2024-09-21T06:34:53.795 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:34:53.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:34:53.908 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/pool-perm} email: pdonnell@redhat.com first_in_suite: false job_id: '7913561' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjjr7Q+pYSIMrgcvc2LrWmyfWeYoUDcECKxHGyHaSb7S2JethfZIWgk+MLLbSkLK6uKRe0kjcukkWR3+NAHuS8= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXDSwTEoQIWAHemkMqByKkVOQ83Z8XZfncbZi32JboJgtrD4+arTAubYFQrZgTBy2LKLAPMkPMMWKGBBqygUPw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:34:53.909 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:34:53.909 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:34:53.909 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:34:53.911 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:34:53.931 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:34:53.931 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:34:53.931 INFO:teuthology.packaging:ref: None 2024-09-21T06:34:53.931 INFO:teuthology.packaging:tag: None 2024-09-21T06:34:53.931 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:34:53.931 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:34:53.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:34:54.088 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:34:54.089 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:34:54.097 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:34:54.097 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:34:54.122 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:34:54.142 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:34:54.148 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:34:54.174 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:29:50.079764', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjjr7Q+pYSIMrgcvc2LrWmyfWeYoUDcECKxHGyHaSb7S2JethfZIWgk+MLLbSkLK6uKRe0kjcukkWR3+NAHuS8='} 2024-09-21T06:34:54.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:29:50.081277', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXDSwTEoQIWAHemkMqByKkVOQ83Z8XZfncbZi32JboJgtrD4+arTAubYFQrZgTBy2LKLAPMkPMMWKGBBqygUPw='} 2024-09-21T06:34:54.194 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:34:54.201 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T06:34:54.201 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T06:34:54.201 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:34:54.285 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc5e2ac0160>, signals=[15]) 2024-09-21T06:34:54.285 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:34:54.291 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:34:54.291 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:34:54.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:34:54.369 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:34:54.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:34:54.443 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:34:54.449 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-21T06:34:54.467 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-21T06:34:54.467 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:34:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:34:54.526 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:34:54.526 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:34:54.526 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:34:54.526 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:34:54.526 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-21T06:34:54.548 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-21T06:34:54.567 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-21T06:34:54.567 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-21T06:34:54.625 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-21T06:34:54.625 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-21T06:34:54.625 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-21T06:34:54.625 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:34:54.625 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-21T06:34:54.625 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:34:54.626 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:34:54.626 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-21T06:34:54.648 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:34:54.657 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:34:54.706 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:34:54.707 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:34:54.709 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:34:54.726 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:34:54.740 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:34:54.740 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:34:54.767 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:34:54.792 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:34:54.846 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:34:54.864 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:34:54.864 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-21T06:34:54.864 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:34:54.865 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:34:54.865 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:34:54.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:54.882 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-21T06:34:54.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:34:54.883 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-21T06:34:54.941 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:34:54.941 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-21T06:34:54.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-21T06:34:54.943 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:34:54.943 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-21T06:34:54.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-21T06:34:57.496 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T06:34:59.355 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-21T06:35:00.697 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.3 MB 00:04 2024-09-21T06:35:03.298 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-21T06:35:04.397 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-21T06:35:05.948 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-21T06:35:07.094 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T06:35:07.507 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T06:35:09.107 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-21T06:35:09.903 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T06:35:12.425 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T06:35:14.348 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:35:14.348 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:35:14.438 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-21T06:35:14.450 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T06:35:14.450 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-21T06:35:14.450 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T06:35:14.450 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-21T06:35:14.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:35:14.452 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-21T06:35:14.452 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-21T06:35:14.452 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-21T06:35:14.826 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 377 kB/s | 36 kB 00:00 2024-09-21T06:35:15.210 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-21T06:35:15.301 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T06:35:15.652 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-21T06:35:15.944 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-21T06:35:15.944 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:35:15.944 INFO:teuthology.orchestra.run.smithi081.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-21T06:35:16.628 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-21T06:35:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-21T06:35:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-21T06:35:17.232 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:35:17.232 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:35:17.326 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-21T06:35:17.335 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-21T06:35:17.336 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:35:17.336 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-21T06:35:17.336 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-21T06:35:17.336 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-21T06:35:17.702 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 331 kB/s | 36 kB 00:00 2024-09-21T06:35:17.892 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-21T06:35:17.892 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-21T06:35:20.310 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-21T06:35:21.025 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:35:21.106 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:35:22.035 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.5 MB/s | 16 MB 00:04 2024-09-21T06:35:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:35:24.008 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:35:28.822 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:35:29.379 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:35:30.934 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-21T06:35:33.867 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-21T06:35:33.868 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:35:33.868 INFO:teuthology.orchestra.run.smithi089.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-21T06:35:34.206 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:35:34.549 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-21T06:35:34.905 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-21T06:35:34.905 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-21T06:35:35.896 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-21T06:35:35.896 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-21T06:35:38.394 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-21T06:35:39.078 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:35:39.160 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:35:41.919 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:35:42.064 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:35:46.901 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:35:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:35:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:12.087 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:36:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:36:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:36:13.245 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:13.245 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:36:13.246 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-21T06:36:13.246 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:36:13.246 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:36:13.246 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:36:13.246 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:36:13.246 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:36:13.246 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-21T06:36:13.588 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:36:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:36:13.669 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:36:13.669 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:36:13.669 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:36:13.669 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:36:13.669 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T06:36:13.669 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:36:13.670 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:36:13.728 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:36:13.728 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:36:13.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-21T06:36:13.773 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-21T06:36:13.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:36:13.775 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:36:13.775 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:36:13.775 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:36:13.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:36:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-21T06:36:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:36:15.699 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-21T06:36:15.701 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-21T06:36:15.717 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.qJb37qlxLM 2024-09-21T06:36:15.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qJb37qlxLM 2024-09-21T06:36:15.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.qJb37qlxLM 2024-09-21T06:36:15.955 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.qJb37qlxLM is 6KB 2024-09-21T06:36:15.994 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.qJb37qlxLM 2024-09-21T06:36:16.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:36:16.079 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:36:16.079 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:36:16.079 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:36:16.079 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:36:16.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:36:16.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-21T06:36:29.916 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:29.961 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:30.327 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:30.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:36:30.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:36:30.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:36:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:36:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:36:31.193 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-21T06:36:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:36:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:36:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:36:31.193 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:36:31.194 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:36:31.194 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-21T06:36:31.557 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:36:31.645 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:36:31.646 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:36:31.646 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:36:31.646 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:36:31.646 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:36:31.646 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-21T06:36:31.646 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:36:31.646 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:36:31.705 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:36:31.706 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:36:31.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-21T06:36:31.737 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:36:31.738 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:36:31.739 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:36:31.740 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:36:31.740 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:36:31.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:36:32.339 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-21T06:36:33.673 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:36:33.714 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-21T06:36:33.717 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-21T06:36:33.732 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.uXitEsoXZI 2024-09-21T06:36:33.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uXitEsoXZI 2024-09-21T06:36:33.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.uXitEsoXZI 2024-09-21T06:36:33.943 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.uXitEsoXZI is 6KB 2024-09-21T06:36:33.964 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.uXitEsoXZI 2024-09-21T06:36:33.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:36:34.042 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:36:34.043 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:36:34.043 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:36:34.043 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:36:34.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:36:34.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-21T06:36:46.242 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:36:46.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T06:36:46.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:37:04.213 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T06:37:04.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T06:37:04.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:37:22.543 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T06:37:31.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T06:37:31.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:37:34.607 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T06:37:46.328 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T06:37:46.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T06:37:46.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:37:55.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T06:37:55.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:37:55.819 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-21T06:37:56.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T06:37:56.239 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:37:56.239 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-21T06:37:56.253 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:37:56.253 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:37:56.253 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:37:56.254 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:37:57.255 DEBUG:teuthology.parallel:result is None 2024-09-21T06:38:05.039 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2024-09-21T06:38:20.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T06:38:20.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:38:20.594 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-21T06:38:21.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T06:38:21.023 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:38:21.024 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-21T06:38:21.044 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:38:21.044 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:38:21.045 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:38:21.045 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:38:22.046 DEBUG:teuthology.parallel:result is None 2024-09-21T06:38:22.046 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:38:22.059 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:38:22.059 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:38:22.063 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:38:22.110 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:38:22.120 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:38:22.154 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:38:22.154 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:38:22.157 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:38:22.212 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:38:22.218 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:38:22.218 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:38:22.227 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:38:22.337 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:38:22.378 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:38:22.381 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:38:22.391 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:38:22.393 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:38:22.400 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:38:22.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:38:22.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:38:22.473 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:38:22.482 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:38:22.482 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:38:22.485 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:38:22.531 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:38:22.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:38:22.633 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:38:22.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:38:22.759 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:38:22.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:38:22.825 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:38:22.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:38:23.105 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:38:23.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:38:23.193 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:38:23.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:38:23.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-21T06:38:23.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-21T06:38:23.317 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:38:23.393 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:38:23.823 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:38:23.831 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:38:23.831 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:38:23.866 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:38:23.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-21T06:38:23.959 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-21T06:38:23.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-21T06:38:24.014 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-21T06:38:24.016 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:38:24.016 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-21T06:38:24.044 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-21T06:38:24.044 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-21T06:38:24.064 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-21T06:38:24.064 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:38:24.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:38:24.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:38:24.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:38:24.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:38:24.137 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:38:24.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:38:24.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:38:24.212 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:38:24.228 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:38:24.238 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:38:24.239 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:42:07.057 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2024-09-21T06:42:07.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T06:42:07.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:42:07.134 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-21T06:42:07.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-21T06:42:07.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T06:42:07.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:42:07.289 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-21T06:42:07.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-21T06:42:07.376 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:42:07.386 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:42:07.386 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:42:07.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:42:07.389 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:42:07.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:42:07.421 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:42:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:42:07.449 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:42:07.463 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-21T06:42:07.465 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:42:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-21T06:42:07.490 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:42:07.492 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-21T06:42:07.504 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-21T06:42:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:42:07.518 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:42:07.533 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-21T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:42:07.595 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:42:07.595 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-21T06:42:07.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.595 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:42:07.596 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:42:07.612 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:42:07.612 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:42:07.612 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:42:07.612 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:42:07.617 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:42:07.617 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:42:07.617 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:42:07.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:42:07.619 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:42:07.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:42:07.768 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:42:07.769 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:42:07.772 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:42:07.772 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:42:07.876 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:42:07.876 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:42:07.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:42:07.886 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:42:07.887 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:42:07.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:42:07.903 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:42:07.903 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:42:07.912 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:42:07.912 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:42:07.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:42:07.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:42:08.043 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:42:08.053 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:42:08.108 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-21T06:42:08.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-21T06:42:08.117 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-21T06:42:08.119 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-21T06:42:08.338 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-21T06:42:08.349 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-21T06:42:08.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:42:08.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:42:08.929 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-21T06:42:08.939 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-21T06:42:09.229 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T06:42:09.239 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T06:42:09.505 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T06:42:09.507 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T06:42:10.524 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.3 MB 00:00 2024-09-21T06:42:11.047 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.3 MB 00:01 2024-09-21T06:42:12.998 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-21T06:42:17.941 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.5 MB 00:01 2024-09-21T06:42:19.592 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-21T06:42:20.712 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T06:42:26.110 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T06:42:28.329 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:42:28.329 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:42:28.340 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:42:28.341 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:42:28.342 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:42:28.343 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:42:28.345 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:42:28.347 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:42:28.348 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:42:28.410 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-21T06:42:28.430 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:42:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:42:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:42:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:42:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:42:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:42:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:42:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:42:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:42:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:42:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:42:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:42:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:42:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:42:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:42:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:42:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:42:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:42:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:42:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:42:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:42:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:42:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:42:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:42:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:42:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:42:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:42:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout:Install 149 Packages 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-21T06:42:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:42:28.446 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 228 M 2024-09-21T06:42:28.446 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-21T06:42:28.820 INFO:teuthology.orchestra.run.smithi081.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-21T06:42:29.003 INFO:teuthology.orchestra.run.smithi081.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T06:42:29.095 INFO:teuthology.orchestra.run.smithi081.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T06:42:29.179 INFO:teuthology.orchestra.run.smithi081.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:42:29.280 INFO:teuthology.orchestra.run.smithi081.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 15 MB/s | 1.5 MB 00:00 2024-09-21T06:42:29.329 INFO:teuthology.orchestra.run.smithi081.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-21T06:42:29.580 INFO:teuthology.orchestra.run.smithi081.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T06:42:29.805 INFO:teuthology.orchestra.run.smithi081.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T06:42:29.847 INFO:teuthology.orchestra.run.smithi081.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 608 kB/s | 25 kB 00:00 2024-09-21T06:42:30.372 INFO:teuthology.orchestra.run.smithi081.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T06:42:30.465 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-21T06:42:30.489 INFO:teuthology.orchestra.run.smithi081.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 11 MB/s | 10 MB 00:00 2024-09-21T06:42:30.514 INFO:teuthology.orchestra.run.smithi081.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 648 kB/s | 27 kB 00:00 2024-09-21T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 950 kB/s | 32 kB 00:00 2024-09-21T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T06:42:30.657 INFO:teuthology.orchestra.run.smithi081.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T06:42:30.683 INFO:teuthology.orchestra.run.smithi081.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T06:42:30.758 INFO:teuthology.orchestra.run.smithi081.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 603 kB/s | 45 kB 00:00 2024-09-21T06:42:30.833 INFO:teuthology.orchestra.run.smithi081.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T06:42:30.908 INFO:teuthology.orchestra.run.smithi081.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T06:42:31.034 INFO:teuthology.orchestra.run.smithi081.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.1 MB/s | 321 kB 00:00 2024-09-21T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:42:31.202 INFO:teuthology.orchestra.run.smithi081.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T06:42:31.252 INFO:teuthology.orchestra.run.smithi081.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 22 MB/s | 3.1 MB 00:00 2024-09-21T06:42:31.278 INFO:teuthology.orchestra.run.smithi081.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 455 kB/s | 34 kB 00:00 2024-09-21T06:42:31.378 INFO:teuthology.orchestra.run.smithi081.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.2 MB/s | 154 kB 00:00 2024-09-21T06:42:31.812 INFO:teuthology.orchestra.run.smithi081.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 20 MB/s | 40 MB 00:01 2024-09-21T06:42:31.862 INFO:teuthology.orchestra.run.smithi081.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T06:42:31.963 INFO:teuthology.orchestra.run.smithi081.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-09-21T06:42:31.988 INFO:teuthology.orchestra.run.smithi081.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 395 kB/s | 49 kB 00:00 2024-09-21T06:42:32.013 INFO:teuthology.orchestra.run.smithi081.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T06:42:32.046 INFO:teuthology.orchestra.run.smithi081.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T06:42:32.080 INFO:teuthology.orchestra.run.smithi081.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T06:42:32.105 INFO:teuthology.orchestra.run.smithi081.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 314 kB/s | 18 kB 00:00 2024-09-21T06:42:32.256 INFO:teuthology.orchestra.run.smithi081.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T06:42:32.381 INFO:teuthology.orchestra.run.smithi081.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 266 kB/s | 80 kB 00:00 2024-09-21T06:42:32.414 INFO:teuthology.orchestra.run.smithi081.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T06:42:32.473 INFO:teuthology.orchestra.run.smithi081.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-21T06:42:32.515 INFO:teuthology.orchestra.run.smithi081.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-21T06:42:32.540 INFO:teuthology.orchestra.run.smithi081.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T06:42:32.565 INFO:teuthology.orchestra.run.smithi081.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:42:32.591 INFO:teuthology.orchestra.run.smithi081.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T06:42:32.624 INFO:teuthology.orchestra.run.smithi081.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-09-21T06:42:32.650 INFO:teuthology.orchestra.run.smithi081.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T06:42:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-21T06:42:33.217 INFO:teuthology.orchestra.run.smithi081.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-21T06:42:33.434 INFO:teuthology.orchestra.run.smithi081.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 817 kB/s | 689 kB 00:00 2024-09-21T06:42:33.501 INFO:teuthology.orchestra.run.smithi081.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-21T06:42:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-21T06:42:33.576 INFO:teuthology.orchestra.run.smithi081.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 991 kB/s | 943 kB 00:00 2024-09-21T06:42:33.652 INFO:teuthology.orchestra.run.smithi081.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-21T06:42:33.685 INFO:teuthology.orchestra.run.smithi081.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-21T06:42:33.761 INFO:teuthology.orchestra.run.smithi081.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T06:42:33.803 INFO:teuthology.orchestra.run.smithi081.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T06:42:33.870 INFO:teuthology.orchestra.run.smithi081.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-21T06:42:34.011 INFO:teuthology.orchestra.run.smithi081.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-21T06:42:34.037 INFO:teuthology.orchestra.run.smithi081.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-09-21T06:42:34.120 INFO:teuthology.orchestra.run.smithi081.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-21T06:42:34.145 INFO:teuthology.orchestra.run.smithi081.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-21T06:42:34.179 INFO:teuthology.orchestra.run.smithi081.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2024-09-21T06:42:34.238 INFO:teuthology.orchestra.run.smithi081.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T06:42:34.263 INFO:teuthology.orchestra.run.smithi081.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T06:42:34.288 INFO:teuthology.orchestra.run.smithi081.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-21T06:42:34.513 INFO:teuthology.orchestra.run.smithi081.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-09-21T06:42:34.639 INFO:teuthology.orchestra.run.smithi081.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-21T06:42:34.756 INFO:teuthology.orchestra.run.smithi081.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.7 MB/s | 4.9 MB 00:00 2024-09-21T06:42:35.398 INFO:teuthology.orchestra.run.smithi081.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-21T06:42:35.515 INFO:teuthology.orchestra.run.smithi081.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 750 kB/s | 87 kB 00:00 2024-09-21T06:42:35.583 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-21T06:42:36.982 INFO:teuthology.orchestra.run.smithi081.stdout:(74/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.1 MB/s | 6.0 MB 00:01 2024-09-21T06:42:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 526 kB/s | 61 kB 00:00 2024-09-21T06:42:37.190 INFO:teuthology.orchestra.run.smithi081.stdout:(76/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.5 MB/s | 4.4 MB 00:02 2024-09-21T06:42:37.216 INFO:teuthology.orchestra.run.smithi081.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T06:42:37.332 INFO:teuthology.orchestra.run.smithi081.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-21T06:42:37.417 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-21T06:42:37.449 INFO:teuthology.orchestra.run.smithi081.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-21T06:42:37.567 INFO:teuthology.orchestra.run.smithi081.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T06:42:37.592 INFO:teuthology.orchestra.run.smithi081.stdout:(81/157): python3-jinja2-2.11.3-6.el9.noarch.rp 619 kB/s | 248 kB 00:00 2024-09-21T06:42:37.676 INFO:teuthology.orchestra.run.smithi081.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 319 kB/s | 35 kB 00:00 2024-09-21T06:42:37.784 INFO:teuthology.orchestra.run.smithi081.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T06:42:37.901 INFO:teuthology.orchestra.run.smithi081.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T06:42:38.010 INFO:teuthology.orchestra.run.smithi081.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 712 kB/s | 77 kB 00:00 2024-09-21T06:42:38.110 INFO:teuthology.orchestra.run.smithi081.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-09-21T06:42:38.227 INFO:teuthology.orchestra.run.smithi081.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-21T06:42:38.344 INFO:teuthology.orchestra.run.smithi081.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T06:42:38.461 INFO:teuthology.orchestra.run.smithi081.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T06:42:38.504 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T06:42:38.569 INFO:teuthology.orchestra.run.smithi081.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-21T06:42:38.678 INFO:teuthology.orchestra.run.smithi081.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 496 kB/s | 54 kB 00:00 2024-09-21T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout:(92/157): postgresql-server-13.16-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-09-21T06:42:40.779 INFO:teuthology.orchestra.run.smithi081.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 358 kB/s | 42 kB 00:00 2024-09-21T06:42:40.887 INFO:teuthology.orchestra.run.smithi081.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-21T06:42:41.037 INFO:teuthology.orchestra.run.smithi081.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-21T06:42:41.146 INFO:teuthology.orchestra.run.smithi081.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 332 kB/s | 36 kB 00:00 2024-09-21T06:42:41.263 INFO:teuthology.orchestra.run.smithi081.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 407 kB/s | 47 kB 00:00 2024-09-21T06:42:41.388 INFO:teuthology.orchestra.run.smithi081.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T06:42:41.505 INFO:teuthology.orchestra.run.smithi081.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 496 kB/s | 58 kB 00:00 2024-09-21T06:42:41.623 INFO:teuthology.orchestra.run.smithi081.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 821 kB/s | 96 kB 00:00 2024-09-21T06:42:41.731 INFO:teuthology.orchestra.run.smithi081.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-09-21T06:42:41.839 INFO:teuthology.orchestra.run.smithi081.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-21T06:42:41.956 INFO:teuthology.orchestra.run.smithi081.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-21T06:42:42.098 INFO:teuthology.orchestra.run.smithi081.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 6.0 MB/s | 863 kB 00:00 2024-09-21T06:42:42.149 INFO:teuthology.orchestra.run.smithi081.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:42:42.182 INFO:teuthology.orchestra.run.smithi081.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T06:42:42.207 INFO:teuthology.orchestra.run.smithi081.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-21T06:42:42.316 INFO:teuthology.orchestra.run.smithi081.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T06:42:42.341 INFO:teuthology.orchestra.run.smithi081.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:42:42.375 INFO:teuthology.orchestra.run.smithi081.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-21T06:42:42.400 INFO:teuthology.orchestra.run.smithi081.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:42:42.425 INFO:teuthology.orchestra.run.smithi081.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:42:42.584 INFO:teuthology.orchestra.run.smithi081.stdout:(113/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.2 MB/s | 16 MB 00:03 2024-09-21T06:42:42.626 INFO:teuthology.orchestra.run.smithi081.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-09-21T06:42:42.660 INFO:teuthology.orchestra.run.smithi081.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-21T06:42:42.685 INFO:teuthology.orchestra.run.smithi081.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:42:42.710 INFO:teuthology.orchestra.run.smithi081.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-21T06:42:42.736 INFO:teuthology.orchestra.run.smithi081.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:42:42.769 INFO:teuthology.orchestra.run.smithi081.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-21T06:42:42.803 INFO:teuthology.orchestra.run.smithi081.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T06:42:42.828 INFO:teuthology.orchestra.run.smithi081.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T06:42:42.853 INFO:teuthology.orchestra.run.smithi081.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:42:42.887 INFO:teuthology.orchestra.run.smithi081.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-21T06:42:42.912 INFO:teuthology.orchestra.run.smithi081.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T06:42:42.937 INFO:teuthology.orchestra.run.smithi081.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-21T06:42:42.963 INFO:teuthology.orchestra.run.smithi081.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-21T06:42:42.980 INFO:teuthology.orchestra.run.smithi081.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T06:42:42.997 INFO:teuthology.orchestra.run.smithi081.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.1 MB/s | 20 kB 00:00 2024-09-21T06:42:43.039 INFO:teuthology.orchestra.run.smithi081.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 25 MB/s | 1.0 MB 00:00 2024-09-21T06:42:43.081 INFO:teuthology.orchestra.run.smithi081.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-21T06:42:43.098 INFO:teuthology.orchestra.run.smithi081.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 789 kB/s | 46 kB 00:00 2024-09-21T06:42:43.148 INFO:teuthology.orchestra.run.smithi081.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-21T06:42:43.173 INFO:teuthology.orchestra.run.smithi081.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-09-21T06:42:43.198 INFO:teuthology.orchestra.run.smithi081.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-21T06:42:43.224 INFO:teuthology.orchestra.run.smithi081.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:42:43.249 INFO:teuthology.orchestra.run.smithi081.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T06:42:43.299 INFO:teuthology.orchestra.run.smithi081.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-09-21T06:42:43.324 INFO:teuthology.orchestra.run.smithi081.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-21T06:42:43.350 INFO:teuthology.orchestra.run.smithi081.stdout:(139/157): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-21T06:42:43.375 INFO:teuthology.orchestra.run.smithi081.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T06:42:43.401 INFO:teuthology.orchestra.run.smithi081.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T06:42:43.426 INFO:teuthology.orchestra.run.smithi081.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T06:42:43.451 INFO:teuthology.orchestra.run.smithi081.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:42:43.476 INFO:teuthology.orchestra.run.smithi081.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:42:43.502 INFO:teuthology.orchestra.run.smithi081.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-21T06:42:43.535 INFO:teuthology.orchestra.run.smithi081.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-21T06:42:43.560 INFO:teuthology.orchestra.run.smithi081.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T06:42:43.619 INFO:teuthology.orchestra.run.smithi081.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-21T06:42:43.878 INFO:teuthology.orchestra.run.smithi081.stdout:(149/157): python3-numpy-1.20.1-5.el9.x86_64.rp 830 kB/s | 5.1 MB 00:06 2024-09-21T06:42:43.936 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T06:42:43.953 INFO:teuthology.orchestra.run.smithi081.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.6 MB/s | 3.4 MB 00:00 2024-09-21T06:42:44.053 INFO:teuthology.orchestra.run.smithi081.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.3 MB/s | 3.2 MB 00:00 2024-09-21T06:42:44.153 INFO:teuthology.orchestra.run.smithi081.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 8.4 MB/s | 2.3 MB 00:00 2024-09-21T06:42:44.178 INFO:teuthology.orchestra.run.smithi081.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 327 kB/s | 41 kB 00:00 2024-09-21T06:42:44.204 INFO:teuthology.orchestra.run.smithi081.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T06:42:44.288 INFO:teuthology.orchestra.run.smithi081.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-21T06:42:44.321 INFO:teuthology.orchestra.run.smithi081.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.9 MB/s | 1.8 MB 00:00 2024-09-21T06:42:44.396 INFO:teuthology.orchestra.run.smithi081.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 1.4 MB 00:00 2024-09-21T06:42:44.402 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:42:44.402 INFO:teuthology.orchestra.run.smithi081.stdout:Total 14 MB/s | 228 MB 00:15 2024-09-21T06:42:45.639 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-21T06:42:45.793 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-21T06:42:45.793 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-21T06:42:46.148 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:42:46.149 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:42:46.162 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:42:46.163 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:42:46.164 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:42:46.165 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:42:46.167 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:42:46.170 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:42:46.171 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:42:46.234 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:42:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:42:46.262 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:42:46.263 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:42:46.264 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:42:46.265 INFO:teuthology.orchestra.run.smithi089.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:42:46.266 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:42:46.267 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:42:46.268 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:42:46.269 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:42:46.270 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:42:46.271 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout:Install 149 Packages 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 8 Packages 2024-09-21T06:42:46.272 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:42:46.273 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 228 M 2024-09-21T06:42:46.273 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-21T06:42:47.037 INFO:teuthology.orchestra.run.smithi089.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-21T06:42:47.246 INFO:teuthology.orchestra.run.smithi089.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T06:42:47.321 INFO:teuthology.orchestra.run.smithi089.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T06:42:47.455 INFO:teuthology.orchestra.run.smithi089.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T06:42:47.539 INFO:teuthology.orchestra.run.smithi089.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T06:42:47.589 INFO:teuthology.orchestra.run.smithi089.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T06:42:47.923 INFO:teuthology.orchestra.run.smithi089.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-21T06:42:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-21T06:42:48.043 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-21T06:42:48.143 INFO:teuthology.orchestra.run.smithi089.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T06:42:48.190 INFO:teuthology.orchestra.run.smithi089.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T06:42:48.657 INFO:teuthology.orchestra.run.smithi089.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T06:42:48.782 INFO:teuthology.orchestra.run.smithi089.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T06:42:48.807 INFO:teuthology.orchestra.run.smithi089.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.5 MB/s | 226 kB 00:00 2024-09-21T06:42:48.824 INFO:teuthology.orchestra.run.smithi089.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 647 kB/s | 27 kB 00:00 2024-09-21T06:42:48.849 INFO:teuthology.orchestra.run.smithi089.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 756 kB/s | 32 kB 00:00 2024-09-21T06:42:48.900 INFO:teuthology.orchestra.run.smithi089.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 766 kB 00:00 2024-09-21T06:42:48.925 INFO:teuthology.orchestra.run.smithi089.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T06:42:48.950 INFO:teuthology.orchestra.run.smithi089.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:42:48.984 INFO:teuthology.orchestra.run.smithi089.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.4 MB/s | 507 kB 00:00 2024-09-21T06:42:49.051 INFO:teuthology.orchestra.run.smithi089.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 676 kB/s | 45 kB 00:00 2024-09-21T06:42:49.118 INFO:teuthology.orchestra.run.smithi089.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T06:42:49.219 INFO:teuthology.orchestra.run.smithi089.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-21T06:42:49.244 INFO:teuthology.orchestra.run.smithi089.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.3 MB/s | 161 kB 00:00 2024-09-21T06:42:49.269 INFO:teuthology.orchestra.run.smithi089.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.2 MB/s | 321 kB 00:00 2024-09-21T06:42:49.311 INFO:teuthology.orchestra.run.smithi089.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T06:42:49.337 INFO:teuthology.orchestra.run.smithi089.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.4 MB/s | 99 kB 00:00 2024-09-21T06:42:49.362 INFO:teuthology.orchestra.run.smithi089.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:42:49.429 INFO:teuthology.orchestra.run.smithi089.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T06:42:49.530 INFO:teuthology.orchestra.run.smithi089.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 16 MB/s | 3.1 MB 00:00 2024-09-21T06:42:49.555 INFO:teuthology.orchestra.run.smithi089.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 273 kB/s | 34 kB 00:00 2024-09-21T06:42:49.580 INFO:teuthology.orchestra.run.smithi089.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:42:50.030 INFO:teuthology.orchestra.run.smithi089.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-21T06:42:50.431 INFO:teuthology.orchestra.run.smithi089.stdout:(32/157): ceph-test-19.3.0-5120.g18432218.el9.x 18 MB/s | 40 MB 00:02 2024-09-21T06:42:50.456 INFO:teuthology.orchestra.run.smithi089.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 686 kB/s | 292 kB 00:00 2024-09-21T06:42:50.481 INFO:teuthology.orchestra.run.smithi089.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 989 kB/s | 49 kB 00:00 2024-09-21T06:42:50.507 INFO:teuthology.orchestra.run.smithi089.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 327 kB/s | 16 kB 00:00 2024-09-21T06:42:50.540 INFO:teuthology.orchestra.run.smithi089.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T06:42:50.582 INFO:teuthology.orchestra.run.smithi089.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 442 kB/s | 18 kB 00:00 2024-09-21T06:42:50.607 INFO:teuthology.orchestra.run.smithi089.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.6 MB/s | 784 kB 00:00 2024-09-21T06:42:50.783 INFO:teuthology.orchestra.run.smithi089.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T06:42:50.808 INFO:teuthology.orchestra.run.smithi089.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 354 kB/s | 80 kB 00:00 2024-09-21T06:42:50.984 INFO:teuthology.orchestra.run.smithi089.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-21T06:42:51.009 INFO:teuthology.orchestra.run.smithi089.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 848 kB/s | 191 kB 00:00 2024-09-21T06:42:51.059 INFO:teuthology.orchestra.run.smithi089.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T06:42:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:(44/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-21T06:42:51.118 INFO:teuthology.orchestra.run.smithi089.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-21T06:42:51.160 INFO:teuthology.orchestra.run.smithi089.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 6.9 MB/s | 1.2 MB 00:00 2024-09-21T06:42:51.186 INFO:teuthology.orchestra.run.smithi089.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-21T06:42:51.211 INFO:teuthology.orchestra.run.smithi089.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T06:42:51.320 INFO:teuthology.orchestra.run.smithi089.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 4.2 MB/s | 689 kB 00:00 2024-09-21T06:42:51.362 INFO:teuthology.orchestra.run.smithi089.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 712 kB/s | 107 kB 00:00 2024-09-21T06:42:51.387 INFO:teuthology.orchestra.run.smithi089.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-21T06:42:51.413 INFO:teuthology.orchestra.run.smithi089.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-21T06:42:51.446 INFO:teuthology.orchestra.run.smithi089.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-21T06:42:51.480 INFO:teuthology.orchestra.run.smithi089.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T06:42:51.513 INFO:teuthology.orchestra.run.smithi089.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-21T06:42:51.572 INFO:teuthology.orchestra.run.smithi089.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-21T06:42:51.597 INFO:teuthology.orchestra.run.smithi089.stdout:(57/157): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-21T06:42:51.622 INFO:teuthology.orchestra.run.smithi089.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T06:42:51.648 INFO:teuthology.orchestra.run.smithi089.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-21T06:42:51.673 INFO:teuthology.orchestra.run.smithi089.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-09-21T06:42:51.723 INFO:teuthology.orchestra.run.smithi089.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-21T06:42:51.749 INFO:teuthology.orchestra.run.smithi089.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-21T06:42:51.774 INFO:teuthology.orchestra.run.smithi089.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-21T06:42:51.799 INFO:teuthology.orchestra.run.smithi089.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-21T06:42:51.826 INFO:teuthology.orchestra.run.smithi089.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-21T06:42:51.850 INFO:teuthology.orchestra.run.smithi089.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T06:42:51.876 INFO:teuthology.orchestra.run.smithi089.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-21T06:42:51.976 INFO:teuthology.orchestra.run.smithi089.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-21T06:42:52.017 INFO:teuthology.orchestra.run.smithi089.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T06:42:52.052 INFO:teuthology.orchestra.run.smithi089.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T06:42:52.118 INFO:teuthology.orchestra.run.smithi089.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-21T06:42:52.152 INFO:teuthology.orchestra.run.smithi089.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.0 MB/s | 137 kB 00:00 2024-09-21T06:42:52.194 INFO:teuthology.orchestra.run.smithi089.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T06:42:52.220 INFO:teuthology.orchestra.run.smithi089.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T06:42:52.303 INFO:teuthology.orchestra.run.smithi089.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-21T06:42:52.329 INFO:teuthology.orchestra.run.smithi089.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-21T06:42:52.362 INFO:teuthology.orchestra.run.smithi089.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T06:42:52.437 INFO:teuthology.orchestra.run.smithi089.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-09-21T06:42:52.454 INFO:teuthology.orchestra.run.smithi089.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 279 kB/s | 26 kB 00:00 2024-09-21T06:42:52.480 INFO:teuthology.orchestra.run.smithi089.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T06:42:52.496 INFO:teuthology.orchestra.run.smithi089.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-09-21T06:42:52.522 INFO:teuthology.orchestra.run.smithi089.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-21T06:42:52.556 INFO:teuthology.orchestra.run.smithi089.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-21T06:42:52.589 INFO:teuthology.orchestra.run.smithi089.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T06:42:52.623 INFO:teuthology.orchestra.run.smithi089.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-21T06:42:52.648 INFO:teuthology.orchestra.run.smithi089.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T06:42:52.723 INFO:teuthology.orchestra.run.smithi089.stdout:(87/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-21T06:42:52.749 INFO:teuthology.orchestra.run.smithi089.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 337 kB/s | 42 kB 00:00 2024-09-21T06:42:52.774 INFO:teuthology.orchestra.run.smithi089.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-21T06:42:52.799 INFO:teuthology.orchestra.run.smithi089.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T06:42:52.833 INFO:teuthology.orchestra.run.smithi089.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-21T06:42:52.858 INFO:teuthology.orchestra.run.smithi089.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-21T06:42:52.884 INFO:teuthology.orchestra.run.smithi089.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 638 kB/s | 54 kB 00:00 2024-09-21T06:42:52.917 INFO:teuthology.orchestra.run.smithi089.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-09-21T06:42:52.951 INFO:teuthology.orchestra.run.smithi089.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-09-21T06:42:52.976 INFO:teuthology.orchestra.run.smithi089.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T06:42:53.010 INFO:teuthology.orchestra.run.smithi089.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-09-21T06:42:53.036 INFO:teuthology.orchestra.run.smithi089.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-09-21T06:42:53.077 INFO:teuthology.orchestra.run.smithi089.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-21T06:42:53.103 INFO:teuthology.orchestra.run.smithi089.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 864 kB/s | 58 kB 00:00 2024-09-21T06:42:53.262 INFO:teuthology.orchestra.run.smithi089.stdout:(101/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-21T06:42:53.287 INFO:teuthology.orchestra.run.smithi089.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 347 kB/s | 64 kB 00:00 2024-09-21T06:42:53.312 INFO:teuthology.orchestra.run.smithi089.stdout:(103/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 409 kB/s | 96 kB 00:00 2024-09-21T06:42:53.337 INFO:teuthology.orchestra.run.smithi089.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-21T06:42:53.396 INFO:teuthology.orchestra.run.smithi089.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T06:42:53.430 INFO:teuthology.orchestra.run.smithi089.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:42:53.455 INFO:teuthology.orchestra.run.smithi089.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-21T06:42:53.564 INFO:teuthology.orchestra.run.smithi089.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T06:42:53.589 INFO:teuthology.orchestra.run.smithi089.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:42:53.614 INFO:teuthology.orchestra.run.smithi089.stdout:(110/157): lua-devel-5.4.4-4.el9.x86_64.rpm 68 kB/s | 22 kB 00:00 2024-09-21T06:42:53.648 INFO:teuthology.orchestra.run.smithi089.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-09-21T06:42:53.673 INFO:teuthology.orchestra.run.smithi089.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.3 MB/s | 151 kB 00:00 2024-09-21T06:42:53.698 INFO:teuthology.orchestra.run.smithi089.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 803 kB/s | 67 kB 00:00 2024-09-21T06:42:53.740 INFO:teuthology.orchestra.run.smithi089.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-21T06:42:53.766 INFO:teuthology.orchestra.run.smithi089.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:42:53.791 INFO:teuthology.orchestra.run.smithi089.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:42:53.816 INFO:teuthology.orchestra.run.smithi089.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-21T06:42:53.842 INFO:teuthology.orchestra.run.smithi089.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-09-21T06:42:53.867 INFO:teuthology.orchestra.run.smithi089.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T06:42:53.892 INFO:teuthology.orchestra.run.smithi089.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T06:42:53.918 INFO:teuthology.orchestra.run.smithi089.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T06:42:53.943 INFO:teuthology.orchestra.run.smithi089.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:42:53.977 INFO:teuthology.orchestra.run.smithi089.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T06:42:54.002 INFO:teuthology.orchestra.run.smithi089.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-21T06:42:54.028 INFO:teuthology.orchestra.run.smithi089.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-21T06:42:54.053 INFO:teuthology.orchestra.run.smithi089.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-21T06:42:54.078 INFO:teuthology.orchestra.run.smithi089.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-21T06:42:54.104 INFO:teuthology.orchestra.run.smithi089.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-21T06:42:54.162 INFO:teuthology.orchestra.run.smithi089.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.3 MB/s | 2.0 MB 00:00 2024-09-21T06:42:54.204 INFO:teuthology.orchestra.run.smithi089.stdout:(130/157): protobuf-compiler-3.14.0-13.el9.x86_ 968 kB/s | 863 kB 00:00 2024-09-21T06:42:54.221 INFO:teuthology.orchestra.run.smithi089.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2024-09-21T06:42:54.247 INFO:teuthology.orchestra.run.smithi089.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.3 MB/s | 58 kB 00:00 2024-09-21T06:42:54.280 INFO:teuthology.orchestra.run.smithi089.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.5 MB/s | 272 kB 00:00 2024-09-21T06:42:54.306 INFO:teuthology.orchestra.run.smithi089.stdout:(134/157): python3-more-itertools-8.12.0-2.el9. 782 kB/s | 79 kB 00:00 2024-09-21T06:42:54.322 INFO:teuthology.orchestra.run.smithi089.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-09-21T06:42:54.348 INFO:teuthology.orchestra.run.smithi089.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T06:42:54.373 INFO:teuthology.orchestra.run.smithi089.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T06:42:54.390 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-21T06:42:54.423 INFO:teuthology.orchestra.run.smithi089.stdout:(138/157): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-09-21T06:42:54.448 INFO:teuthology.orchestra.run.smithi089.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-09-21T06:42:54.474 INFO:teuthology.orchestra.run.smithi089.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T06:42:54.499 INFO:teuthology.orchestra.run.smithi089.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-21T06:42:54.533 INFO:teuthology.orchestra.run.smithi089.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-21T06:42:54.542 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:42:54.558 INFO:teuthology.orchestra.run.smithi089.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-21T06:42:54.584 INFO:teuthology.orchestra.run.smithi089.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T06:42:54.609 INFO:teuthology.orchestra.run.smithi089.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T06:42:54.617 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:42:54.634 INFO:teuthology.orchestra.run.smithi089.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-21T06:42:54.660 INFO:teuthology.orchestra.run.smithi089.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:42:54.685 INFO:teuthology.orchestra.run.smithi089.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T06:42:54.752 INFO:teuthology.orchestra.run.smithi089.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T06:42:54.826 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:42:54.902 INFO:teuthology.orchestra.run.smithi089.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T06:42:54.988 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:42:55.012 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:42:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:42:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.6 MB/s | 3.2 MB 00:00 2024-09-21T06:42:55.251 INFO:teuthology.orchestra.run.smithi089.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 276 kB/s | 41 kB 00:00 2024-09-21T06:42:55.293 INFO:teuthology.orchestra.run.smithi089.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.6 MB/s | 1.8 MB 00:00 2024-09-21T06:42:55.360 INFO:teuthology.orchestra.run.smithi089.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-21T06:42:55.417 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:42:55.537 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:42:55.544 INFO:teuthology.orchestra.run.smithi089.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.0 MB/s | 2.3 MB 00:00 2024-09-21T06:42:55.602 INFO:teuthology.orchestra.run.smithi089.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.4 MB/s | 1.4 MB 00:00 2024-09-21T06:42:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:42:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:42:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:42:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:42:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:42:56.007 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:42:56.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:42:56.093 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:42:56.128 INFO:teuthology.orchestra.run.smithi089.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 2.4 MB 00:00 2024-09-21T06:42:56.134 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:42:56.134 INFO:teuthology.orchestra.run.smithi089.stdout:Total 23 MB/s | 228 MB 00:09 2024-09-21T06:42:56.200 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:42:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:42:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:42:56.321 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:42:56.341 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:42:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:42:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:42:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:42:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:42:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:42:57.266 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:42:57.345 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-21T06:42:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:42:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:42:57.459 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:42:57.496 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-21T06:42:57.497 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-21T06:42:57.532 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:42:57.577 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:42:57.627 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:42:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:42:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:42:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:42:57.807 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:42:57.860 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:42:57.892 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:42:57.936 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:42:58.089 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:42:58.117 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:42:58.188 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:42:58.280 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:42:58.314 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:42:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:42:58.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:42:59.031 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:42:59.122 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:42:59.151 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:42:59.194 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:42:59.429 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:42:59.477 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:42:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:42:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:42:59.704 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:42:59.737 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:42:59.755 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-21T06:42:59.755 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-21T06:42:59.773 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:42:59.941 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:43:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:43:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:43:00.259 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:43:00.361 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:43:00.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:43:00.449 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:43:00.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:43:00.508 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:43:00.609 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:43:00.734 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:43:00.786 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:43:00.819 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:43:00.856 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:43:00.895 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:43:00.927 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:43:00.957 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:43:00.992 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:43:01.025 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:43:01.066 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:43:01.101 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:43:01.187 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:43:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:43:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:43:01.373 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:43:01.421 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:43:02.140 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:43:02.186 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:43:02.219 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:43:02.318 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:43:02.366 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:43:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:43:02.499 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:43:02.539 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:43:02.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:43:02.753 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:43:02.830 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:43:03.490 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:43:03.602 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:43:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:43:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:43:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:43:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:43:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:43:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:43:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:43:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:43:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:43:06.009 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:43:06.045 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:43:06.107 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:43:06.123 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-21T06:43:06.130 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:43:06.257 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:43:06.321 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:43:06.507 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:43:06.550 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:43:06.575 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:43:06.637 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:43:07.073 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:43:07.135 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:43:07.263 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:43:07.286 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:43:07.395 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:43:07.433 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:43:07.471 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:43:07.647 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:43:07.714 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:43:07.742 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:43:07.857 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:43:07.885 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:43:07.956 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:43:07.986 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:43:08.006 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:43:08.198 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:43:08.366 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:43:08.450 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:43:08.485 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:43:08.519 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:43:08.634 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:43:08.695 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:43:08.921 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:43:09.025 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:43:09.062 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:43:09.074 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:43:09.109 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:43:09.113 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:43:09.191 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:43:09.205 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:43:09.205 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:43:09.205 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:43:09.205 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:09.242 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:43:09.244 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:43:09.276 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:43:09.319 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:43:09.353 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:43:09.381 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:43:09.449 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:43:09.503 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:43:09.534 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:43:09.590 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:43:09.674 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:43:09.705 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:43:09.749 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:43:09.777 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:43:09.848 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:43:09.892 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:43:09.966 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:43:10.099 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:43:10.162 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:43:10.694 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:43:10.783 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:43:10.812 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:43:10.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:43:10.910 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:43:10.960 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:43:11.103 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:43:11.155 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:43:11.255 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:43:11.311 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:43:11.384 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:43:11.424 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:43:11.468 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:43:11.515 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:43:11.552 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:43:11.595 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:43:11.637 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:43:11.771 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:43:11.856 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:43:11.898 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:43:12.000 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:43:12.040 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:43:12.081 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:43:12.118 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:43:12.142 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:43:12.244 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:43:12.368 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:43:12.409 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:43:12.438 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:43:12.471 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:43:12.510 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:43:12.542 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:43:12.572 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:43:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:43:12.649 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:43:12.690 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:43:12.725 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:43:12.812 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:43:12.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:43:12.904 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:43:13.006 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:43:13.055 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:43:13.770 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:43:13.826 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:43:13.868 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:43:13.969 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:43:14.024 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:43:14.068 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:43:14.158 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:43:14.197 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:43:14.388 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:43:14.419 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:43:14.496 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:43:15.146 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:43:15.269 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:43:16.518 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:43:16.586 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:43:16.631 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:43:16.664 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:43:17.001 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:43:17.052 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:43:17.144 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:43:17.174 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:43:17.211 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:43:17.722 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:43:17.756 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:43:17.827 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:43:17.857 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:43:20.143 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:43:20.188 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:43:20.771 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:43:20.817 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:43:20.908 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:43:20.908 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:43:20.908 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:43:20.908 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:20.952 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-21T06:43:21.054 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:21.227 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:43:21.243 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:43:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:43:21.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:43:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:43:22.874 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:22.874 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:43:22.875 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:43:22.875 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:43:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:23.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:43:23.121 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:43:23.121 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:23.121 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:43:23.121 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:43:23.121 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:43:23.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:23.607 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:43:23.630 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:43:23.630 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:23.630 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:43:23.630 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:43:23.631 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:43:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:23.737 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:43:23.786 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:43:23.841 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:43:24.029 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:43:24.082 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:43:24.159 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:43:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:43:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:43:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:43:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:43:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:43:24.961 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:43:24.990 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:43:25.022 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:43:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:43:25.139 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:43:28.338 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:43:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:43:29.358 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:43:29.387 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:43:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:43:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:43:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:43:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:43:29.721 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:29.721 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:43:29.721 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:43:29.721 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:43:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:43:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:43:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:43:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:43:30.894 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:43:30.925 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:43:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:43:30.949 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:30.949 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:43:30.949 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:43:30.949 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:43:30.949 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:43:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:43:31.016 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:31.016 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:43:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:43:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:43:31.084 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:31.084 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:43:31.084 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:43:31.084 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:43:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:31.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:43:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:43:31.426 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:31.426 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:43:31.426 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:43:31.426 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:43:31.426 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:32.815 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-21T06:43:32.816 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:32.993 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:43:33.010 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:43:33.010 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:33.010 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:43:33.010 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:43:34.632 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:34.857 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:43:34.879 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:43:34.879 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:34.879 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:43:34.879 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:43:34.880 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:43:34.880 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:35.349 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:43:35.372 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:43:35.372 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:35.372 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:43:35.372 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:43:35.372 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:43:35.372 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:35.449 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:43:35.479 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:43:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:43:35.531 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:43:35.544 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:43:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:43:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:43:35.601 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:43:35.787 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:43:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:43:35.842 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:43:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:43:35.891 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:43:35.922 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:43:35.928 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:43:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:43:36.018 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:43:36.174 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:43:36.226 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:43:36.275 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:43:36.303 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:43:36.551 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:43:36.590 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:43:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:43:36.705 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:43:36.741 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:43:36.776 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:43:36.842 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:43:36.867 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:43:37.437 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:43:37.512 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:43:37.557 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:43:37.650 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:43:37.682 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:43:37.707 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:43:37.741 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:43:37.742 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:43:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:43:37.817 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:43:37.918 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:43:37.943 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:43:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:43:37.948 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:43:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:43:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:43:38.203 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:43:38.277 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:43:40.068 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:43:40.132 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:43:41.087 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:43:41.116 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:43:41.230 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:43:41.409 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:43:41.444 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:43:41.467 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:43:41.467 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:41.467 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:43:41.468 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:43:41.468 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:43:41.468 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:41.511 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:43:41.522 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:43:41.621 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:43:41.671 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:43:42.630 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:43:42.672 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:43:42.696 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:43:42.696 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:42.696 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:43:42.696 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:43:42.696 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:43:42.696 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:42.740 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:43:42.762 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:43:42.763 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:42.763 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:43:42.763 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:42.807 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:43:42.830 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:43:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:43:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:43:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:43:42.831 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:43.149 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:43:43.172 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:43:43.173 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:43:43.173 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:43:43.173 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:43:43.173 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:43:43.173 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:44.571 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:43:44.572 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:43:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:43:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:43:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:43:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:43:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:43:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:43:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:43:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:43:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:43:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:43:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:43:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:43:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:43:47.204 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:43:47.218 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:43:47.218 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:47.218 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-21T06:43:47.218 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.219 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.220 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:43:47.221 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:43:47.222 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:43:47.223 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:43:47.225 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:43:47.226 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:43:47.227 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:43:47.228 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:43:47.229 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:43:47.230 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:43:47.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:43:47.230 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-21T06:43:47.245 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:43:47.286 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:43:47.318 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:43:47.345 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:43:47.556 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:43:47.601 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:43:47.632 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:43:47.660 DEBUG:teuthology.parallel:result is None 2024-09-21T06:43:47.661 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:43:47.708 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:43:48.327 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:43:48.365 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:43:48.385 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:43:49.205 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:43:49.280 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:43:49.333 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:43:49.421 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:43:49.459 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:43:49.484 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:43:49.510 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:43:49.510 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:43:49.578 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:43:49.578 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:43:49.645 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:43:49.678 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:43:49.684 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:43:49.684 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:43:49.864 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:43:49.864 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:43:49.956 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:43:50.023 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:43:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:43:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:43:56.614 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:43:56.615 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:43:56.616 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:43:56.617 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:43:56.618 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:43:56.619 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:43:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:43:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:43:56.622 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:43:56.623 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:43:56.624 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:43:56.625 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:43:56.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:43:59.108 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:43:59.108 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:59.108 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-21T06:43:59.108 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:43:59.109 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.110 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:43:59.111 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:43:59.112 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:43:59.113 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:43:59.114 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:43:59.115 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:43:59.116 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:43:59.117 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:43:59.118 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:43:59.119 INFO:teuthology.orchestra.run.smithi089.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:43:59.120 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:43:59.121 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:43:59.121 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:43:59.121 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:43:59.121 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-21T06:43:59.594 DEBUG:teuthology.parallel:result is None 2024-09-21T06:43:59.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:43:59.735 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:43:59.761 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:43:59.762 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:43:59.762 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:43:59.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:43:59.898 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:43:59.921 INFO:teuthology.orchestra.run.smithi089.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:43:59.921 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:43:59.921 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:43:59.923 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:43:59.923 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:43:59.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:43:59.955 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:43:59.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:43:59.989 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:43:59.989 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:43:59.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:44:00.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:44:00.090 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:00.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:44:00.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:44:00.181 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:44:00.181 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:00.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:44:00.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:44:00.277 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:00.277 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:44:00.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:44:00.368 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:44:00.368 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:00.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:44:00.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:44:00.459 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:00.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:44:00.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:44:00.548 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T06:44:00.624 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T06:44:00.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-21T06:44:00.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2024-09-21T06:44:00.652 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T06:44:00.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T06:44:00.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T06:44:00.717 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T06:44:00.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T06:44:00.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T06:44:00.791 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T06:44:00.792 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T06:44:00.792 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T06:44:00.792 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:00.792 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T06:44:00.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:00.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:00.973 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:00.973 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T06:44:00.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:01.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:01.132 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T06:44:01.133 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T06:44:01.134 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/pool-perm}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913561', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAjjr7Q+pYSIMrgcvc2LrWmyfWeYoUDcECKxHGyHaSb7S2JethfZIWgk+MLLbSkLK6uKRe0kjcukkWR3+NAHuS8=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLXDSwTEoQIWAHemkMqByKkVOQ83Z8XZfncbZi32JboJgtrD4+arTAubYFQrZgTBy2LKLAPMkPMMWKGBBqygUPw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T06:44:01.134 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T06:44:01.136 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T06:44:01.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T06:44:01.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T06:44:01.247 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:01.247 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:44:01.270 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:44:01.270 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:43:38.636608656 +0000 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 06:41:46.670063036 +0000 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 06:41:46.670063036 +0000 2024-09-21T06:44:01.325 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 06:41:46.670063036 +0000 2024-09-21T06:44:01.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:44:01.388 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:44:01.388 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:44:01.388 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000202728 s, 2.5 MB/s 2024-09-21T06:44:01.389 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:44:01.446 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:43:38.636608656 +0000 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 06:41:46.984056825 +0000 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 06:41:46.984056825 +0000 2024-09-21T06:44:01.502 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 06:41:46.984056825 +0000 2024-09-21T06:44:01.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:44:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:44:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:44:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000208271 s, 2.5 MB/s 2024-09-21T06:44:01.566 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:44:01.623 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:43:38.636608656 +0000 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 06:41:47.292050733 +0000 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 06:41:47.292050733 +0000 2024-09-21T06:44:01.678 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 06:41:47.292050733 +0000 2024-09-21T06:44:01.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:44:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:44:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:44:01.741 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000203916 s, 2.5 MB/s 2024-09-21T06:44:01.742 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:44:01.799 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-21T06:44:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:44:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:01.854 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T06:44:01.854 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:01.854 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:01.855 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-21 06:43:38.637608636 +0000 2024-09-21T06:44:01.855 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-21 06:41:47.622044207 +0000 2024-09-21T06:44:01.855 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-21 06:41:47.622044207 +0000 2024-09-21T06:44:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-21 06:41:47.622044207 +0000 2024-09-21T06:44:01.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:44:01.917 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-21T06:44:01.917 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-21T06:44:01.917 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000173626 s, 2.9 MB/s 2024-09-21T06:44:01.918 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:44:01.974 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:01.974 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:01.974 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:44:01.992 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:44:01.992 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-21T06:44:02.048 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:44:02.048 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:02.048 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T06:44:02.048 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:02.048 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:02.049 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:43:50.403681828 +0000 2024-09-21T06:44:02.049 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 06:41:46.675121072 +0000 2024-09-21T06:44:02.049 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 06:41:46.675121072 +0000 2024-09-21T06:44:02.049 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 06:41:46.675121072 +0000 2024-09-21T06:44:02.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:44:02.112 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:44:02.112 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:44:02.112 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00021158 s, 2.4 MB/s 2024-09-21T06:44:02.113 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:44:02.170 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-21T06:44:02.226 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:44:02.226 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:02.226 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T06:44:02.226 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:02.226 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:02.226 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:43:50.404681822 +0000 2024-09-21T06:44:02.227 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 06:41:47.001119289 +0000 2024-09-21T06:44:02.227 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 06:41:47.001119289 +0000 2024-09-21T06:44:02.227 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 06:41:47.001119289 +0000 2024-09-21T06:44:02.227 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:44:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:44:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:44:02.290 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000252148 s, 2.0 MB/s 2024-09-21T06:44:02.291 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:44:02.347 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-21T06:44:02.403 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:44:02.403 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T06:44:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:02.403 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:43:50.404681822 +0000 2024-09-21T06:44:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 06:41:47.322117533 +0000 2024-09-21T06:44:02.404 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 06:41:47.322117533 +0000 2024-09-21T06:44:02.404 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 06:41:47.322117533 +0000 2024-09-21T06:44:02.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:44:02.466 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:44:02.466 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:44:02.466 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00016593 s, 3.1 MB/s 2024-09-21T06:44:02.467 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:44:02.523 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-21T06:44:02.578 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-21 06:43:50.404681822 +0000 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-21 06:41:47.636115816 +0000 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-21 06:41:47.636115816 +0000 2024-09-21T06:44:02.579 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-21 06:41:47.636115816 +0000 2024-09-21T06:44:02.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:44:02.642 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-21T06:44:02.642 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-21T06:44:02.642 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000228949 s, 2.2 MB/s 2024-09-21T06:44:02.643 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:44:02.699 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:02.699 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T06:44:02.699 INFO:tasks.ceph:Generating config... 2024-09-21T06:44:02.700 INFO:tasks.ceph:[client] pid file = 2024-09-21T06:44:02.700 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T06:44:02.701 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T06:44:02.701 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T06:44:02.701 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T06:44:02.701 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T06:44:02.701 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T06:44:02.701 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-21T06:44:02.701 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:44:02.702 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T06:44:02.702 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T06:44:02.702 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T06:44:02.702 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T06:44:02.702 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T06:44:02.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T06:44:02.769 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T06:44:02.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T06:44:02.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:44:02.852 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2024-09-21T06:44:02.852 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-21T06:44:02.853 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:02.853 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T06:44:02.907 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:03.004 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 5acf265c-1f37-45bc-9438-eb9ad71b6190 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 5acf265c-1f37-45bc-9438-eb9ad71b6190 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-21T06:44:03.004103+0000 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-21T06:44:03.004103+0000 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2024-09-21T06:44:03.005 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T06:44:03.006 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T06:44:03.021 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5acf265c-1f37-45bc-9438-eb9ad71b6190... 2024-09-21T06:44:03.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T06:44:03.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T06:44:03.104 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-21T06:44:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-21T06:44:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T06:44:03.104 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-21T06:44:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T06:44:03.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2024-09-21T06:44:03.107 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 5acf265c-1f37-45bc-9438-eb9ad71b6190 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-21T06:44:03.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-21T06:44:03.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-21T06:44:03.110 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-21T06:44:03.111 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T06:44:03.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: mon down mkfs grace = 300 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-21T06:44:03.113 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2024-09-21T06:44:03.114 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.115 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2024-09-21T06:44:03.116 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2024-09-21T06:44:03.117 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 5acf265c-1f37-45bc-9438-eb9ad71b6190 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.118 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2024-09-21T06:44:03.119 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2024-09-21T06:44:03.120 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2024-09-21T06:44:03.121 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.122 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: mon down mkfs grace = 300 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T06:44:03.123 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = "" 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2024-09-21T06:44:03.124 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2024-09-21T06:44:03.125 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T06:44:03.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T06:44:03.232 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T06:44:03.232 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:03.233 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T06:44:03.248 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:03.248 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T06:44:03.303 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:44:03.303 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:03.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T06:44:03.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:44:03.378 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:03.378 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:03.433 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:44:03.433 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:03.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T06:44:03.433 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:44:03.467 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:03.468 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:03.523 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T06:44:03.523 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T06:44:03.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T06:44:03.583 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T06:44:03.586 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T06:44:03.652 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T06:44:03.655 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T06:44:03.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T06:44:03.717 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T06:44:03.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T06:44:03.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T06:44:03.845 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T06:44:03.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T06:44:03.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T06:44:03.934 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T06:44:03.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T06:44:03.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T06:44:04.060 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T06:44:04.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T06:44:04.088 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T06:44:04.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:44:04.139 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T06:44:04.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T06:44:04.203 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T06:44:04.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T06:44:04.266 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T06:44:04.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T06:44:04.329 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T06:44:04.343 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T06:44:04.343 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T06:44:04.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T06:44:04.368 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:04.368 INFO:tasks.ceph:role: osd.0 2024-09-21T06:44:04.368 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:44:04.368 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T06:44:04.439 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:04.440 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:04.935 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-21T06:44:04.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-21T06:44:04.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T06:44:05.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T06:44:05.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T06:44:05.142 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:05.142 INFO:tasks.ceph:role: osd.1 2024-09-21T06:44:05.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:44:05.142 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:05.677 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-21T06:44:05.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-21T06:44:05.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T06:44:05.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T06:44:05.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T06:44:05.885 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:05.886 INFO:tasks.ceph:role: osd.2 2024-09-21T06:44:05.886 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:44:05.886 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T06:44:05.957 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:05.958 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:06.443 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-21T06:44:06.445 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-21T06:44:06.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T06:44:06.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T06:44:06.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T06:44:06.633 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:06.633 INFO:tasks.ceph:role: osd.3 2024-09-21T06:44:06.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:44:06.634 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T06:44:06.707 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:06.707 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:06.707 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:06.707 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:06.707 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:06.708 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:06.708 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:06.708 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:06.708 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:06.708 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:07.210 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-21T06:44:07.212 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-21T06:44:07.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T06:44:07.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T06:44:07.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:07.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:07.501+0000 7fafd3d30640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T06:44:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:07.507+0000 7fafd3d30640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T06:44:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:07.507+0000 7fafd3d30640 -1 bdev(0x55ed7aef9900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:07.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:07.507+0000 7fafd3d30640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T06:44:10.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T06:44:10.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:10.552+0000 7f5d5720d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T06:44:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:10.553+0000 7f5d5720d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T06:44:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:10.553+0000 7f5d5720d640 -1 bdev(0x565302a21900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:10.553+0000 7f5d5720d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T06:44:13.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T06:44:13.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:13.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:13.834+0000 7fc8a31fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T06:44:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:13.834+0000 7fc8a31fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T06:44:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:13.834+0000 7fc8a31fd640 -1 bdev(0x563121f05900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:13.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:13.834+0000 7fc8a31fd640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T06:44:17.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T06:44:17.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:17.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:17.365+0000 7f9f807b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T06:44:17.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:17.365+0000 7f9f807b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T06:44:17.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:17.365+0000 7f9f807b2640 -1 bdev(0x5583674e7900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:17.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:17.365+0000 7f9f807b2640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T06:44:21.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T06:44:21.066 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T06:44:21.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:21.096 INFO:tasks.ceph:role: osd.4 2024-09-21T06:44:21.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:44:21.097 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:21.173 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:21.174 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:21.174 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:21.674 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-21T06:44:21.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-21T06:44:21.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T06:44:21.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T06:44:21.812 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T06:44:21.876 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:21.876 INFO:tasks.ceph:role: osd.5 2024-09-21T06:44:21.876 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:44:21.876 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:21.949 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:22.401 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-21T06:44:22.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-21T06:44:22.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T06:44:22.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T06:44:22.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T06:44:22.609 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:22.609 INFO:tasks.ceph:role: osd.6 2024-09-21T06:44:22.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:44:22.609 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:22.681 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:22.682 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:22.682 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:23.164 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-21T06:44:23.167 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-21T06:44:23.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T06:44:23.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T06:44:23.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T06:44:23.355 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:44:23.355 INFO:tasks.ceph:role: osd.7 2024-09-21T06:44:23.355 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:44:23.355 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T06:44:23.427 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:44:23.427 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:44:23.427 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:44:23.427 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:44:23.428 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:44:23.428 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:44:23.428 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:44:23.428 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:44:23.428 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:44:23.428 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:44:23.947 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2024-09-21T06:44:23.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2024-09-21T06:44:23.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T06:44:24.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T06:44:24.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:24.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:24.256+0000 7f26a7969640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T06:44:24.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:24.262+0000 7f26a7969640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T06:44:24.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:24.262+0000 7f26a7969640 -1 bdev(0x55fbad9ad900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:24.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:24.262+0000 7f26a7969640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T06:44:27.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T06:44:27.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:27.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:27.306+0000 7f7e86a1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T06:44:27.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:27.306+0000 7f7e86a1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T06:44:27.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:27.306+0000 7f7e86a1a640 -1 bdev(0x55baa3119900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:27.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:27.306+0000 7f7e86a1a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T06:44:30.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T06:44:30.750 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:30.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:30.852+0000 7fb2ca060640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T06:44:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:30.852+0000 7fb2ca060640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T06:44:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:30.852+0000 7fb2ca060640 -1 bdev(0x55bfdd315900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:30.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:30.852+0000 7fb2ca060640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T06:44:31.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:31.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:33.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T06:44:33.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:33.895+0000 7f5cd8334640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T06:44:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:33.895+0000 7f5cd8334640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T06:44:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:33.895+0000 7f5cd8334640 -1 bdev(0x55b981eb9900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T06:44:33.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:33.895+0000 7f5cd8334640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T06:44:37.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T06:44:37.104 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T06:44:37.104 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T06:44:37.135 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T06:44:37.205 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T06:44:37.273 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T06:44:37.341 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T06:44:37.409 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T06:44:37.475 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T06:44:37.542 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:37.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T06:44:37.571 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:37.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T06:44:37.640 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:37.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T06:44:37.707 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:37.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T06:44:37.773 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:37.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T06:44:37.839 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:37.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T06:44:37.905 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:37.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T06:44:37.971 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.971 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T06:44:37.988 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:37.988 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T06:44:38.044 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:38.044 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T06:44:38.060 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:38.060 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T06:44:38.115 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T06:44:38.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T06:44:38.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T06:44:38.158 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAza+5mVfC1IhAAasTz1gRrzWOb3hWmXUQmdw== 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAza+5mUzW5KhAAlWe3DNGFhoHzcZKVslgilw== 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAza+5mb9hZMhAAHLZ7d0T548EPhF3/h33DeA== 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA3a+5m2fjqHRAAP178PuV9yiw9cbo7/1OoVg== 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA6a+5mIe4HIRAAPkD3C92LH25iaPoKrs66uQ== 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA9a+5meEnSMRAAf4QZAj2WcogUBB1Y8efOtQ== 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-21T06:44:38.159 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBBa+5m93HXFRAAAJCY+KY0MQuETBmI44+aNw== 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAza+5mMvfYJhAAvcvg+BqxohgSrYZxnsWkgw== 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAza+5mrJ6iNxAAYlPzreZVfOBq8uNON7qX6A== 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5mRC+TAxAAZBxHrZ/8fkiTV5/jI/qPig== 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBIa+5mo5JTDxAAHWKo3EJWBUAbC8e4WHWQgw== 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBLa+5mNKVNEhAAdCjnmKVY9GyFjHe+EPqc1Q== 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBOa+5mdT3YMhAAr7AtNX9uM2SjgIbXyNJvtg== 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-21T06:44:38.160 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBRa+5mqwVtNRAA2qzg3e3lxipuLSGdwaDlAQ== 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5mniEcDBAAKVy0qqJUGtHC9okai+CUlQ== 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5mA3XZDxAA2aiJXqyvv25Mz518UE+Efg== 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2024-09-21T06:44:38.161 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m3tqhExAAfa2YN4jeUlT9G43v8YOo4w== 2024-09-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2024-09-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAza+5mVfC1IhAAasTz1gRrzWOb3hWmXUQmdw== 2024-09-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2024-09-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAza+5mUzW5KhAAlWe3DNGFhoHzcZKVslgilw== 2024-09-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2024-09-21T06:44:38.178 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAza+5mb9hZMhAAHLZ7d0T548EPhF3/h33DeA== 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA3a+5m2fjqHRAAP178PuV9yiw9cbo7/1OoVg== 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA6a+5mIe4HIRAAPkD3C92LH25iaPoKrs66uQ== 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA9a+5meEnSMRAAf4QZAj2WcogUBB1Y8efOtQ== 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBBa+5m93HXFRAAAJCY+KY0MQuETBmI44+aNw== 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAza+5mMvfYJhAAvcvg+BqxohgSrYZxnsWkgw== 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAza+5mrJ6iNxAAYlPzreZVfOBq8uNON7qX6A== 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2024-09-21T06:44:38.179 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0a+5mRC+TAxAAZBxHrZ/8fkiTV5/jI/qPig== 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBIa+5mo5JTDxAAHWKo3EJWBUAbC8e4WHWQgw== 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBLa+5mNKVNEhAAdCjnmKVY9GyFjHe+EPqc1Q== 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBOa+5mdT3YMhAAr7AtNX9uM2SjgIbXyNJvtg== 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBRa+5mqwVtNRAA2qzg3e3lxipuLSGdwaDlAQ== 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout:[client.2] 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0a+5mniEcDBAAKVy0qqJUGtHC9okai+CUlQ== 2024-09-21T06:44:38.180 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2024-09-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0a+5mA3XZDxAA2aiJXqyvv25Mz518UE+Efg== 2024-09-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi089.stdout:[client.3] 2024-09-21T06:44:38.181 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0a+5m3tqhExAAfa2YN4jeUlT9G43v8YOo4w== 2024-09-21T06:44:38.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:44:38.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:44:38.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:44:38.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:44:38.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:44:38.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:38.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:39.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:39.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:44:39.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.317 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:44:39.381 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T06:44:39.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T06:44:39.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:44:39.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T06:44:39.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T06:44:39.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:44:39.667 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T06:44:39.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T06:44:39.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:44:39.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T06:44:39.888 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:39.891 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:44:39.943 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T06:44:39.944 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T06:44:39.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T06:44:39.947 INFO:tasks.ceph.mon.a:Started 2024-09-21T06:44:39.947 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T06:44:39.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T06:44:39.986 INFO:tasks.ceph.mon.b:Started 2024-09-21T06:44:39.986 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T06:44:39.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T06:44:39.989 INFO:tasks.ceph.mon.c:Started 2024-09-21T06:44:39.989 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T06:44:39.989 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T06:44:39.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T06:44:39.992 INFO:tasks.ceph.mgr.y:Started 2024-09-21T06:44:39.992 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T06:44:39.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T06:44:39.995 INFO:tasks.ceph.mgr.x:Started 2024-09-21T06:44:39.995 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T06:44:39.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T06:44:39.998 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T06:44:39.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T06:44:40.041 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T06:44:40.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T06:44:40.084 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:44:40.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T06:44:40.127 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:44:40.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T06:44:40.170 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T06:44:40.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T06:44:40.213 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:44:40.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T06:44:40.256 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T06:44:40.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T06:44:40.299 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T06:44:40.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T06:44:40.342 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:44:40.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T06:44:40.386 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:44:40.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T06:44:40.429 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T06:44:40.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T06:44:40.472 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:44:40.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T06:44:40.515 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:44:40.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:44:40.558 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:44:40.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:44:40.601 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:44:40.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T06:44:40.644 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T06:44:40.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T06:44:40.687 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T06:44:40.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T06:44:40.731 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T06:44:40.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T06:44:40.774 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:44:40.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:44:40.817 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:44:40.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T06:44:40.860 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:44:40.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T06:44:40.904 DEBUG:tasks.ceph:set 22 configs 2024-09-21T06:44:40.905 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.773 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.773 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.772+0000 7fa223fff640 1 -- 172.21.15.81:0/2736375673 <== mon.2 v2:172.21.15.89:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 109+0+0 (secure 0 0 0) 0x7fa22c054810 con 0x7fa224004800 2024-09-21T06:44:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 -- 172.21.15.81:0/2736375673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa224004800 msgr2=0x7fa23c1f0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 --2- 172.21.15.81:0/2736375673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa224004800 0x7fa23c1f0450 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa22c02dab0 tx=0x7fa22c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 -- 172.21.15.81:0/2736375673 shutdown_connections 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 --2- 172.21.15.81:0/2736375673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa23c148ec0 0x7fa23c09dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 --2- 172.21.15.81:0/2736375673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2240099b0 0x7fa23c1484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 --2- 172.21.15.81:0/2736375673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa224004800 0x7fa23c1f0450 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 -- 172.21.15.81:0/2736375673 >> 172.21.15.81:0/2736375673 conn(0x7fa23c0d1150 msgr2=0x7fa23c0d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 -- 172.21.15.81:0/2736375673 shutdown_connections 2024-09-21T06:44:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.773+0000 7fa241f32640 1 -- 172.21.15.81:0/2736375673 wait complete. 2024-09-21T06:44:50.789 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.790 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.798+0000 7fb73457b640 1 -- 172.21.15.81:0/2086633617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb708005310 con 0x7fb72c14c5b0 2024-09-21T06:44:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.803+0000 7fb722ffd640 1 -- 172.21.15.81:0/2086633617 <== mon.0 v2:172.21.15.81:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v20)=0 v20) ==== 123+0+0 (secure 0 0 0) 0x7fb7240245f0 con 0x7fb72c14c5b0 2024-09-21T06:44:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.803+0000 7fb722ffd640 1 -- 172.21.15.81:0/2086633617 <== mon.0 v2:172.21.15.81:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb724024910 con 0x7fb72c14c5b0 2024-09-21T06:44:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 -- 172.21.15.81:0/2086633617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c14c5b0 msgr2=0x7fb72c1f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 --2- 172.21.15.81:0/2086633617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c14c5b0 0x7fb72c1f8b20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb710006180 tx=0x7fb724011aa0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 -- 172.21.15.81:0/2086633617 shutdown_connections 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 --2- 172.21.15.81:0/2086633617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb72c14ce00 0x7fb72c1fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 --2- 172.21.15.81:0/2086633617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c14c5b0 0x7fb72c1f8b20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 --2- 172.21.15.81:0/2086633617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb71000ec60 0x7fb72c14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 -- 172.21.15.81:0/2086633617 >> 172.21.15.81:0/2086633617 conn(0x7fb72c0d0840 msgr2=0x7fb72c15dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 -- 172.21.15.81:0/2086633617 shutdown_connections 2024-09-21T06:44:50.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.804+0000 7fb73457b640 1 -- 172.21.15.81:0/2086633617 wait complete. 2024-09-21T06:44:50.816 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.816 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.816 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.816+0000 7f3ce70e6640 1 -- 172.21.15.81:0/3832041250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cc400ec70 msgr2=0x7f3cc400f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.816+0000 7f3ce70e6640 1 --2- 172.21.15.81:0/3832041250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3cc400ec70 0x7f3cc400f080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc005f10 tx=0x7f3ccc02d0b0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.817+0000 7f3ce5683640 1 -- 172.21.15.81:0/3832041250 reap_dead start 2024-09-21T06:44:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.817+0000 7f3ce70e6640 1 -- 172.21.15.81:0/3832041250 shutdown_connections 2024-09-21T06:44:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.817+0000 7f3ce70e6640 1 -- 172.21.15.81:0/3832041250 >> 172.21.15.81:0/3832041250 conn(0x7f3ce00d1150 msgr2=0x7f3ce00d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.817+0000 7f3ce70e6640 1 -- 172.21.15.81:0/3832041250 shutdown_connections 2024-09-21T06:44:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.817+0000 7f3ce70e6640 1 -- 172.21.15.81:0/3832041250 wait complete. 2024-09-21T06:44:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.818+0000 7f3ce70e6640 1 Processor -- start 2024-09-21T06:44:50.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.819+0000 7f3ce70e6640 1 -- start start 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce70e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc400ec70 0x7f3ce01507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce70e6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce014b500 0x7f3ce01f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce70e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce01f2560 0x7f3ce009d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce70e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00adf30 con 0x7f3cc400ec70 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce70e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce015bc50 con 0x7f3ce01f2560 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce70e6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00ae0b0 con 0x7f3ce014b500 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc400ec70 0x7f3ce01507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc400ec70 0x7f3ce01507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60522/0 (socket says 172.21.15.81:60522) 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 -- 172.21.15.81:0/748369244 learned_addr learned my addr 172.21.15.81:0/748369244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3cdffff640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce014b500 0x7f3ce01f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce5683640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce01f2560 0x7f3ce009d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 -- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce014b500 msgr2=0x7f3ce01f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce014b500 0x7f3ce01f2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 -- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce01f2560 msgr2=0x7f3ce009d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce01f2560 0x7f3ce009d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.820+0000 7f3ce4e82640 1 -- 172.21.15.81:0/748369244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01f2d30 con 0x7f3cc400ec70 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3ce4e82640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc400ec70 0x7f3ce01507e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40072e0 tx=0x7f3cd4011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3cdd7fa640 1 -- 172.21.15.81:0/748369244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd401c430 con 0x7f3cc400ec70 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3cdd7fa640 1 -- 172.21.15.81:0/748369244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd401c5d0 con 0x7f3cc400ec70 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce014fd00 con 0x7f3cc400ec70 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3cdd7fa640 1 -- 172.21.15.81:0/748369244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd401c9e0 con 0x7f3cc400ec70 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01502c0 con 0x7f3cc400ec70 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3cdd7fa640 1 -- 172.21.15.81:0/748369244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3cd40263f0 con 0x7f3cc400ec70 2024-09-21T06:44:50.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.821+0000 7f3cdd7fa640 1 -- 172.21.15.81:0/748369244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3cd4001a60 con 0x7f3cc400ec70 2024-09-21T06:44:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.822+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce00ae610 con 0x7f3cc400ec70 2024-09-21T06:44:50.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.824+0000 7f3cdd7fa640 1 -- 172.21.15.81:0/748369244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3cd402b080 con 0x7f3cc400ec70 2024-09-21T06:44:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.897+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3ce0154f80 con 0x7f3cc400ec70 2024-09-21T06:44:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.901+0000 7f3cdd7fa640 1 -- 172.21.15.81:0/748369244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v21)=0 v21) ==== 106+0+0 (secure 0 0 0) 0x7f3cd4001cb0 con 0x7f3cc400ec70 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc400ec70 msgr2=0x7f3ce01507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc400ec70 0x7f3ce01507e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40072e0 tx=0x7f3cd4011800 comp rx=0 tx=0).stop 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 shutdown_connections 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce014b500 0x7f3ce01f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce01f2560 0x7f3ce009d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 --2- 172.21.15.81:0/748369244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cc400ec70 0x7f3ce01507e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 >> 172.21.15.81:0/748369244 conn(0x7f3ce00d1150 msgr2=0x7f3ce00d17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 shutdown_connections 2024-09-21T06:44:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:50.902+0000 7f3ce70e6640 1 -- 172.21.15.81:0/748369244 wait complete. 2024-09-21T06:44:50.914 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi081') 2024-09-21T06:44:50.915 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f018cb41640 1 -- 172.21.15.81:0/2412796163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01680089f0 msgr2=0x7f0168008e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f018cb41640 1 --2- 172.21.15.81:0/2412796163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01680089f0 0x7f0168008e00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01680094c0 tx=0x7f017802d0e0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f0186d9d640 1 -- 172.21.15.81:0/2412796163 reap_dead start 2024-09-21T06:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f018cb41640 1 -- 172.21.15.81:0/2412796163 shutdown_connections 2024-09-21T06:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f018cb41640 1 --2- 172.21.15.81:0/2412796163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01680089f0 0x7f0168008e00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f018cb41640 1 -- 172.21.15.81:0/2412796163 >> 172.21.15.81:0/2412796163 conn(0x7f01880d0840 msgr2=0x7f01880d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f018cb41640 1 -- 172.21.15.81:0/2412796163 shutdown_connections 2024-09-21T06:44:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.036+0000 7f018cb41640 1 -- 172.21.15.81:0/2412796163 wait complete. 2024-09-21T06:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.038+0000 7f018cb41640 1 Processor -- start 2024-09-21T06:44:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.038+0000 7f018cb41640 1 -- start start 2024-09-21T06:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.039+0000 7f018cb41640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01680089f0 0x7f01881f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.039+0000 7f018cb41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018814c300 0x7f018815de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.039+0000 7f018cb41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018814c710 0x7f018815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.039+0000 7f018cb41640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f018815efe0 con 0x7f018814c710 2024-09-21T06:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.039+0000 7f018cb41640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f01880b01e0 con 0x7f018814c300 2024-09-21T06:44:51.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.039+0000 7f018cb41640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f018815f160 con 0x7f01680089f0 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018814c710 0x7f018815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018814c710 0x7f018815e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60540/0 (socket says 172.21.15.81:60540) 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 -- 172.21.15.81:0/1767156499 learned_addr learned my addr 172.21.15.81:0/1767156499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f018659c640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01680089f0 0x7f01881f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0185d9b640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018814c300 0x7f018815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 -- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01680089f0 msgr2=0x7f01881f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01680089f0 0x7f01881f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 -- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018814c300 msgr2=0x7f018815de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018814c300 0x7f018815de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 -- 172.21.15.81:0/1767156499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01881f5da0 con 0x7f018814c710 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0186d9d640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018814c710 0x7f018815e3d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180012b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0176ffd640 1 -- 172.21.15.81:0/1767156499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180009a30 con 0x7f018814c710 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0176ffd640 1 -- 172.21.15.81:0/1767156499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0180009bd0 con 0x7f018814c710 2024-09-21T06:44:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01881f6080 con 0x7f018814c710 2024-09-21T06:44:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f0176ffd640 1 -- 172.21.15.81:0/1767156499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180003970 con 0x7f018814c710 2024-09-21T06:44:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.040+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0188151880 con 0x7f018814c710 2024-09-21T06:44:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.041+0000 7f0176ffd640 1 -- 172.21.15.81:0/1767156499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f018000c040 con 0x7f018814c710 2024-09-21T06:44:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.041+0000 7f0176ffd640 1 -- 172.21.15.81:0/1767156499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f018001f7b0 con 0x7f018814c710 2024-09-21T06:44:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.041+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01881f5b10 con 0x7f018814c710 2024-09-21T06:44:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.043+0000 7f0176ffd640 1 -- 172.21.15.81:0/1767156499 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0180003c00 con 0x7f018814c710 2024-09-21T06:44:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.076+0000 7f47064cc640 1 -- 172.21.15.81:0/3325936705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46ec007d70 msgr2=0x7f46ec008200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.076+0000 7f47064cc640 1 --2- 172.21.15.81:0/3325936705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46ec007d70 0x7f46ec008200 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f46f40058c0 tx=0x7f46f402c3e0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.076+0000 7f4704a69640 1 -- 172.21.15.81:0/3325936705 reap_dead start 2024-09-21T06:44:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.076+0000 7f47064cc640 1 -- 172.21.15.81:0/3325936705 shutdown_connections 2024-09-21T06:44:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.076+0000 7f47064cc640 1 -- 172.21.15.81:0/3325936705 >> 172.21.15.81:0/3325936705 conn(0x7f47000d0aa0 msgr2=0x7f47000d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.076+0000 7f47064cc640 1 -- 172.21.15.81:0/3325936705 shutdown_connections 2024-09-21T06:44:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.076+0000 7f47064cc640 1 -- 172.21.15.81:0/3325936705 wait complete. 2024-09-21T06:44:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.078+0000 7f47064cc640 1 Processor -- start 2024-09-21T06:44:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.078+0000 7f47064cc640 1 -- start start 2024-09-21T06:44:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.079+0000 7f47064cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ec007d70 0x7f470014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.079+0000 7f47064cc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470015a860 0x7f470014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.079+0000 7f47064cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470014d070 0x7f4700150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.079+0000 7f47064cc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f470015f810 con 0x7f470014d070 2024-09-21T06:44:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.079+0000 7f47064cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f470015f690 con 0x7f46ec007d70 2024-09-21T06:44:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.079+0000 7f47064cc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f470015f990 con 0x7f470015a860 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470014d070 0x7f4700150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470014d070 0x7f4700150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60542/0 (socket says 172.21.15.81:60542) 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 -- 172.21.15.81:0/3204318394 learned_addr learned my addr 172.21.15.81:0/3204318394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f46ff7fe640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470015a860 0x7f470014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f46fffff640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ec007d70 0x7f470014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 -- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470015a860 msgr2=0x7f470014fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470015a860 0x7f470014fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 -- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ec007d70 msgr2=0x7f470014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ec007d70 0x7f470014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 -- 172.21.15.81:0/3204318394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47001f7850 con 0x7f470014d070 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f4704a69640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470014d070 0x7f4700150320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47000735c0 tx=0x7f46f8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f46fcff9640 1 -- 172.21.15.81:0/3204318394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8004b20 con 0x7f470014d070 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f46fcff9640 1 -- 172.21.15.81:0/3204318394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46f8004cc0 con 0x7f470014d070 2024-09-21T06:44:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47001f6a90 con 0x7f470014d070 2024-09-21T06:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f46fcff9640 1 -- 172.21.15.81:0/3204318394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8010850 con 0x7f470014d070 2024-09-21T06:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.080+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47001f7050 con 0x7f470014d070 2024-09-21T06:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.081+0000 7f46fcff9640 1 -- 172.21.15.81:0/3204318394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f46f800c040 con 0x7f470014d070 2024-09-21T06:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.081+0000 7f46fcff9640 1 -- 172.21.15.81:0/3204318394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f46f80093c0 con 0x7f470014d070 2024-09-21T06:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.082+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47000b4060 con 0x7f470014d070 2024-09-21T06:44:51.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.084+0000 7f46fcff9640 1 -- 172.21.15.81:0/3204318394 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f46f8022070 con 0x7f470014d070 2024-09-21T06:44:51.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.104+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f01880b2270 con 0x7f018814c710 2024-09-21T06:44:51.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.107+0000 7f0176ffd640 1 -- 172.21.15.81:0/1767156499 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f01880b2270 con 0x7f018814c710 2024-09-21T06:44:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.108+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018814c710 msgr2=0x7f018815e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.108+0000 7f018cb41640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018814c710 0x7f018815e3d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0180005fd0 tx=0x7f0180012b10 comp rx=0 tx=0).stop 2024-09-21T06:44:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.109+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 shutdown_connections 2024-09-21T06:44:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.109+0000 7f018cb41640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f018814c710 0x7f018815e3d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.109+0000 7f018cb41640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f018814c300 0x7f018815de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.109+0000 7f018cb41640 1 --2- 172.21.15.81:0/1767156499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01680089f0 0x7f01881f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.109+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 >> 172.21.15.81:0/1767156499 conn(0x7f01880d0840 msgr2=0x7f01880d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.109+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 shutdown_connections 2024-09-21T06:44:51.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.109+0000 7f018cb41640 1 -- 172.21.15.81:0/1767156499 wait complete. 2024-09-21T06:44:51.121 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.146+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f470015aca0 con 0x7f470014d070 2024-09-21T06:44:51.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.148+0000 7f46fcff9640 1 -- 172.21.15.81:0/3204318394 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f46f801b470 con 0x7f470014d070 2024-09-21T06:44:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.149+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470014d070 msgr2=0x7f4700150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.149+0000 7f47064cc640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470014d070 0x7f4700150320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47000735c0 tx=0x7f46f8011aa0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.150+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 shutdown_connections 2024-09-21T06:44:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.150+0000 7f47064cc640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f470015a860 0x7f470014fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.150+0000 7f47064cc640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f470014d070 0x7f4700150320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.150+0000 7f47064cc640 1 --2- 172.21.15.81:0/3204318394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ec007d70 0x7f470014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.150+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 >> 172.21.15.81:0/3204318394 conn(0x7f47000d0aa0 msgr2=0x7f47000b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.150+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 shutdown_connections 2024-09-21T06:44:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.150+0000 7f47064cc640 1 -- 172.21.15.81:0/3204318394 wait complete. 2024-09-21T06:44:51.161 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.162 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.162 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.162 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.162 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.162 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.162 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.163 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-21T06:44:51.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config dump 2024-09-21T06:44:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.313+0000 7f3fe7998640 1 -- 172.21.15.81:0/2817267652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015d4e0 msgr2=0x7f3fe01672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.313+0000 7f3fe7998640 1 --2- 172.21.15.81:0/2817267652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015d4e0 0x7f3fe01672a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8005fd0 tx=0x7f3fd802a940 comp rx=0 tx=0).stop 2024-09-21T06:44:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.313+0000 7f3fe7998640 1 -- 172.21.15.81:0/2817267652 shutdown_connections 2024-09-21T06:44:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.313+0000 7f3fe7998640 1 --2- 172.21.15.81:0/2817267652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015d4e0 0x7f3fe01672a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.313+0000 7f3fe7998640 1 -- 172.21.15.81:0/2817267652 >> 172.21.15.81:0/2817267652 conn(0x7f3fe00cec40 msgr2=0x7f3fe00cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.313+0000 7f3fe7998640 1 -- 172.21.15.81:0/2817267652 shutdown_connections 2024-09-21T06:44:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.313+0000 7f3fe7998640 1 -- 172.21.15.81:0/2817267652 wait complete. 2024-09-21T06:44:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.315+0000 7f3fe7998640 1 Processor -- start 2024-09-21T06:44:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.315+0000 7f3fe7998640 1 -- start start 2024-09-21T06:44:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.316+0000 7f3fe7998640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe00d1a00 0x7f3fe0166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.316+0000 7f3fe7998640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe015d4e0 0x7f3fe00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.316+0000 7f3fe7998640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015eeb0 0x7f3fe0152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.316+0000 7f3fe7998640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0167b70 con 0x7f3fe015eeb0 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.316+0000 7f3fe7998640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe01679f0 con 0x7f3fe00d1a00 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.316+0000 7f3fe7998640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe0167cf0 con 0x7f3fe015d4e0 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015eeb0 0x7f3fe0152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015eeb0 0x7f3fe0152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60560/0 (socket says 172.21.15.81:60560) 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 -- 172.21.15.81:0/2884181193 learned_addr learned my addr 172.21.15.81:0/2884181193 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5734640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe00d1a00 0x7f3fe0166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe4f33640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe015d4e0 0x7f3fe00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 -- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe015d4e0 msgr2=0x7f3fe00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe015d4e0 0x7f3fe00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 -- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe00d1a00 msgr2=0x7f3fe0166ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe00d1a00 0x7f3fe0166ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 -- 172.21.15.81:0/2884181193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe0165a20 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe5f35640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015eeb0 0x7f3fe0152330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8006010 tx=0x7f3fd8031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fd5ffb640 1 -- 172.21.15.81:0/2884181193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd803e070 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fd5ffb640 1 -- 172.21.15.81:0/2884181193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fd8004540 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe0165d00 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fd5ffb640 1 -- 172.21.15.81:0/2884181193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8043460 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.317+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe01662c0 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.318+0000 7f3fd5ffb640 1 -- 172.21.15.81:0/2884181193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fd8043600 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.318+0000 7f3fd5ffb640 1 -- 172.21.15.81:0/2884181193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3fd803a790 con 0x7f3fe015eeb0 2024-09-21T06:44:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.318+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe0167000 con 0x7f3fe015eeb0 2024-09-21T06:44:51.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.320+0000 7f3fd5ffb640 1 -- 172.21.15.81:0/2884181193 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3fd8043a30 con 0x7f3fe015eeb0 2024-09-21T06:44:51.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.381+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f3fe01608e0 con 0x7f3fe015eeb0 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.381+0000 7f3fd5ffb640 1 -- 172.21.15.81:0/2884181193 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f3fd8043c10 con 0x7f3fe015eeb0 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_client 20/20 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:44:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:44:51.384 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:44:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.382+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015eeb0 msgr2=0x7f3fe0152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.382+0000 7f3fe7998640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015eeb0 0x7f3fe0152330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8006010 tx=0x7f3fd8031e20 comp rx=0 tx=0).stop 2024-09-21T06:44:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.382+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 shutdown_connections 2024-09-21T06:44:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.382+0000 7f3fe7998640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fe015d4e0 0x7f3fe00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.382+0000 7f3fe7998640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fe015eeb0 0x7f3fe0152330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.382+0000 7f3fe7998640 1 --2- 172.21.15.81:0/2884181193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fe00d1a00 0x7f3fe0166ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.383+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 >> 172.21.15.81:0/2884181193 conn(0x7f3fe00cec40 msgr2=0x7f3fe00cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.383+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 shutdown_connections 2024-09-21T06:44:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.383+0000 7f3fe7998640 1 -- 172.21.15.81:0/2884181193 wait complete. 2024-09-21T06:44:51.394 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T06:44:51.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T06:44:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.504+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2790722509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 msgr2=0x7f8ef806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.504+0000 7f8efd1c3640 1 --2- 172.21.15.81:0/2790722509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef806eb70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0005fd0 tx=0x7f8ef002ab40 comp rx=0 tx=0).stop 2024-09-21T06:44:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.504+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2790722509 shutdown_connections 2024-09-21T06:44:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.504+0000 7f8efd1c3640 1 --2- 172.21.15.81:0/2790722509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef806eb70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.504+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2790722509 >> 172.21.15.81:0/2790722509 conn(0x7f8ef809aa30 msgr2=0x7f8ef80b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.504+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2790722509 shutdown_connections 2024-09-21T06:44:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.504+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2790722509 wait complete. 2024-09-21T06:44:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.506+0000 7f8efd1c3640 1 Processor -- start 2024-09-21T06:44:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.506+0000 7f8efd1c3640 1 -- start start 2024-09-21T06:44:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.507+0000 7f8efd1c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef81f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.507+0000 7f8efd1c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ef815b6a0 0x7f8ef80af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.507+0000 7f8efd1c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ef80c5730 0x7f8ef81f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8efd1c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef806f0b0 con 0x7f8ef8071720 2024-09-21T06:44:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8efd1c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef80d2120 con 0x7f8ef80c5730 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8efd1c3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef806f230 con 0x7f8ef815b6a0 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef81f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef81f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60572/0 (socket says 172.21.15.81:60572) 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 -- 172.21.15.81:0/2653853168 learned_addr learned my addr 172.21.15.81:0/2653853168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef759e640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ef80c5730 0x7f8ef81f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef659c640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ef815b6a0 0x7f8ef80af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 -- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ef815b6a0 msgr2=0x7f8ef80af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ef815b6a0 0x7f8ef80af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 -- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ef80c5730 msgr2=0x7f8ef81f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ef80c5730 0x7f8ef81f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 -- 172.21.15.81:0/2653853168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef80ae340 con 0x7f8ef8071720 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef759e640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ef80c5730 0x7f8ef81f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8ef6d9d640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef81f64d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c3a0 tx=0x7f8ee800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8edf7fe640 1 -- 172.21.15.81:0/2653853168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8017070 con 0x7f8ef8071720 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8edf7fe640 1 -- 172.21.15.81:0/2653853168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ee80053c0 con 0x7f8ef8071720 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef80ae620 con 0x7f8ef8071720 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8edf7fe640 1 -- 172.21.15.81:0/2653853168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8003850 con 0x7f8ef8071720 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.508+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef80aebe0 con 0x7f8ef8071720 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.509+0000 7f8edf7fe640 1 -- 172.21.15.81:0/2653853168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ee801a070 con 0x7f8ef8071720 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.509+0000 7f8edf7fe640 1 -- 172.21.15.81:0/2653853168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8ee801c780 con 0x7f8ef8071720 2024-09-21T06:44:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.510+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef80d1150 con 0x7f8ef8071720 2024-09-21T06:44:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.512+0000 7f8edf7fe640 1 -- 172.21.15.81:0/2653853168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8ee8021020 con 0x7f8ef8071720 2024-09-21T06:44:51.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.576+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8ef815f600 con 0x7f8ef8071720 2024-09-21T06:44:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.578+0000 7f8edf7fe640 1 -- 172.21.15.81:0/2653853168 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8ee8011d60 con 0x7f8ef8071720 2024-09-21T06:44:51.579 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-21T06:44:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 msgr2=0x7f8ef81f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef81f64d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c3a0 tx=0x7f8ee800c860 comp rx=0 tx=0).stop 2024-09-21T06:44:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 shutdown_connections 2024-09-21T06:44:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ef815b6a0 0x7f8ef80af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ef80c5730 0x7f8ef81f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 --2- 172.21.15.81:0/2653853168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ef8071720 0x7f8ef81f64d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 >> 172.21.15.81:0/2653853168 conn(0x7f8ef809aa30 msgr2=0x7f8ef80b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 shutdown_connections 2024-09-21T06:44:51.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:51.579+0000 7f8efd1c3640 1 -- 172.21.15.81:0/2653853168 wait complete. 2024-09-21T06:44:51.591 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T06:44:51.591 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T06:44:51.592 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:51.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T06:44:51.616 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:51.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T06:44:51.680 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:51.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T06:44:51.744 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:44:51.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T06:44:51.809 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:51.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T06:44:51.834 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:51.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T06:44:51.899 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:51.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T06:44:51.965 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:44:51.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T06:44:52.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 0d51cbed-f6af-449e-acaa-b6218d92f263 0 2024-09-21T06:44:52.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 -- 172.21.15.89:0/2838547099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c0d1a00 msgr2=0x7efe9c160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 --2- 172.21.15.89:0/2838547099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c0d1a00 0x7efe9c160120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe9c074a60 tx=0x7efe8402a5f0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 -- 172.21.15.89:0/2838547099 shutdown_connections 2024-09-21T06:44:52.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 --2- 172.21.15.89:0/2838547099 >> v2:172.21.15.81:3300/0 conn(0x7efe9c160660 0x7efe9c160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 --2- 172.21.15.89:0/2838547099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c0d1a00 0x7efe9c160120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 -- 172.21.15.89:0/2838547099 >> 172.21.15.89:0/2838547099 conn(0x7efe9c0cec40 msgr2=0x7efe9c0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 -- 172.21.15.89:0/2838547099 shutdown_connections 2024-09-21T06:44:52.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.182+0000 7efea2494640 1 -- 172.21.15.89:0/2838547099 wait complete. 2024-09-21T06:44:52.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.184+0000 7efea2494640 1 Processor -- start 2024-09-21T06:44:52.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.184+0000 7efea2494640 1 -- start start 2024-09-21T06:44:52.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea2494640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe9c0d1a00 0x7efe9c0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea2494640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe9c15dea0 0x7efe9c0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea2494640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c160660 0x7efe9c1496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea2494640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c15e9c0 con 0x7efe9c0d1a00 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea2494640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c15d8f0 con 0x7efe9c160660 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea2494640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c15eb40 con 0x7efe9c15dea0 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efe9b7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe9c15dea0 0x7efe9c0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea0a31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c160660 0x7efe9c1496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efe9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe9c0d1a00 0x7efe9c0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea0a31640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c160660 0x7efe9c1496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36330/0 (socket says 172.21.15.89:36330) 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efea0a31640 1 -- 172.21.15.89:0/35293092 learned_addr learned my addr 172.21.15.89:0/35293092 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.185+0000 7efe9b7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe9c15dea0 0x7efe9c0c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:38546/0 (socket says 172.21.15.89:38546) 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe9bfff640 1 -- 172.21.15.89:0/35293092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe9c15dea0 msgr2=0x7efe9c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe9bfff640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe9c15dea0 0x7efe9c0c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe9bfff640 1 -- 172.21.15.89:0/35293092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c160660 msgr2=0x7efe9c1496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe9bfff640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c160660 0x7efe9c1496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe9bfff640 1 -- 172.21.15.89:0/35293092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c149c10 con 0x7efe9c0d1a00 2024-09-21T06:44:52.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efea0a31640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c160660 0x7efe9c1496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe9bfff640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe9c0d1a00 0x7efe9c0c7470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0d11e0 tx=0x7efe840038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe98ff9640 1 -- 172.21.15.89:0/35293092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8403e030 con 0x7efe9c0d1a00 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe98ff9640 1 -- 172.21.15.89:0/35293092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe84003dd0 con 0x7efe9c0d1a00 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c0c63d0 con 0x7efe9c0d1a00 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe98ff9640 1 -- 172.21.15.89:0/35293092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84035040 con 0x7efe9c0d1a00 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c0c6990 con 0x7efe9c0d1a00 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe98ff9640 1 -- 172.21.15.89:0/35293092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe84041030 con 0x7efe9c0d1a00 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.186+0000 7efe98ff9640 1 -- 172.21.15.89:0/35293092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7efe84043bf0 con 0x7efe9c0d1a00 2024-09-21T06:44:52.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.187+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9c15eff0 con 0x7efe9c0d1a00 2024-09-21T06:44:52.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.189+0000 7efe98ff9640 1 -- 172.21.15.89:0/35293092 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efe9c149c10 con 0x7efe9c0d1a00 2024-09-21T06:44:52.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.259+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0d51cbed-f6af-449e-acaa-b6218d92f263", "id": 0} v 0) -- 0x7efe9c073970 con 0x7efe9c0d1a00 2024-09-21T06:44:52.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.260+0000 7efe98ff9640 1 -- 172.21.15.89:0/35293092 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d51cbed-f6af-449e-acaa-b6218d92f263", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7efe84043410 con 0x7efe9c0d1a00 2024-09-21T06:44:52.262 INFO:teuthology.orchestra.run.smithi089.stdout:0 2024-09-21T06:44:52.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.261+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe9c0d1a00 msgr2=0x7efe9c0c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.261+0000 7efea2494640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe9c0d1a00 0x7efe9c0c7470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0d11e0 tx=0x7efe840038a0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.261+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 shutdown_connections 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.261+0000 7efea2494640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe9c15dea0 0x7efe9c0c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.261+0000 7efea2494640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe9c160660 0x7efe9c1496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.261+0000 7efea2494640 1 --2- 172.21.15.89:0/35293092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe9c0d1a00 0x7efe9c0c7470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.262+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 >> 172.21.15.89:0/35293092 conn(0x7efe9c0cec40 msgr2=0x7efe9c071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.262+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 shutdown_connections 2024-09-21T06:44:52.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.262+0000 7efea2494640 1 -- 172.21.15.89:0/35293092 wait complete. 2024-09-21T06:44:52.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new a285756c-6abd-4c2a-947c-6924296cde5c 1 2024-09-21T06:44:52.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3360277026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 msgr2=0x7ff7ec0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 --2- 172.21.15.89:0/3360277026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec0cccf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc005fd0 tx=0x7ff7dc02a5a0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3360277026 shutdown_connections 2024-09-21T06:44:52.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 --2- 172.21.15.89:0/3360277026 >> v2:172.21.15.81:3300/0 conn(0x7ff7ec06ff10 0x7ff7ec15ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 --2- 172.21.15.89:0/3360277026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec0cccf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3360277026 >> 172.21.15.89:0/3360277026 conn(0x7ff7ec0d0aa0 msgr2=0x7ff7ec0d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3360277026 shutdown_connections 2024-09-21T06:44:52.389 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.386+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3360277026 wait complete. 2024-09-21T06:44:52.390 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.389+0000 7ff7f26bd640 1 Processor -- start 2024-09-21T06:44:52.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.389+0000 7ff7f26bd640 1 -- start start 2024-09-21T06:44:52.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f26bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ec06ff10 0x7ff7ec1e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f26bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7ec070320 0x7ff7ec0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f26bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f26bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec15c840 con 0x7ff7ec06ff10 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f26bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec15c6c0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f26bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec1e85b0 con 0x7ff7ec070320 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7ec070320 0x7ff7ec0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f0c5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f0c5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36336/0 (socket says 172.21.15.89:36336) 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ec06ff10 0x7ff7ec1e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7eb7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7ec070320 0x7ff7ec0cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:38554/0 (socket says 172.21.15.89:38554) 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.391+0000 7ff7f0c5a640 1 -- 172.21.15.89:0/3925673516 learned_addr learned my addr 172.21.15.89:0/3925673516 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f0c5a640 1 -- 172.21.15.89:0/3925673516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7ec070320 msgr2=0x7ff7ec0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f0c5a640 1 --2- 172.21.15.89:0/3925673516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7ec070320 0x7ff7ec0cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f0c5a640 1 -- 172.21.15.89:0/3925673516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ec06ff10 msgr2=0x7ff7ec1e7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f0c5a640 1 --2- 172.21.15.89:0/3925673516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ec06ff10 0x7ff7ec1e7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f0c5a640 1 -- 172.21.15.89:0/3925673516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec1f62c0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f0c5a640 1 --2- 172.21.15.89:0/3925673516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec150170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400e980 tx=0x7ff7e400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7e8ff9640 1 -- 172.21.15.89:0/3925673516 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4001f10 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7e8ff9640 1 -- 172.21.15.89:0/3925673516 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7e4003970 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7e8ff9640 1 -- 172.21.15.89:0/3925673516 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4003dc0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec1f65a0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec1e82f0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7e8ff9640 1 -- 172.21.15.89:0/3925673516 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff7e40050d0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.392+0000 7ff7e8ff9640 1 -- 172.21.15.89:0/3925673516 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff7e401a3f0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.393+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ec15ef70 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.397+0000 7ff7e8ff9640 1 -- 172.21.15.89:0/3925673516 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff7e4016020 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.469 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.467+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a285756c-6abd-4c2a-947c-6924296cde5c", "id": 1} v 0) -- 0x7ff7ec070c00 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.471+0000 7ff7e8ff9640 1 -- 172.21.15.89:0/3925673516 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a285756c-6abd-4c2a-947c-6924296cde5c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff7ec15fda0 con 0x7ff7ec0b4a30 2024-09-21T06:44:52.473 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-09-21T06:44:52.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 msgr2=0x7ff7ec150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 --2- 172.21.15.89:0/3925673516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec150170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400e980 tx=0x7ff7e400ee40 comp rx=0 tx=0).stop 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 shutdown_connections 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 --2- 172.21.15.89:0/3925673516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7ec070320 0x7ff7ec0cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 --2- 172.21.15.89:0/3925673516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7ec0b4a30 0x7ff7ec150170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 --2- 172.21.15.89:0/3925673516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ec06ff10 0x7ff7ec1e7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 >> 172.21.15.89:0/3925673516 conn(0x7ff7ec0d0aa0 msgr2=0x7ff7ec06dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 shutdown_connections 2024-09-21T06:44:52.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.472+0000 7ff7f26bd640 1 -- 172.21.15.89:0/3925673516 wait complete. 2024-09-21T06:44:52.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 8effc0a6-a110-434a-a89c-5a3f13f59425 2 2024-09-21T06:44:52.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 -- 172.21.15.89:0/1567938174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00cda90 msgr2=0x7f09d00cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 --2- 172.21.15.89:0/1567938174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00cda90 0x7f09d00cdea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09d00d00e0 tx=0x7f09c402a5f0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 -- 172.21.15.89:0/1567938174 shutdown_connections 2024-09-21T06:44:52.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 --2- 172.21.15.89:0/1567938174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00cda90 0x7f09d00cdea0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 --2- 172.21.15.89:0/1567938174 >> v2:172.21.15.81:3300/0 conn(0x7f09d015fa60 0x7f09d015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 -- 172.21.15.89:0/1567938174 >> 172.21.15.89:0/1567938174 conn(0x7f09d00d10b0 msgr2=0x7f09d00cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 -- 172.21.15.89:0/1567938174 shutdown_connections 2024-09-21T06:44:52.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.595+0000 7f09d69f1640 1 -- 172.21.15.89:0/1567938174 wait complete. 2024-09-21T06:44:52.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.597+0000 7f09d69f1640 1 Processor -- start 2024-09-21T06:44:52.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.597+0000 7f09d69f1640 1 -- start start 2024-09-21T06:44:52.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09d69f1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09d00cda90 0x7f09d00cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09d69f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00ce7a0 0x7f09d00c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09d69f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d015fa60 0x7f09d00c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09d69f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09d00716b0 con 0x7f09d015fa60 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09d69f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f09d0071530 con 0x7f09d00ce7a0 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09d69f1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f09d0071830 con 0x7f09d00cda90 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00ce7a0 0x7f09d00c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cffff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09d00cda90 0x7f09d00cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00ce7a0 0x7f09d00c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36356/0 (socket says 172.21.15.89:36356) 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 -- 172.21.15.89:0/3295574542 learned_addr learned my addr 172.21.15.89:0/3295574542 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09d4f8e640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d015fa60 0x7f09d00c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 -- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09d00cda90 msgr2=0x7f09d00cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09d00cda90 0x7f09d00cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 -- 172.21.15.89:0/3295574542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d015fa60 msgr2=0x7f09d00c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d015fa60 0x7f09d00c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 -- 172.21.15.89:0/3295574542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d00c5ad0 con 0x7f09d00ce7a0 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cffff640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09d00cda90 0x7f09d00cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09cf7fe640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00ce7a0 0x7f09d00c7b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f09c4034040 tx=0x7f09c4003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09ccff9640 1 -- 172.21.15.89:0/3295574542 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c403e030 con 0x7f09d00ce7a0 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09ccff9640 1 -- 172.21.15.89:0/3295574542 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09c4003d10 con 0x7f09d00ce7a0 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.599+0000 7f09ccff9640 1 -- 172.21.15.89:0/3295574542 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4035040 con 0x7f09d00ce7a0 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.600+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d00c5d40 con 0x7f09d00ce7a0 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.600+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d00c62e0 con 0x7f09d00ce7a0 2024-09-21T06:44:52.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.600+0000 7f09ccff9640 1 -- 172.21.15.89:0/3295574542 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09c4041030 con 0x7f09d00ce7a0 2024-09-21T06:44:52.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.600+0000 7f09ccff9640 1 -- 172.21.15.89:0/3295574542 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f09c4043820 con 0x7f09d00ce7a0 2024-09-21T06:44:52.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.600+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d00cf4d0 con 0x7f09d00ce7a0 2024-09-21T06:44:52.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.604+0000 7f09ccff9640 1 -- 172.21.15.89:0/3295574542 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f09c4043410 con 0x7f09d00ce7a0 2024-09-21T06:44:52.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.675+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8effc0a6-a110-434a-a89c-5a3f13f59425", "id": 2} v 0) -- 0x7f09d01f4060 con 0x7f09d00ce7a0 2024-09-21T06:44:52.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.679+0000 7f09ccff9640 1 -- 172.21.15.89:0/3295574542 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8effc0a6-a110-434a-a89c-5a3f13f59425", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f09c4004d50 con 0x7f09d00ce7a0 2024-09-21T06:44:52.681 INFO:teuthology.orchestra.run.smithi089.stdout:2 2024-09-21T06:44:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00ce7a0 msgr2=0x7f09d00c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00ce7a0 0x7f09d00c7b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f09c4034040 tx=0x7f09c4003820 comp rx=0 tx=0).stop 2024-09-21T06:44:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 shutdown_connections 2024-09-21T06:44:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09d015fa60 0x7f09d00c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09d00ce7a0 0x7f09d00c7b00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 --2- 172.21.15.89:0/3295574542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09d00cda90 0x7f09d00cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 >> 172.21.15.89:0/3295574542 conn(0x7f09d00d10b0 msgr2=0x7f09d015e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 shutdown_connections 2024-09-21T06:44:52.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.680+0000 7f09d69f1640 1 -- 172.21.15.89:0/3295574542 wait complete. 2024-09-21T06:44:52.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 93a4d391-8dfe-468a-8b0c-d36d7e1bb531 3 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.803+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2851491427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff141590f0 msgr2=0x7eff1415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.803+0000 7eff1c1e6640 1 --2- 172.21.15.89:0/2851491427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff141590f0 0x7eff1415c4c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7eff10005fd0 tx=0x7eff1002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.803+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2851491427 shutdown_connections 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.803+0000 7eff1c1e6640 1 --2- 172.21.15.89:0/2851491427 >> v2:172.21.15.81:3300/0 conn(0x7eff1415f030 0x7eff1415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.803+0000 7eff1c1e6640 1 --2- 172.21.15.89:0/2851491427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff141590f0 0x7eff1415c4c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.804+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2851491427 >> 172.21.15.89:0/2851491427 conn(0x7eff140d0ae0 msgr2=0x7eff140d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.804+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2851491427 shutdown_connections 2024-09-21T06:44:52.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.804+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2851491427 wait complete. 2024-09-21T06:44:52.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.805+0000 7eff1c1e6640 1 Processor -- start 2024-09-21T06:44:52.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.805+0000 7eff1c1e6640 1 -- start start 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1c1e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff1406dea0 0x7eff141f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1c1e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141590f0 0x7eff14153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1c1e6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff1415f030 0x7eff14151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1c1e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff140cea60 con 0x7eff141590f0 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1c1e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7eff140ce8e0 con 0x7eff1406dea0 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1c1e6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7eff140cebe0 con 0x7eff1415f030 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff1406dea0 0x7eff141f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff1406dea0 0x7eff141f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36372/0 (socket says 172.21.15.89:36372) 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 -- 172.21.15.89:0/2508033497 learned_addr learned my addr 172.21.15.89:0/2508033497 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:52.810 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1a783640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff1415f030 0x7eff14151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19781640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141590f0 0x7eff14153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 -- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff1415f030 msgr2=0x7eff14151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff1415f030 0x7eff14151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 -- 172.21.15.89:0/2508033497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141590f0 msgr2=0x7eff14153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141590f0 0x7eff14153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 -- 172.21.15.89:0/2508033497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff141f6e20 con 0x7eff1406dea0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff1a783640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff1415f030 0x7eff14151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.807+0000 7eff19f82640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff1406dea0 0x7eff141f78c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff10034040 tx=0x7eff100035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.808+0000 7eff0a7fc640 1 -- 172.21.15.89:0/2508033497 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1003e030 con 0x7eff1406dea0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.808+0000 7eff0a7fc640 1 -- 172.21.15.89:0/2508033497 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff10003ae0 con 0x7eff1406dea0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.808+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff140c5c40 con 0x7eff1406dea0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.808+0000 7eff0a7fc640 1 -- 172.21.15.89:0/2508033497 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10035040 con 0x7eff1406dea0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.808+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff141f70c0 con 0x7eff1406dea0 2024-09-21T06:44:52.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.808+0000 7eff0a7fc640 1 -- 172.21.15.89:0/2508033497 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7eff10041030 con 0x7eff1406dea0 2024-09-21T06:44:52.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.808+0000 7eff0a7fc640 1 -- 172.21.15.89:0/2508033497 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7eff10043ad0 con 0x7eff1406dea0 2024-09-21T06:44:52.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.809+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff140cf090 con 0x7eff1406dea0 2024-09-21T06:44:52.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.812+0000 7eff0a7fc640 1 -- 172.21.15.89:0/2508033497 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7eff10043d70 con 0x7eff1406dea0 2024-09-21T06:44:52.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.882+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93a4d391-8dfe-468a-8b0c-d36d7e1bb531", "id": 3} v 0) -- 0x7eff140cf800 con 0x7eff1406dea0 2024-09-21T06:44:52.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.886+0000 7eff0a7fc640 1 -- 172.21.15.89:0/2508033497 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93a4d391-8dfe-468a-8b0c-d36d7e1bb531", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7eff10043640 con 0x7eff1406dea0 2024-09-21T06:44:52.888 INFO:teuthology.orchestra.run.smithi089.stdout:3 2024-09-21T06:44:52.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff1406dea0 msgr2=0x7eff141f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:52.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff1406dea0 0x7eff141f78c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff10034040 tx=0x7eff100035f0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 shutdown_connections 2024-09-21T06:44:52.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff1415f030 0x7eff14151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff141590f0 0x7eff14153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 --2- 172.21.15.89:0/2508033497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff1406dea0 0x7eff141f78c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:52.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 >> 172.21.15.89:0/2508033497 conn(0x7eff140d0ae0 msgr2=0x7eff141587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:52.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 shutdown_connections 2024-09-21T06:44:52.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:52.887+0000 7eff1c1e6640 1 -- 172.21.15.89:0/2508033497 wait complete. 2024-09-21T06:44:52.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 62d75e80-b6ca-48d1-a2bb-c7db05fdf99b 4 2024-09-21T06:44:53.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.010+0000 7ff5442d5640 1 -- 172.21.15.89:0/2517777652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 msgr2=0x7ff53c153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.010+0000 7ff5442d5640 1 --2- 172.21.15.89:0/2517777652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 0x7ff53c153700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009860 tx=0x7ff52c02a510 comp rx=0 tx=0).stop 2024-09-21T06:44:53.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.010+0000 7ff5442d5640 1 -- 172.21.15.89:0/2517777652 shutdown_connections 2024-09-21T06:44:53.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.010+0000 7ff5442d5640 1 --2- 172.21.15.89:0/2517777652 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 0x7ff53c153700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.010+0000 7ff5442d5640 1 -- 172.21.15.89:0/2517777652 >> 172.21.15.89:0/2517777652 conn(0x7ff53c0d1150 msgr2=0x7ff53c0d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.010+0000 7ff5442d5640 1 -- 172.21.15.89:0/2517777652 shutdown_connections 2024-09-21T06:44:53.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.010+0000 7ff5442d5640 1 -- 172.21.15.89:0/2517777652 wait complete. 2024-09-21T06:44:53.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.012+0000 7ff5442d5640 1 Processor -- start 2024-09-21T06:44:53.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.012+0000 7ff5442d5640 1 -- start start 2024-09-21T06:44:53.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff5442d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff53c06f1c0 0x7ff53c1ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff5442d5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 0x7ff53c09e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff5442d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff53c15b620 0x7ff53c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff5442d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c0b4850 con 0x7ff53c15b620 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff5442d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c0b46d0 con 0x7ff53c06f1c0 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff5442d5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff53c0b49d0 con 0x7ff53c15d7b0 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff542071640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff53c06f1c0 0x7ff53c1ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff542071640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff53c06f1c0 0x7ff53c1ef5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36374/0 (socket says 172.21.15.89:36374) 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff542071640 1 -- 172.21.15.89:0/3004031173 learned_addr learned my addr 172.21.15.89:0/3004031173 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.013+0000 7ff541870640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 0x7ff53c09e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff542872640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff53c15b620 0x7ff53c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff541870640 1 -- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff53c06f1c0 msgr2=0x7ff53c1ef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff541870640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff53c06f1c0 0x7ff53c1ef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff541870640 1 -- 172.21.15.89:0/3004031173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff53c15b620 msgr2=0x7ff53c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff541870640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff53c15b620 0x7ff53c15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff541870640 1 -- 172.21.15.89:0/3004031173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c15bf70 con 0x7ff53c15d7b0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff542071640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff53c06f1c0 0x7ff53c1ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff541870640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 0x7ff53c09e3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff53800c3c0 tx=0x7ff53800c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff532ffd640 1 -- 172.21.15.89:0/3004031173 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538011790 con 0x7ff53c15d7b0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff532ffd640 1 -- 172.21.15.89:0/3004031173 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff538017070 con 0x7ff53c15d7b0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff532ffd640 1 -- 172.21.15.89:0/3004031173 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538011cc0 con 0x7ff53c15d7b0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53c1efb10 con 0x7ff53c15d7b0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53c1f5a40 con 0x7ff53c15d7b0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff532ffd640 1 -- 172.21.15.89:0/3004031173 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff53801c460 con 0x7ff53c15d7b0 2024-09-21T06:44:53.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.014+0000 7ff532ffd640 1 -- 172.21.15.89:0/3004031173 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff538012d90 con 0x7ff53c15d7b0 2024-09-21T06:44:53.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.016+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53c153700 con 0x7ff53c15d7b0 2024-09-21T06:44:53.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.018+0000 7ff532ffd640 1 -- 172.21.15.89:0/3004031173 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff53c15bf70 con 0x7ff53c15d7b0 2024-09-21T06:44:53.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.130+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "62d75e80-b6ca-48d1-a2bb-c7db05fdf99b", "id": 4} v 0) -- 0x7ff53c0727a0 con 0x7ff53c15d7b0 2024-09-21T06:44:53.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff532ffd640 1 -- 172.21.15.89:0/3004031173 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "62d75e80-b6ca-48d1-a2bb-c7db05fdf99b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff538012420 con 0x7ff53c15d7b0 2024-09-21T06:44:53.136 INFO:teuthology.orchestra.run.smithi089.stdout:4 2024-09-21T06:44:53.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 msgr2=0x7ff53c09e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff5442d5640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 0x7ff53c09e3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff53800c3c0 tx=0x7ff53800c7c0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 shutdown_connections 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff5442d5640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff53c15d7b0 0x7ff53c09e3a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff5442d5640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff53c15b620 0x7ff53c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff5442d5640 1 --2- 172.21.15.89:0/3004031173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff53c06f1c0 0x7ff53c1ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.135+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 >> 172.21.15.89:0/3004031173 conn(0x7ff53c0d1150 msgr2=0x7ff53c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.136+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 shutdown_connections 2024-09-21T06:44:53.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.136+0000 7ff5442d5640 1 -- 172.21.15.89:0/3004031173 wait complete. 2024-09-21T06:44:53.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 13d1a733-1e42-4bee-99b7-61bce85e5e6f 5 2024-09-21T06:44:53.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.258+0000 7f8cec8f9640 1 -- 172.21.15.89:0/4242543626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 msgr2=0x7f8ce815f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.258+0000 7f8cec8f9640 1 --2- 172.21.15.89:0/4242543626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce815f7b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ce806e8a0 tx=0x7f8cdc02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.259+0000 7f8cec8f9640 1 -- 172.21.15.89:0/4242543626 shutdown_connections 2024-09-21T06:44:53.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.259+0000 7f8cec8f9640 1 --2- 172.21.15.89:0/4242543626 >> v2:172.21.15.81:3300/0 conn(0x7f8ce815b670 0x7f8ce806cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.259+0000 7f8cec8f9640 1 --2- 172.21.15.89:0/4242543626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce815f7b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.259+0000 7f8cec8f9640 1 -- 172.21.15.89:0/4242543626 >> 172.21.15.89:0/4242543626 conn(0x7f8ce80d0aa0 msgr2=0x7f8ce80d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.259+0000 7f8cec8f9640 1 -- 172.21.15.89:0/4242543626 shutdown_connections 2024-09-21T06:44:53.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.259+0000 7f8cec8f9640 1 -- 172.21.15.89:0/4242543626 wait complete. 2024-09-21T06:44:53.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.260+0000 7f8cec8f9640 1 Processor -- start 2024-09-21T06:44:53.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.261+0000 7f8cec8f9640 1 -- start start 2024-09-21T06:44:53.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8cec8f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce81f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8cec8f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce80afc60 0x7f8ce81596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8cec8f9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ce815b670 0x7f8ce814b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8cec8f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce806d820 con 0x7f8ce80afc60 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8cec8f9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce806d6a0 con 0x7f8ce80af710 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8cec8f9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce806d9a0 con 0x7f8ce815b670 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce81f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce6d9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ce815b670 0x7f8ce814b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce81f7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36386/0 (socket says 172.21.15.89:36386) 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce659c640 1 -- 172.21.15.89:0/774230975 learned_addr learned my addr 172.21.15.89:0/774230975 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce5d9b640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce80afc60 0x7f8ce81596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce6d9d640 1 -- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 msgr2=0x7f8ce81f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce6d9d640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce81f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce6d9d640 1 -- 172.21.15.89:0/774230975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce80afc60 msgr2=0x7f8ce81596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce6d9d640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce80afc60 0x7f8ce81596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce6d9d640 1 -- 172.21.15.89:0/774230975 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce814f2b0 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce659c640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce81f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.262+0000 7f8ce6d9d640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ce815b670 0x7f8ce814b570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0005fd0 tx=0x7f8ce000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.263+0000 7f8cd6ffd640 1 -- 172.21.15.89:0/774230975 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000cd80 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.263+0000 7f8cd6ffd640 1 -- 172.21.15.89:0/774230975 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ce0004b20 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.263+0000 7f8cd6ffd640 1 -- 172.21.15.89:0/774230975 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0005020 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.263+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce814f590 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.263+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce814dfc0 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.263+0000 7f8cd6ffd640 1 -- 172.21.15.89:0/774230975 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ce0005550 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.263+0000 7f8cd6ffd640 1 -- 172.21.15.89:0/774230975 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8ce00109b0 con 0x7f8ce815b670 2024-09-21T06:44:53.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.264+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce806de50 con 0x7f8ce815b670 2024-09-21T06:44:53.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.266+0000 7f8cd6ffd640 1 -- 172.21.15.89:0/774230975 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8ce0018dd0 con 0x7f8ce815b670 2024-09-21T06:44:53.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.337+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "13d1a733-1e42-4bee-99b7-61bce85e5e6f", "id": 5} v 0) -- 0x7f8ce80cff00 con 0x7f8ce815b670 2024-09-21T06:44:53.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.341+0000 7f8cd6ffd640 1 -- 172.21.15.89:0/774230975 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13d1a733-1e42-4bee-99b7-61bce85e5e6f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8ce0010c50 con 0x7f8ce815b670 2024-09-21T06:44:53.343 INFO:teuthology.orchestra.run.smithi089.stdout:5 2024-09-21T06:44:53.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ce815b670 msgr2=0x7f8ce814b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ce815b670 0x7f8ce814b570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0005fd0 tx=0x7f8ce000ee40 comp rx=0 tx=0).stop 2024-09-21T06:44:53.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 shutdown_connections 2024-09-21T06:44:53.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ce815b670 0x7f8ce814b570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce80afc60 0x7f8ce81596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 --2- 172.21.15.89:0/774230975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ce80af710 0x7f8ce81f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 >> 172.21.15.89:0/774230975 conn(0x7f8ce80d0aa0 msgr2=0x7f8ce8068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 shutdown_connections 2024-09-21T06:44:53.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.342+0000 7f8cec8f9640 1 -- 172.21.15.89:0/774230975 wait complete. 2024-09-21T06:44:53.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 0e81012a-bcd4-467f-b394-cc3f09651729 6 2024-09-21T06:44:53.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.465+0000 7f7fb58d5640 1 -- 172.21.15.89:0/584677724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 msgr2=0x7f7fb0160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.465+0000 7f7fb58d5640 1 --2- 172.21.15.89:0/584677724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 0x7f7fb0160830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009860 tx=0x7f7f9802a5a0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.465+0000 7f7fb58d5640 1 -- 172.21.15.89:0/584677724 shutdown_connections 2024-09-21T06:44:53.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.465+0000 7f7fb58d5640 1 --2- 172.21.15.89:0/584677724 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 0x7f7fb0160830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.465+0000 7f7fb58d5640 1 -- 172.21.15.89:0/584677724 >> 172.21.15.89:0/584677724 conn(0x7f7fb00cec40 msgr2=0x7f7fb00cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.465+0000 7f7fb58d5640 1 -- 172.21.15.89:0/584677724 shutdown_connections 2024-09-21T06:44:53.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.465+0000 7f7fb58d5640 1 -- 172.21.15.89:0/584677724 wait complete. 2024-09-21T06:44:53.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.467+0000 7f7fb58d5640 1 Processor -- start 2024-09-21T06:44:53.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.467+0000 7f7fb58d5640 1 -- start start 2024-09-21T06:44:53.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fb58d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb00d1a00 0x7f7fb01f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fb58d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb015c4d0 0x7f7fb01526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fb58d5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 0x7f7fb00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fb58d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb015d430 con 0x7f7fb00d1a00 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fb58d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb015d2b0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fb58d5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb015d5b0 con 0x7f7fb015eeb0 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fae7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb015c4d0 0x7f7fb01526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fae7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb015c4d0 0x7f7fb01526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36392/0 (socket says 172.21.15.89:36392) 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7fae7fc640 1 -- 172.21.15.89:0/1051508455 learned_addr learned my addr 172.21.15.89:0/1051508455 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7faeffd640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb00d1a00 0x7f7fb01f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.468+0000 7f7faf7fe640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 0x7f7fb00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fae7fc640 1 -- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 msgr2=0x7f7fb00ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fae7fc640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 0x7f7fb00ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fae7fc640 1 -- 172.21.15.89:0/1051508455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb00d1a00 msgr2=0x7f7fb01f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fae7fc640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb00d1a00 0x7f7fb01f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fae7fc640 1 -- 172.21.15.89:0/1051508455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb01f6b40 con 0x7f7fb015c4d0 2024-09-21T06:44:53.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fae7fc640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb015c4d0 0x7f7fb01526d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f9802ab90 tx=0x7f7f98033ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fa7fff640 1 -- 172.21.15.89:0/1051508455 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98031b50 con 0x7f7fb015c4d0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fa7fff640 1 -- 172.21.15.89:0/1051508455 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f98031de0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb00b2d30 con 0x7f7fb015c4d0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fa7fff640 1 -- 172.21.15.89:0/1051508455 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98005260 con 0x7f7fb015c4d0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb006e0f0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fa7fff640 1 -- 172.21.15.89:0/1051508455 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f980047a0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.469+0000 7f7fa7fff640 1 -- 172.21.15.89:0/1051508455 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7f980035f0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.470+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb00cd8a0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.472+0000 7f7fa7fff640 1 -- 172.21.15.89:0/1051508455 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7fb00cd8a0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.543+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e81012a-bcd4-467f-b394-cc3f09651729", "id": 6} v 0) -- 0x7f7fb015c8e0 con 0x7f7fb015c4d0 2024-09-21T06:44:53.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.546+0000 7f7fa7fff640 1 -- 172.21.15.89:0/1051508455 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e81012a-bcd4-467f-b394-cc3f09651729", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7fb01f6b40 con 0x7f7fb015c4d0 2024-09-21T06:44:53.549 INFO:teuthology.orchestra.run.smithi089.stdout:6 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.547+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb015c4d0 msgr2=0x7f7fb01526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.547+0000 7f7fb58d5640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb015c4d0 0x7f7fb01526d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7f9802ab90 tx=0x7f7f98033ba0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.547+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 shutdown_connections 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.547+0000 7f7fb58d5640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fb015eeb0 0x7f7fb00ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.547+0000 7f7fb58d5640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb015c4d0 0x7f7fb01526d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.547+0000 7f7fb58d5640 1 --2- 172.21.15.89:0/1051508455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fb00d1a00 0x7f7fb01f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.547+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 >> 172.21.15.89:0/1051508455 conn(0x7f7fb00cec40 msgr2=0x7f7fb00701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.548+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 shutdown_connections 2024-09-21T06:44:53.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.548+0000 7f7fb58d5640 1 -- 172.21.15.89:0/1051508455 wait complete. 2024-09-21T06:44:53.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4 7 2024-09-21T06:44:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.669+0000 7fa026694640 1 -- 172.21.15.89:0/2635777919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 msgr2=0x7fa00c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.669+0000 7fa026694640 1 --2- 172.21.15.89:0/2635777919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 0x7fa00c004080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa010006f70 tx=0x7fa00c005830 comp rx=0 tx=0).stop 2024-09-21T06:44:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.669+0000 7fa026694640 1 -- 172.21.15.89:0/2635777919 shutdown_connections 2024-09-21T06:44:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.669+0000 7fa026694640 1 --2- 172.21.15.89:0/2635777919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 0x7fa00c004080 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.669+0000 7fa026694640 1 -- 172.21.15.89:0/2635777919 >> 172.21.15.89:0/2635777919 conn(0x7fa0200cec40 msgr2=0x7fa0200cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.669+0000 7fa026694640 1 -- 172.21.15.89:0/2635777919 shutdown_connections 2024-09-21T06:44:53.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.669+0000 7fa026694640 1 -- 172.21.15.89:0/2635777919 wait complete. 2024-09-21T06:44:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.671+0000 7fa026694640 1 Processor -- start 2024-09-21T06:44:53.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.671+0000 7fa026694640 1 -- start start 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa026694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 0x7fa0200cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa026694640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0200ca060 0x7fa0200b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa026694640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0201f93c0 0x7fa0201f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa026694640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa020160780 con 0x7fa0201f93c0 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa026694640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa020160600 con 0x7fa00c003c30 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa026694640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa020160900 con 0x7fa0200ca060 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0200ca060 0x7fa0200b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 0x7fa0200cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0200ca060 0x7fa0200b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:38660/0 (socket says 172.21.15.89:38660) 2024-09-21T06:44:53.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 -- 172.21.15.89:0/2548885409 learned_addr learned my addr 172.21.15.89:0/2548885409 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa024c31640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0201f93c0 0x7fa0201f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 -- 172.21.15.89:0/2548885409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 msgr2=0x7fa0200cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 0x7fa0200cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 -- 172.21.15.89:0/2548885409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0201f93c0 msgr2=0x7fa0201f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0201f93c0 0x7fa0201f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 -- 172.21.15.89:0/2548885409 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0200c9310 con 0x7fa0200ca060 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01f7fe640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0200ca060 0x7fa0200b2b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa008011ab0 tx=0x7fa008011f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.673+0000 7fa01cff9640 1 -- 172.21.15.89:0/2548885409 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00801e070 con 0x7fa0200ca060 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.674+0000 7fa01cff9640 1 -- 172.21.15.89:0/2548885409 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa00800fc70 con 0x7fa0200ca060 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.674+0000 7fa01cff9640 1 -- 172.21.15.89:0/2548885409 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa008019670 con 0x7fa0200ca060 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.674+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0200cb790 con 0x7fa0200ca060 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.674+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0200c9580 con 0x7fa0200ca060 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.674+0000 7fa01cff9640 1 -- 172.21.15.89:0/2548885409 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa008021070 con 0x7fa0200ca060 2024-09-21T06:44:53.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.674+0000 7fa01cff9640 1 -- 172.21.15.89:0/2548885409 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa0080183b0 con 0x7fa0200ca060 2024-09-21T06:44:53.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.675+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa020160e60 con 0x7fa0200ca060 2024-09-21T06:44:53.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.677+0000 7fa01cff9640 1 -- 172.21.15.89:0/2548885409 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa0200cb790 con 0x7fa0200ca060 2024-09-21T06:44:53.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.747+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4", "id": 7} v 0) -- 0x7fa020073970 con 0x7fa0200ca060 2024-09-21T06:44:53.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.753+0000 7fa01cff9640 1 -- 172.21.15.89:0/2548885409 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa008019810 con 0x7fa0200ca060 2024-09-21T06:44:53.754 INFO:teuthology.orchestra.run.smithi089.stdout:7 2024-09-21T06:44:53.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.753+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0200ca060 msgr2=0x7fa0200b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.753+0000 7fa026694640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0200ca060 0x7fa0200b2b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa008011ab0 tx=0x7fa008011f70 comp rx=0 tx=0).stop 2024-09-21T06:44:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.753+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 shutdown_connections 2024-09-21T06:44:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.753+0000 7fa026694640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0200ca060 0x7fa0200b2b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.753+0000 7fa026694640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0201f93c0 0x7fa0201f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.753+0000 7fa026694640 1 --2- 172.21.15.89:0/2548885409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa00c003c30 0x7fa0200cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.754+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 >> 172.21.15.89:0/2548885409 conn(0x7fa0200cec40 msgr2=0x7fa02015c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.754+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 shutdown_connections 2024-09-21T06:44:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:44:53.754+0000 7fa026694640 1 -- 172.21.15.89:0/2548885409 wait complete. 2024-09-21T06:44:53.766 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T06:44:53.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T06:44:53.769 INFO:tasks.ceph.osd.0:Started 2024-09-21T06:44:53.769 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T06:44:53.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T06:44:53.771 INFO:tasks.ceph.osd.1:Started 2024-09-21T06:44:53.771 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T06:44:53.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T06:44:53.773 INFO:tasks.ceph.osd.2:Started 2024-09-21T06:44:53.773 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T06:44:53.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T06:44:53.775 INFO:tasks.ceph.osd.3:Started 2024-09-21T06:44:53.775 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T06:44:53.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T06:44:53.778 INFO:tasks.ceph.osd.4:Started 2024-09-21T06:44:53.778 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T06:44:53.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T06:44:53.780 INFO:tasks.ceph.osd.5:Started 2024-09-21T06:44:53.780 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T06:44:53.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T06:44:53.782 INFO:tasks.ceph.osd.6:Started 2024-09-21T06:44:53.782 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T06:44:53.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T06:44:53.784 INFO:tasks.ceph.osd.7:Started 2024-09-21T06:44:53.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:44:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 -- 172.21.15.81:0/3229059710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 msgr2=0x7f2d8415e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 --2- 172.21.15.81:0/3229059710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415e4c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d84073f20 tx=0x7f2d7c02aac0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 -- 172.21.15.81:0/3229059710 shutdown_connections 2024-09-21T06:44:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 --2- 172.21.15.81:0/3229059710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415e4c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 --2- 172.21.15.81:0/3229059710 >> v2:172.21.15.89:3300/0 conn(0x7f2d840cfda0 0x7f2d8415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 -- 172.21.15.81:0/3229059710 >> 172.21.15.81:0/3229059710 conn(0x7f2d840b4210 msgr2=0x7f2d840b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:53.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 -- 172.21.15.81:0/3229059710 shutdown_connections 2024-09-21T06:44:53.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.938+0000 7f2d893c6640 1 -- 172.21.15.81:0/3229059710 wait complete. 2024-09-21T06:44:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.940+0000 7f2d893c6640 1 Processor -- start 2024-09-21T06:44:53.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.940+0000 7f2d893c6640 1 -- start start 2024-09-21T06:44:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d893c6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d840cfda0 0x7f2d8414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d893c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d840d1340 0x7f2d841f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d893c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d893c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8415ed90 con 0x7f2d8415e0b0 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d893c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8415ec10 con 0x7f2d840d1340 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d893c6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8415ef10 con 0x7f2d840cfda0 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60610/0 (socket says 172.21.15.81:60610) 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 -- 172.21.15.81:0/3257105584 learned_addr learned my addr 172.21.15.81:0/3257105584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d827fc640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d840d1340 0x7f2d841f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d82ffd640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d840cfda0 0x7f2d8414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 -- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d840cfda0 msgr2=0x7f2d8414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d840cfda0 0x7f2d8414c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 -- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d840d1340 msgr2=0x7f2d841f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d840d1340 0x7f2d841f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.941+0000 7f2d837fe640 1 -- 172.21.15.81:0/3257105584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d84153850 con 0x7f2d8415e0b0 2024-09-21T06:44:53.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d837fe640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415b5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009d60 tx=0x7f2d7c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d6b7fe640 1 -- 172.21.15.81:0/3257105584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c044070 con 0x7f2d8415e0b0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d6b7fe640 1 -- 172.21.15.81:0/3257105584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d7c004250 con 0x7f2d8415e0b0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d841f9920 con 0x7f2d8415e0b0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d6b7fe640 1 -- 172.21.15.81:0/3257105584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0046a0 con 0x7f2d8415e0b0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d841f5bf0 con 0x7f2d8415e0b0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d6b7fe640 1 -- 172.21.15.81:0/3257105584 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2d7c03f410 con 0x7f2d8415e0b0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.942+0000 7f2d6b7fe640 1 -- 172.21.15.81:0/3257105584 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2d7c036ad0 con 0x7f2d8415e0b0 2024-09-21T06:44:53.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.943+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8415d730 con 0x7f2d8415e0b0 2024-09-21T06:44:53.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:53.945+0000 7f2d6b7fe640 1 -- 172.21.15.81:0/3257105584 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2d84153850 con 0x7f2d8415e0b0 2024-09-21T06:44:54.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.018+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d840c5ae0 con 0x7f2d8415e0b0 2024-09-21T06:44:54.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.019+0000 7f2d6b7fe640 1 -- 172.21.15.81:0/3257105584 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2d7c032030 con 0x7f2d8415e0b0 2024-09-21T06:44:54.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:44:54.020 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:44:53.749731+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:44:54.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 msgr2=0x7f2d8415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:54.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415b5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009d60 tx=0x7f2d7c003ce0 comp rx=0 tx=0).stop 2024-09-21T06:44:54.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 shutdown_connections 2024-09-21T06:44:54.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d8415e0b0 0x7f2d8415b5e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:54.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d840d1340 0x7f2d841f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:54.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 --2- 172.21.15.81:0/3257105584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d840cfda0 0x7f2d8414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:54.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 >> 172.21.15.81:0/3257105584 conn(0x7f2d840b4210 msgr2=0x7f2d8415c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:54.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 shutdown_connections 2024-09-21T06:44:54.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:44:54.020+0000 7f2d893c6640 1 -- 172.21.15.81:0/3257105584 wait complete. 2024-09-21T06:44:54.032 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T06:44:54.032 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T06:44:54.836 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T06:44:54.942 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.941+0000 7f0f432d3640 1 -- 172.21.15.81:0/1325307413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c0d19a0 msgr2=0x7f0f3c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:54.942 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.941+0000 7f0f432d3640 1 --2- 172.21.15.81:0/1325307413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c0d19a0 0x7f0f3c15a290 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009900 tx=0x7f0f3802a610 comp rx=0 tx=0).stop 2024-09-21T06:44:54.942 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.941+0000 7f0f432d3640 1 -- 172.21.15.81:0/1325307413 shutdown_connections 2024-09-21T06:44:54.942 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.941+0000 7f0f432d3640 1 --2- 172.21.15.81:0/1325307413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c0d19a0 0x7f0f3c15a290 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:54.943 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.941+0000 7f0f432d3640 1 -- 172.21.15.81:0/1325307413 >> 172.21.15.81:0/1325307413 conn(0x7f0f3c0d25e0 msgr2=0x7f0f3c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:54.943 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.941+0000 7f0f432d3640 1 -- 172.21.15.81:0/1325307413 shutdown_connections 2024-09-21T06:44:54.943 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.941+0000 7f0f432d3640 1 -- 172.21.15.81:0/1325307413 wait complete. 2024-09-21T06:44:54.943 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.942+0000 7f0f432d3640 1 Processor -- start 2024-09-21T06:44:54.943 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.943+0000 7f0f432d3640 1 -- start start 2024-09-21T06:44:54.946 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f432d3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f3c0d19a0 0x7f0f3c156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:54.946 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f432d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f3c15d2c0 0x7f0f3c0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:54.946 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f432d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c1601c0 0x7f0f3c0cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f432d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c15d6d0 con 0x7f0f3c1601c0 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f432d3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c073660 con 0x7f0f3c15d2c0 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f432d3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c15d850 con 0x7f0f3c0d19a0 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c1601c0 0x7f0f3c0cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c1601c0 0x7f0f3c0cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60620/0 (socket says 172.21.15.81:60620) 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 -- 172.21.15.81:0/2638949153 learned_addr learned my addr 172.21.15.81:0/2638949153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f4086e640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f3c15d2c0 0x7f0f3c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f4106f640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f3c0d19a0 0x7f0f3c156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 -- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f3c0d19a0 msgr2=0x7f0f3c156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f3c0d19a0 0x7f0f3c156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 -- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f3c15d2c0 msgr2=0x7f0f3c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:54.947 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f3c15d2c0 0x7f0f3c0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 -- 172.21.15.81:0/2638949153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c0ca550 con 0x7f0f3c1601c0 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f41870640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c1601c0 0x7f0f3c0cb6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c730 tx=0x7f0f3400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.944+0000 7f0f31ffb640 1 -- 172.21.15.81:0/2638949153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34003b70 con 0x7f0f3c1601c0 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.945+0000 7f0f31ffb640 1 -- 172.21.15.81:0/2638949153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f34003d30 con 0x7f0f3c1601c0 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.945+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c0ca830 con 0x7f0f3c1601c0 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.945+0000 7f0f31ffb640 1 -- 172.21.15.81:0/2638949153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340052d0 con 0x7f0f3c1601c0 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.945+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c0c5e70 con 0x7f0f3c1601c0 2024-09-21T06:44:54.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.946+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c0ca2c0 con 0x7f0f3c1601c0 2024-09-21T06:44:54.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.946+0000 7f0f31ffb640 1 -- 172.21.15.81:0/2638949153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f0f34005680 con 0x7f0f3c1601c0 2024-09-21T06:44:54.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.946+0000 7f0f31ffb640 1 -- 172.21.15.81:0/2638949153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0f34052270 con 0x7f0f3c1601c0 2024-09-21T06:44:54.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:54.948+0000 7f0f31ffb640 1 -- 172.21.15.81:0/2638949153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0f3401b400 con 0x7f0f3c1601c0 2024-09-21T06:44:55.008 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.008+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f3c15a290 con 0x7f0f3c1601c0 2024-09-21T06:44:55.009 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.008+0000 7f0f31ffb640 1 -- 172.21.15.81:0/2638949153 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0f34011cc0 con 0x7f0f3c1601c0 2024-09-21T06:44:55.009 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-21T06:44:55.009 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:44:53.749731+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:44:55.010 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c1601c0 msgr2=0x7f0f3c0cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:55.010 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c1601c0 0x7f0f3c0cb6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c730 tx=0x7f0f3400cbf0 comp rx=0 tx=0).stop 2024-09-21T06:44:55.010 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 shutdown_connections 2024-09-21T06:44:55.011 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f3c1601c0 0x7f0f3c0cb6c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:55.011 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f3c15d2c0 0x7f0f3c0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:55.011 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 --2- 172.21.15.81:0/2638949153 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f3c0d19a0 0x7f0f3c156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:55.011 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 >> 172.21.15.81:0/2638949153 conn(0x7f0f3c0d25e0 msgr2=0x7f0f3c15ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:55.011 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 shutdown_connections 2024-09-21T06:44:55.011 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:44:55.009+0000 7f0f432d3640 1 -- 172.21.15.81:0/2638949153 wait complete. 2024-09-21T06:44:55.019 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T06:44:55.048 INFO:tasks.ceph.osd.4.smithi089.stderr:2024-09-21T06:44:55.046+0000 7f741040b640 -1 Falling back to public interface 2024-09-21T06:44:55.052 INFO:tasks.ceph.osd.5.smithi089.stderr:2024-09-21T06:44:55.050+0000 7f78b6d2c640 -1 Falling back to public interface 2024-09-21T06:44:55.257 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-21T06:44:55.256+0000 7f3baa214640 -1 Falling back to public interface 2024-09-21T06:44:55.258 INFO:tasks.ceph.osd.6.smithi089.stderr:2024-09-21T06:44:55.257+0000 7f2e2e82a640 -1 Falling back to public interface 2024-09-21T06:44:55.274 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-21T06:44:55.274+0000 7fa816615640 -1 Falling back to public interface 2024-09-21T06:44:55.491 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-21T06:44:55.490+0000 7f2c7660f640 -1 Falling back to public interface 2024-09-21T06:44:55.514 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-21T06:44:55.513+0000 7f2b01016640 -1 Falling back to public interface 2024-09-21T06:44:55.658 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-09-21T06:44:55.656+0000 7f48c8d50640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T06:44:55.658 INFO:tasks.ceph.mgr.x.smithi089.stderr:2024-09-21T06:44:55.657+0000 7f48c8d50640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T06:44:55.770 INFO:tasks.ceph.osd.7.smithi089.stderr:2024-09-21T06:44:55.768+0000 7f9b09cf1640 -1 Falling back to public interface 2024-09-21T06:44:59.024 INFO:tasks.ceph.osd.6.smithi089.stderr:2024-09-21T06:44:59.022+0000 7f2e2e82a640 -1 osd.6 0 log_to_monitors true 2024-09-21T06:44:59.062 INFO:tasks.ceph.osd.4.smithi089.stderr:2024-09-21T06:44:59.060+0000 7f741040b640 -1 osd.4 0 log_to_monitors true 2024-09-21T06:44:59.107 INFO:tasks.ceph.osd.5.smithi089.stderr:2024-09-21T06:44:59.106+0000 7f78b6d2c640 -1 osd.5 0 log_to_monitors true 2024-09-21T06:44:59.336 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-21T06:44:59.335+0000 7f3baa214640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:44:59.387 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-21T06:44:59.386+0000 7fa816615640 -1 osd.3 0 log_to_monitors true 2024-09-21T06:44:59.534 INFO:tasks.ceph.osd.7.smithi089.stderr:2024-09-21T06:44:59.533+0000 7f9b09cf1640 -1 osd.7 0 log_to_monitors true 2024-09-21T06:44:59.580 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-21T06:44:59.579+0000 7f2b01016640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:44:59.743 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-21T06:44:59.742+0000 7f2c7660f640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:45:01.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:45:01.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:45:01.628 INFO:tasks.ceph.osd.4.smithi089.stderr:2024-09-21T06:45:01.626+0000 7f740c512640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T06:45:01.648 INFO:tasks.ceph.osd.6.smithi089.stderr:2024-09-21T06:45:01.647+0000 7f2e2a7b8640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T06:45:01.679 INFO:tasks.ceph.osd.4.smithi089.stderr:2024-09-21T06:45:01.678+0000 7f7403af3640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:01.729 INFO:tasks.ceph.osd.6.smithi089.stderr:2024-09-21T06:45:01.727+0000 7f2e225ae640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:01.825 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:01.944 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.941+0000 7f8eecbc6640 1 -- 172.21.15.81:0/2438948594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee80742d0 msgr2=0x7f8ee815b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.944 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.941+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/2438948594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee80742d0 0x7f8ee815b180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0005fd0 tx=0x7f8ee002b980 comp rx=0 tx=0).stop 2024-09-21T06:45:01.944 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.941+0000 7f8eecbc6640 1 -- 172.21.15.81:0/2438948594 shutdown_connections 2024-09-21T06:45:01.944 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.942+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/2438948594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee80742d0 0x7f8ee815b180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.944 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.942+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/2438948594 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee815f2f0 0x7f8ee8073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.944 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.942+0000 7f8eecbc6640 1 -- 172.21.15.81:0/2438948594 >> 172.21.15.81:0/2438948594 conn(0x7f8ee80d1260 msgr2=0x7f8ee8073680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.944 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.942+0000 7f8eecbc6640 1 -- 172.21.15.81:0/2438948594 shutdown_connections 2024-09-21T06:45:01.945 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.942+0000 7f8eecbc6640 1 -- 172.21.15.81:0/2438948594 wait complete. 2024-09-21T06:45:01.946 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.944+0000 7f8eecbc6640 1 Processor -- start 2024-09-21T06:45:01.946 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.944+0000 7f8eecbc6640 1 -- start start 2024-09-21T06:45:01.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8eecbc6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee80742d0 0x7f8ee8154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8eecbc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee81552b0 0x7f8ee80cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.948 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8eecbc6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ee815f2f0 0x7f8ee814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8eecbc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee806ab30 con 0x7f8ee81552b0 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8eecbc6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8071290 con 0x7f8ee815f2f0 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8eecbc6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee806acb0 con 0x7f8ee80742d0 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8ee659c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee80742d0 0x7f8ee8154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8ee5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee81552b0 0x7f8ee80cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8ee659c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee80742d0 0x7f8ee8154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:53560/0 (socket says 172.21.15.81:53560) 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8ee6d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ee815f2f0 0x7f8ee814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8ee659c640 1 -- 172.21.15.81:0/3978027603 learned_addr learned my addr 172.21.15.81:0/3978027603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.945+0000 7f8ee659c640 1 -- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ee815f2f0 msgr2=0x7f8ee814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ee659c640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ee815f2f0 0x7f8ee814b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ee659c640 1 -- 172.21.15.81:0/3978027603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee81552b0 msgr2=0x7f8ee80cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ee659c640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee81552b0 0x7f8ee80cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ee659c640 1 -- 172.21.15.81:0/3978027603 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee80aeb90 con 0x7f8ee80742d0 2024-09-21T06:45:01.949 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ee5d9b640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee81552b0 0x7f8ee80cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:01.950 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ee659c640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee80742d0 0x7f8ee8154690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c3a0 tx=0x7f8ed800c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.950 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ed6ffd640 1 -- 172.21.15.81:0/3978027603 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8017070 con 0x7f8ee80742d0 2024-09-21T06:45:01.950 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ed6ffd640 1 -- 172.21.15.81:0/3978027603 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ed80053c0 con 0x7f8ee80742d0 2024-09-21T06:45:01.950 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee80aee70 con 0x7f8ee80742d0 2024-09-21T06:45:01.950 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8ed6ffd640 1 -- 172.21.15.81:0/3978027603 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8003850 con 0x7f8ee80742d0 2024-09-21T06:45:01.950 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.946+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee81543d0 con 0x7f8ee80742d0 2024-09-21T06:45:01.950 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.947+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee806b1c0 con 0x7f8ee80742d0 2024-09-21T06:45:01.951 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.949+0000 7f8ed6ffd640 1 -- 172.21.15.81:0/3978027603 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f8ed801a070 con 0x7f8ee80742d0 2024-09-21T06:45:01.952 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.950+0000 7f8ed6ffd640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8ec8078b00 0x7f8ec807b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.952 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.950+0000 7f8ed6ffd640 1 -- 172.21.15.81:0/3978027603 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f8ed8099260 con 0x7f8ee80742d0 2024-09-21T06:45:01.952 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.950+0000 7f8ee5d9b640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8ec8078b00 0x7f8ec807b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.953 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.951+0000 7f8ee5d9b640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8ec8078b00 0x7f8ec807b010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80c67f0 tx=0x7f8edc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.960 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:01.957+0000 7f8ed6ffd640 1 -- 172.21.15.81:0/3978027603 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ee80746e0 con 0x7f8ee80742d0 2024-09-21T06:45:02.187 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.185+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ee8070830 con 0x7f8ee80742d0 2024-09-21T06:45:02.188 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.186+0000 7f8ed6ffd640 1 -- 172.21.15.81:0/3978027603 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f8ed8061e40 con 0x7f8ee80742d0 2024-09-21T06:45:02.188 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-21T06:45:02.189 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":13,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:01.080083+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8ec8078b00 msgr2=0x7f8ec807b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8ec8078b00 0x7f8ec807b010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80c67f0 tx=0x7f8edc005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee80742d0 msgr2=0x7f8ee8154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee80742d0 0x7f8ee8154690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c3a0 tx=0x7f8ed800c860 comp rx=0 tx=0).stop 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 shutdown_connections 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8ec8078b00 0x7f8ec807b010 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ee815f2f0 0x7f8ee814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ee81552b0 0x7f8ee80cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.191 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 --2- 172.21.15.81:0/3978027603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ee80742d0 0x7f8ee8154690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 >> 172.21.15.81:0/3978027603 conn(0x7f8ee80d1260 msgr2=0x7f8ee80cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 shutdown_connections 2024-09-21T06:45:02.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:02.189+0000 7f8eecbc6640 1 -- 172.21.15.81:0/3978027603 wait complete. 2024-09-21T06:45:02.203 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T06:45:02.365 INFO:tasks.ceph.osd.5.smithi089.stderr:2024-09-21T06:45:02.363+0000 7f78b34cf640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T06:45:02.382 INFO:tasks.ceph.osd.7.smithi089.stderr:2024-09-21T06:45:02.380+0000 7f9b06494640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T06:45:02.382 INFO:tasks.ceph.osd.5.smithi089.stderr:2024-09-21T06:45:02.381+0000 7f78aaab0640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:02.391 INFO:tasks.ceph.osd.7.smithi089.stderr:2024-09-21T06:45:02.390+0000 7f9afda75640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:03.318 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-21T06:45:03.316+0000 7f2c7201b640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:45:03.338 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-21T06:45:03.336+0000 7f2c69e11640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:03.340 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-21T06:45:03.337+0000 7f2afc979640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:45:03.351 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-21T06:45:03.349+0000 7f2af476f640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:03.369 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-21T06:45:03.367+0000 7f3ba5a9e640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:45:03.379 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-21T06:45:03.378+0000 7f3b9d894640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:03.414 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-21T06:45:03.412+0000 7fa811f05640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T06:45:03.426 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-21T06:45:03.424+0000 7fa809cfb640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:45:09.009 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 -- 172.21.15.81:0/1086536569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d4260 msgr2=0x7fcc700d4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 --2- 172.21.15.81:0/1086536569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d4260 0x7fcc700d4670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc7008d3a0 tx=0x7fcc6802aac0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 -- 172.21.15.81:0/1086536569 shutdown_connections 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 --2- 172.21.15.81:0/1086536569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d4260 0x7fcc700d4670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 --2- 172.21.15.81:0/1086536569 >> v2:172.21.15.89:3300/0 conn(0x7fcc700d2500 0x7fcc7015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 -- 172.21.15.81:0/1086536569 >> 172.21.15.81:0/1086536569 conn(0x7fcc700b9290 msgr2=0x7fcc700b96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 -- 172.21.15.81:0/1086536569 shutdown_connections 2024-09-21T06:45:09.126 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.123+0000 7fcc75913640 1 -- 172.21.15.81:0/1086536569 wait complete. 2024-09-21T06:45:09.127 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.125+0000 7fcc75913640 1 Processor -- start 2024-09-21T06:45:09.127 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.125+0000 7fcc75913640 1 -- start start 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.126+0000 7fcc75913640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc700d2500 0x7fcc701f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.126+0000 7fcc75913640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d3410 0x7fcc701f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.126+0000 7fcc75913640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc700d4260 0x7fcc701f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.126+0000 7fcc75913640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc700b13d0 con 0x7fcc700d3410 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.126+0000 7fcc75913640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcc700b1250 con 0x7fcc700d2500 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.126+0000 7fcc75913640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fcc700b1550 con 0x7fcc700d4260 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d3410 0x7fcc701f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d3410 0x7fcc701f88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47944/0 (socket says 172.21.15.81:47944) 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 -- 172.21.15.81:0/3688209636 learned_addr learned my addr 172.21.15.81:0/3688209636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc6effd640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc700d2500 0x7fcc701f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.130 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc6f7fe640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc700d4260 0x7fcc701f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 -- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc700d4260 msgr2=0x7fcc701f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc700d4260 0x7fcc701f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 -- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc700d2500 msgr2=0x7fcc701f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc700d2500 0x7fcc701f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 -- 172.21.15.81:0/3688209636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7015fe60 con 0x7fcc700d3410 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc6f7fe640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc700d4260 0x7fcc701f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc67fff640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d3410 0x7fcc701f88a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c3a0 tx=0x7fcc5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc6cff9640 1 -- 172.21.15.81:0/3688209636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58017070 con 0x7fcc700d3410 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc6cff9640 1 -- 172.21.15.81:0/3688209636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc580053c0 con 0x7fcc700d3410 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc70160140 con 0x7fcc700d3410 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc6cff9640 1 -- 172.21.15.81:0/3688209636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58003850 con 0x7fcc700d3410 2024-09-21T06:45:09.131 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.127+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc70160700 con 0x7fcc700d3410 2024-09-21T06:45:09.132 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.128+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc701f96b0 con 0x7fcc700d3410 2024-09-21T06:45:09.132 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.129+0000 7fcc6cff9640 1 -- 172.21.15.81:0/3688209636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc5801a070 con 0x7fcc700d3410 2024-09-21T06:45:09.132 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.130+0000 7fcc6cff9640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc50078b90 0x7fcc5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.133 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.130+0000 7fcc6cff9640 1 -- 172.21.15.81:0/3688209636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fcc58099c50 con 0x7fcc700d3410 2024-09-21T06:45:09.133 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.130+0000 7fcc6effd640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc50078b90 0x7fcc5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.133 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.131+0000 7fcc6effd640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc50078b90 0x7fcc5007b0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bb50 tx=0x7fcc6000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.138 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.135+0000 7fcc6cff9640 1 -- 172.21.15.81:0/3688209636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc5809f020 con 0x7fcc700d3410 2024-09-21T06:45:09.317 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.315+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc700b1a70 con 0x7fcc700d3410 2024-09-21T06:45:09.317 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.315+0000 7fcc6cff9640 1 -- 172.21.15.81:0/3688209636 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12860 (secure 0 0 0) 0x7fcc58061e20 con 0x7fcc700d3410 2024-09-21T06:45:09.318 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-21T06:45:09.318 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":18,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:06.736039+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc50078b90 msgr2=0x7fcc5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc50078b90 0x7fcc5007b0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bb50 tx=0x7fcc6000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d3410 msgr2=0x7fcc701f88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d3410 0x7fcc701f88a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c3a0 tx=0x7fcc5800c860 comp rx=0 tx=0).stop 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 shutdown_connections 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc50078b90 0x7fcc5007b0a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc700d4260 0x7fcc701f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc700d3410 0x7fcc701f88a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 --2- 172.21.15.81:0/3688209636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc700d2500 0x7fcc701f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 >> 172.21.15.81:0/3688209636 conn(0x7fcc700b9290 msgr2=0x7fcc700d14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 shutdown_connections 2024-09-21T06:45:09.321 INFO:teuthology.misc.health.smithi081.stderr:2024-09-21T06:45:09.318+0000 7fcc75913640 1 -- 172.21.15.81:0/3688209636 wait complete. 2024-09-21T06:45:09.330 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T06:45:09.330 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T06:45:09.330 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:45:09.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:45:09.333 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:45:09.333 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:45:09.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:45:09.335 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:45:09.335 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:45:09.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:45:09.338 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:45:09.338 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:45:09.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:45:09.340 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:45:09.341 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T06:45:09.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:09.417 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-21T06:45:09.418 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-21T06:45:09.418 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-21T06:45:09.417+0000 7f341af82640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2024-09-21T06:45:09.434 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2024-09-21T06:45:09.436 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2024-09-21T06:45:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 -- 172.21.15.81:0/2414085401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 msgr2=0x7f17900adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 --2- 172.21.15.81:0/2414085401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 0x7f17900adf30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1780005fd0 tx=0x7f178002a540 comp rx=0 tx=0).stop 2024-09-21T06:45:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 -- 172.21.15.81:0/2414085401 shutdown_connections 2024-09-21T06:45:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 --2- 172.21.15.81:0/2414085401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 0x7f17900adf30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 --2- 172.21.15.81:0/2414085401 >> v2:172.21.15.89:3300/0 conn(0x7f179006f280 0x7f179015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 -- 172.21.15.81:0/2414085401 >> 172.21.15.81:0/2414085401 conn(0x7f17900d1150 msgr2=0x7f17900d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 -- 172.21.15.81:0/2414085401 shutdown_connections 2024-09-21T06:45:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.458+0000 7f1797be6640 1 -- 172.21.15.81:0/2414085401 wait complete. 2024-09-21T06:45:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.460+0000 7f1797be6640 1 Processor -- start 2024-09-21T06:45:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.460+0000 7f1797be6640 1 -- start start 2024-09-21T06:45:09.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1797be6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006f280 0x7f1790150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1797be6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900ae470 0x7f179009cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1797be6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 0x7f179009b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1797be6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17900b5d10 con 0x7f179006f280 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1797be6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f17900b5b90 con 0x7f17900ae470 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1797be6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f179006cd90 con 0x7f1790155a20 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1795982640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006f280 0x7f1790150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1795982640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006f280 0x7f1790150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47978/0 (socket says 172.21.15.81:47978) 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.461+0000 7f1795982640 1 -- 172.21.15.81:0/4117311225 learned_addr learned my addr 172.21.15.81:0/4117311225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1795181640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900ae470 0x7f179009cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1796183640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 0x7f179009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1795982640 1 -- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 msgr2=0x7f179009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1795982640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 0x7f179009b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1795982640 1 -- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900ae470 msgr2=0x7f179009cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1795982640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900ae470 0x7f179009cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1795982640 1 -- 172.21.15.81:0/4117311225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179009d130 con 0x7f179006f280 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1795982640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006f280 0x7f1790150bd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f178c009fd0 tx=0x7f178c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f17867fc640 1 -- 172.21.15.81:0/4117311225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c00ccc0 con 0x7f179006f280 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f17867fc640 1 -- 172.21.15.81:0/4117311225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f178c00ee70 con 0x7f179006f280 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1790156bd0 con 0x7f179006f280 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f17867fc640 1 -- 172.21.15.81:0/4117311225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c00ce60 con 0x7f179006f280 2024-09-21T06:45:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.462+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179015afb0 con 0x7f179006f280 2024-09-21T06:45:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.464+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179015b670 con 0x7f179006f280 2024-09-21T06:45:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.464+0000 7f17867fc640 1 -- 172.21.15.81:0/4117311225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f178c004280 con 0x7f179006f280 2024-09-21T06:45:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.465+0000 7f17867fc640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.465+0000 7f17867fc640 1 -- 172.21.15.81:0/4117311225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f178c09b230 con 0x7f179006f280 2024-09-21T06:45:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.465+0000 7f1795181640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.465+0000 7f1795181640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1780033000 tx=0x7f1780004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.469+0000 7f17867fc640 1 -- 172.21.15.81:0/4117311225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f179015b670 con 0x7f179006f280 2024-09-21T06:45:09.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.680+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1790075b80 con 0x7f179006f280 2024-09-21T06:45:09.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.680+0000 7f17867fc640 1 -- 172.21.15.81:0/4117311225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f1790075b80 con 0x7f179006f280 2024-09-21T06:45:09.683 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:09.683 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"btime":"2024-09-21T06:45:09:422073+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:45:09.683 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 msgr2=0x7f177407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1780033000 tx=0x7f1780004730 comp rx=0 tx=0).stop 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006f280 msgr2=0x7f1790150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006f280 0x7f1790150bd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f178c009fd0 tx=0x7f178c00ec20 comp rx=0 tx=0).stop 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 shutdown_connections 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1790155a20 0x7f179009b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900ae470 0x7f179009cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 --2- 172.21.15.81:0/4117311225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006f280 0x7f1790150bd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 >> 172.21.15.81:0/4117311225 conn(0x7f17900d1150 msgr2=0x7f1790071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 shutdown_connections 2024-09-21T06:45:09.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:09.682+0000 7f1797be6640 1 -- 172.21.15.81:0/4117311225 wait complete. 2024-09-21T06:45:11.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 -- 172.21.15.81:0/1786894232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f564415d2c0 msgr2=0x7f564415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 --2- 172.21.15.81:0/1786894232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f564415d2c0 0x7f564415d6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f563c009ca0 tx=0x7f563c02aac0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 -- 172.21.15.81:0/1786894232 shutdown_connections 2024-09-21T06:45:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 --2- 172.21.15.81:0/1786894232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f564415d2c0 0x7f564415d6d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 --2- 172.21.15.81:0/1786894232 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56440d19a0 0x7f564415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 -- 172.21.15.81:0/1786894232 >> 172.21.15.81:0/1786894232 conn(0x7f56440d25e0 msgr2=0x7f56440d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 -- 172.21.15.81:0/1786894232 shutdown_connections 2024-09-21T06:45:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.819+0000 7f56490ec640 1 -- 172.21.15.81:0/1786894232 wait complete. 2024-09-21T06:45:11.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.821+0000 7f56490ec640 1 Processor -- start 2024-09-21T06:45:11.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.821+0000 7f56490ec640 1 -- start start 2024-09-21T06:45:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f56490ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56440d19a0 0x7f56441f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f56490ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564415d2c0 0x7f56441f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f56490ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441601c0 0x7f5644071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f56490ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56440730d0 con 0x7f56441601c0 2024-09-21T06:45:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f56490ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5644072f50 con 0x7f564415d2c0 2024-09-21T06:45:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f56490ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f5644073250 con 0x7f56440d19a0 2024-09-21T06:45:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441601c0 0x7f5644071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441601c0 0x7f5644071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47992/0 (socket says 172.21.15.81:47992) 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 -- 172.21.15.81:0/2931689968 learned_addr learned my addr 172.21.15.81:0/2931689968 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f5642d9d640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56440d19a0 0x7f56441f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564259c640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564415d2c0 0x7f56441f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 -- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56440d19a0 msgr2=0x7f56441f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56440d19a0 0x7f56441f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 -- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564415d2c0 msgr2=0x7f56441f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564415d2c0 0x7f56441f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 -- 172.21.15.81:0/2931689968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56441595d0 con 0x7f56441601c0 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f5642d9d640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56440d19a0 0x7f56441f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f564359e640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441601c0 0x7f5644071100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f563c009ca0 tx=0x7f563c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f562b7fe640 1 -- 172.21.15.81:0/2931689968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c044070 con 0x7f56441601c0 2024-09-21T06:45:11.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f562b7fe640 1 -- 172.21.15.81:0/2931689968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f563c003e50 con 0x7f56441601c0 2024-09-21T06:45:11.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f562b7fe640 1 -- 172.21.15.81:0/2931689968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c004490 con 0x7f56441601c0 2024-09-21T06:45:11.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.823+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56441f3ef0 con 0x7f56441601c0 2024-09-21T06:45:11.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.824+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56440cb070 con 0x7f56441601c0 2024-09-21T06:45:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.824+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564415a290 con 0x7f56441601c0 2024-09-21T06:45:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.825+0000 7f562b7fe640 1 -- 172.21.15.81:0/2931689968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f563c047070 con 0x7f56441601c0 2024-09-21T06:45:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.826+0000 7f562b7fe640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5630078b90 0x7f563007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.826+0000 7f562b7fe640 1 -- 172.21.15.81:0/2931689968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f563c0bb850 con 0x7f56441601c0 2024-09-21T06:45:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.826+0000 7f5642d9d640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5630078b90 0x7f563007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.827+0000 7f5642d9d640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5630078b90 0x7f563007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5634009b80 tx=0x7f5634005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:11.831+0000 7f562b7fe640 1 -- 172.21.15.81:0/2931689968 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f56441595d0 con 0x7f56441601c0 2024-09-21T06:45:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.043+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56441f0c80 con 0x7f56441601c0 2024-09-21T06:45:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.043+0000 7f562b7fe640 1 -- 172.21.15.81:0/2931689968 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3900 (secure 0 0 0) 0x7f563c032030 con 0x7f56441601c0 2024-09-21T06:45:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:12.046 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"btime":"2024-09-21T06:45:10:423276+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:45:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-09-21T06:45:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5630078b90 msgr2=0x7f563007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5630078b90 0x7f563007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5634009b80 tx=0x7f5634005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441601c0 msgr2=0x7f5644071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441601c0 0x7f5644071100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f563c009ca0 tx=0x7f563c003ce0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 shutdown_connections 2024-09-21T06:45:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5630078b90 0x7f563007b0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56441601c0 0x7f5644071100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564415d2c0 0x7f56441f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 --2- 172.21.15.81:0/2931689968 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56440d19a0 0x7f56441f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 >> 172.21.15.81:0/2931689968 conn(0x7f56440d25e0 msgr2=0x7f564415be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 shutdown_connections 2024-09-21T06:45:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.046+0000 7f56490ec640 1 -- 172.21.15.81:0/2931689968 wait complete. 2024-09-21T06:45:12.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:45:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.169+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/785713437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 msgr2=0x7f3da4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.169+0000 7f3dbf4cc640 1 --2- 172.21.15.81:0/785713437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 0x7f3da4004800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009b50 tx=0x7f3da4005830 comp rx=0 tx=0).stop 2024-09-21T06:45:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.169+0000 7f3dbda69640 1 -- 172.21.15.81:0/785713437 reap_dead start 2024-09-21T06:45:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.169+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/785713437 shutdown_connections 2024-09-21T06:45:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.169+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/785713437 >> 172.21.15.81:0/785713437 conn(0x7f3db80b7330 msgr2=0x7f3db80b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.169+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/785713437 shutdown_connections 2024-09-21T06:45:12.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.169+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/785713437 wait complete. 2024-09-21T06:45:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.171+0000 7f3dbf4cc640 1 Processor -- start 2024-09-21T06:45:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.171+0000 7f3dbf4cc640 1 -- start start 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbf4cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 0x7f3db80b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbf4cc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3db8157990 0x7f3db815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbf4cc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3db815e260 0x7f3db81f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbf4cc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3db80b9a50 con 0x7f3da4003fd0 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbf4cc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3db80b98d0 con 0x7f3db815e260 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbf4cc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3db80d4ac0 con 0x7f3db8157990 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbd268640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 0x7f3db80b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbd268640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 0x7f3db80b6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48006/0 (socket says 172.21.15.81:48006) 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.172+0000 7f3dbd268640 1 -- 172.21.15.81:0/3115002295 learned_addr learned my addr 172.21.15.81:0/3115002295 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbda69640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3db815e260 0x7f3db81f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbca67640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3db8157990 0x7f3db815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbd268640 1 -- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3db8157990 msgr2=0x7f3db815dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbd268640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3db8157990 0x7f3db815dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbd268640 1 -- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3db815e260 msgr2=0x7f3db81f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbd268640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3db815e260 0x7f3db81f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbd268640 1 -- 172.21.15.81:0/3115002295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db81f5400 con 0x7f3da4003fd0 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbd268640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 0x7f3db80b6680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3db400f7f0 tx=0x7f3db400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dadffb640 1 -- 172.21.15.81:0/3115002295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db400bc30 con 0x7f3da4003fd0 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dadffb640 1 -- 172.21.15.81:0/3115002295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3db4011440 con 0x7f3da4003fd0 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db81f56e0 con 0x7f3da4003fd0 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dadffb640 1 -- 172.21.15.81:0/3115002295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4011870 con 0x7f3da4003fd0 2024-09-21T06:45:12.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.173+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db81f5ca0 con 0x7f3da4003fd0 2024-09-21T06:45:12.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.174+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db808d110 con 0x7f3da4003fd0 2024-09-21T06:45:12.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.175+0000 7f3dadffb640 1 -- 172.21.15.81:0/3115002295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3db4019020 con 0x7f3da4003fd0 2024-09-21T06:45:12.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.176+0000 7f3dadffb640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.176+0000 7f3dadffb640 1 -- 172.21.15.81:0/3115002295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f3db409b250 con 0x7f3da4003fd0 2024-09-21T06:45:12.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.176+0000 7f3dbca67640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.176+0000 7f3dbca67640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3da8035000 tx=0x7f3da80046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.180+0000 7f3dadffb640 1 -- 172.21.15.81:0/3115002295 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3db808d110 con 0x7f3da4003fd0 2024-09-21T06:45:12.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.358+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3db80d3220 con 0x7f3da4003fd0 2024-09-21T06:45:12.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.359+0000 7f3dadffb640 1 -- 172.21.15.81:0/3115002295 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f3db4063420 con 0x7f3da4003fd0 2024-09-21T06:45:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:12.361 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-21T06:45:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-21T06:45:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-21T06:45:12.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:12.362 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-21T06:45:12.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d9c078b90 msgr2=0x7f3d9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3da8035000 tx=0x7f3da80046c0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 msgr2=0x7f3db80b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 0x7f3db80b6680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3db400f7f0 tx=0x7f3db400fcb0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 shutdown_connections 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d9c078b90 0x7f3d9c07b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3db8157990 0x7f3db815dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3db815e260 0x7f3db81f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 --2- 172.21.15.81:0/3115002295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da4003fd0 0x7f3db80b6680 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 >> 172.21.15.81:0/3115002295 conn(0x7f3db80b7330 msgr2=0x7f3db815a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 shutdown_connections 2024-09-21T06:45:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.361+0000 7f3dbf4cc640 1 -- 172.21.15.81:0/3115002295 wait complete. 2024-09-21T06:45:12.375 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:45:12.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:45:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.489+0000 7f409d9ad640 1 -- 172.21.15.81:0/1987044619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 msgr2=0x7f40980d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.489+0000 7f409d9ad640 1 --2- 172.21.15.81:0/1987044619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 0x7f40980d4780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4080009850 tx=0x7f408002a5a0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.489+0000 7f409d9ad640 1 -- 172.21.15.81:0/1987044619 shutdown_connections 2024-09-21T06:45:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.489+0000 7f409d9ad640 1 --2- 172.21.15.81:0/1987044619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 0x7f40980d4780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.489+0000 7f409d9ad640 1 -- 172.21.15.81:0/1987044619 >> 172.21.15.81:0/1987044619 conn(0x7f40980b7330 msgr2=0x7f40980b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.490+0000 7f409d9ad640 1 -- 172.21.15.81:0/1987044619 shutdown_connections 2024-09-21T06:45:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.490+0000 7f409d9ad640 1 -- 172.21.15.81:0/1987044619 wait complete. 2024-09-21T06:45:12.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.491+0000 7f409d9ad640 1 Processor -- start 2024-09-21T06:45:12.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.491+0000 7f409d9ad640 1 -- start start 2024-09-21T06:45:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f409d9ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40980cf130 0x7f40980b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f409d9ad640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 0x7f40981f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f409d9ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f409815e800 0x7f40981f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f409d9ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40980cffe0 con 0x7f409815e800 2024-09-21T06:45:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f409d9ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f40980cfe60 con 0x7f40980cf130 2024-09-21T06:45:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f409d9ad640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f40980d0160 con 0x7f40980d4370 2024-09-21T06:45:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f409815e800 0x7f40981f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f409815e800 0x7f40981f92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48016/0 (socket says 172.21.15.81:48016) 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 -- 172.21.15.81:0/2606641126 learned_addr learned my addr 172.21.15.81:0/2606641126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f408e7fc640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 0x7f40981f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f4096ffd640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40980cf130 0x7f40980b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 -- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 msgr2=0x7f40981f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 0x7f40981f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 -- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40980cf130 msgr2=0x7f40980b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40980cf130 0x7f40980b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 -- 172.21.15.81:0/2606641126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40981f9be0 con 0x7f409815e800 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f4096ffd640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40980cf130 0x7f40980b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f40977fe640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f409815e800 0x7f40981f92a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f409000cc50 tx=0x7f409000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.493+0000 7f4094ff9640 1 -- 172.21.15.81:0/2606641126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090016020 con 0x7f409815e800 2024-09-21T06:45:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.494+0000 7f4094ff9640 1 -- 172.21.15.81:0/2606641126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4090012420 con 0x7f409815e800 2024-09-21T06:45:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.494+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40980b5b10 con 0x7f409815e800 2024-09-21T06:45:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.494+0000 7f4094ff9640 1 -- 172.21.15.81:0/2606641126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409000ce60 con 0x7f409815e800 2024-09-21T06:45:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.494+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40980b60d0 con 0x7f409815e800 2024-09-21T06:45:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.494+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40980d4780 con 0x7f409815e800 2024-09-21T06:45:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.495+0000 7f4094ff9640 1 -- 172.21.15.81:0/2606641126 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4090019020 con 0x7f409815e800 2024-09-21T06:45:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.496+0000 7f4094ff9640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4078078b90 0x7f407807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.496+0000 7f4094ff9640 1 -- 172.21.15.81:0/2606641126 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f409009aeb0 con 0x7f409815e800 2024-09-21T06:45:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.496+0000 7f4096ffd640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4078078b90 0x7f407807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.496+0000 7f4096ffd640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4078078b90 0x7f407807b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4088001120 tx=0x7f4088009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.500+0000 7f4094ff9640 1 -- 172.21.15.81:0/2606641126 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4090020030 con 0x7f409815e800 2024-09-21T06:45:12.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:12.676+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f40980cf7e0 con 0x7f409815e800 2024-09-21T06:45:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.435+0000 7f4094ff9640 1 -- 172.21.15.81:0/2606641126 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f40980d4cc0 con 0x7f409815e800 2024-09-21T06:45:13.437 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4078078b90 msgr2=0x7f407807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4078078b90 0x7f407807b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4088001120 tx=0x7f4088009040 comp rx=0 tx=0).stop 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f409815e800 msgr2=0x7f40981f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f409815e800 0x7f40981f92a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f409000cc50 tx=0x7f409000a430 comp rx=0 tx=0).stop 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 shutdown_connections 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4078078b90 0x7f407807b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40980d4370 0x7f40981f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f409815e800 0x7f40981f92a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 --2- 172.21.15.81:0/2606641126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40980cf130 0x7f40980b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.437+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 >> 172.21.15.81:0/2606641126 conn(0x7f40980b7330 msgr2=0x7f40980b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.438+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 shutdown_connections 2024-09-21T06:45:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.438+0000 7f409d9ad640 1 -- 172.21.15.81:0/2606641126 wait complete. 2024-09-21T06:45:13.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T06:45:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.578+0000 7f0aaea4a640 1 -- 172.21.15.81:0/2243067196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90004800 msgr2=0x7f0a90004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.578+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/2243067196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90004800 0x7f0a90004c10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c001690 tx=0x7f0a90005830 comp rx=0 tx=0).stop 2024-09-21T06:45:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.578+0000 7f0aaea4a640 1 -- 172.21.15.81:0/2243067196 shutdown_connections 2024-09-21T06:45:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.578+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/2243067196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90004800 0x7f0a90004c10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.578+0000 7f0aaea4a640 1 -- 172.21.15.81:0/2243067196 >> 172.21.15.81:0/2243067196 conn(0x7f0aa80b7330 msgr2=0x7f0aa80b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.578+0000 7f0aaea4a640 1 -- 172.21.15.81:0/2243067196 shutdown_connections 2024-09-21T06:45:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.578+0000 7f0aaea4a640 1 -- 172.21.15.81:0/2243067196 wait complete. 2024-09-21T06:45:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.580+0000 7f0aaea4a640 1 Processor -- start 2024-09-21T06:45:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.580+0000 7f0aaea4a640 1 -- start start 2024-09-21T06:45:13.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a90004800 0x7f0aa81f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:13.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aa806d850 0x7f0aa806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:13.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa806e190 0x7f0aa806e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:13.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa815ef20 con 0x7f0aa806d850 2024-09-21T06:45:13.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa815eda0 con 0x7f0aa806e190 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa815f0a0 con 0x7f0a90004800 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aa806d850 0x7f0aa806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aa806d850 0x7f0aa806f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48026/0 (socket says 172.21.15.81:48026) 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 -- 172.21.15.81:0/3828182788 learned_addr learned my addr 172.21.15.81:0/3828182788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa7fff640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a90004800 0x7f0aa81f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aacfe7640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa806e190 0x7f0aa806e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 -- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a90004800 msgr2=0x7f0aa81f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a90004800 0x7f0aa81f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 -- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa806e190 msgr2=0x7f0aa806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa806e190 0x7f0aa806e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 -- 172.21.15.81:0/3828182788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa806cd90 con 0x7f0aa806d850 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa77fe640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aa806d850 0x7f0aa806f4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c02a8d0 tx=0x7f0a9c0063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa4ff9640 1 -- 172.21.15.81:0/3828182788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c003a00 con 0x7f0aa806d850 2024-09-21T06:45:13.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa4ff9640 1 -- 172.21.15.81:0/3828182788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a9c039070 con 0x7f0aa806d850 2024-09-21T06:45:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa80b5080 con 0x7f0aa806d850 2024-09-21T06:45:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aa4ff9640 1 -- 172.21.15.81:0/3828182788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c033420 con 0x7f0aa806d850 2024-09-21T06:45:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.582+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa806d050 con 0x7f0aa806d850 2024-09-21T06:45:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.583+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa808d110 con 0x7f0aa806d850 2024-09-21T06:45:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.584+0000 7f0aa4ff9640 1 -- 172.21.15.81:0/3828182788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a9c044020 con 0x7f0aa806d850 2024-09-21T06:45:13.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.585+0000 7f0aa4ff9640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0a94078b90 0x7f0a9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.585+0000 7f0aa4ff9640 1 -- 172.21.15.81:0/3828182788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f0a9c0ba3a0 con 0x7f0aa806d850 2024-09-21T06:45:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.585+0000 7f0aa7fff640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0a94078b90 0x7f0a9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:13.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.585+0000 7f0aa7fff640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0a94078b90 0x7f0a9407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a98001050 tx=0x7f0a980067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.589+0000 7f0aa4ff9640 1 -- 172.21.15.81:0/3828182788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0aa808d110 con 0x7f0aa806d850 2024-09-21T06:45:13.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:13.766+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f0aa80b4e10 con 0x7f0aa806d850 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.443+0000 7f0aa4ff9640 1 -- 172.21.15.81:0/3828182788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f0a9c082400 con 0x7f0aa806d850 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0a94078b90 msgr2=0x7f0a9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0a94078b90 0x7f0a9407b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a98001050 tx=0x7f0a980067a0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aa806d850 msgr2=0x7f0aa806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aa806d850 0x7f0aa806f4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c02a8d0 tx=0x7f0a9c0063a0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 shutdown_connections 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0a94078b90 0x7f0a9407b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0aa806e190 0x7f0aa806e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aa806d850 0x7f0aa806f4d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 --2- 172.21.15.81:0/3828182788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a90004800 0x7f0aa81f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 >> 172.21.15.81:0/3828182788 conn(0x7f0aa80b7330 msgr2=0x7f0aa80d0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 shutdown_connections 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.445+0000 7f0aaea4a640 1 -- 172.21.15.81:0/3828182788 wait complete. 2024-09-21T06:45:14.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:45:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.582+0000 7fa046569640 1 -- 172.21.15.81:0/306201576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 msgr2=0x7fa02800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.582+0000 7fa046569640 1 --2- 172.21.15.81:0/306201576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa02800b9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c610 tx=0x7fa028005830 comp rx=0 tx=0).stop 2024-09-21T06:45:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.582+0000 7fa046569640 1 -- 172.21.15.81:0/306201576 shutdown_connections 2024-09-21T06:45:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.582+0000 7fa046569640 1 --2- 172.21.15.81:0/306201576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa02800b9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.582+0000 7fa046569640 1 -- 172.21.15.81:0/306201576 >> 172.21.15.81:0/306201576 conn(0x7fa0400d25e0 msgr2=0x7fa0400d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.582+0000 7fa046569640 1 -- 172.21.15.81:0/306201576 shutdown_connections 2024-09-21T06:45:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.582+0000 7fa046569640 1 -- 172.21.15.81:0/306201576 wait complete. 2024-09-21T06:45:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.584+0000 7fa046569640 1 Processor -- start 2024-09-21T06:45:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.584+0000 7fa046569640 1 -- start start 2024-09-21T06:45:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa0400b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa04014d680 0x7fa0401f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa04014da90 0x7fa0401f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0401601c0 con 0x7fa028005350 2024-09-21T06:45:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa04015dbb0 con 0x7fa04014da90 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa040160340 con 0x7fa04014d680 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa0400b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa0400b7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48044/0 (socket says 172.21.15.81:48044) 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 -- 172.21.15.81:0/4153348768 learned_addr learned my addr 172.21.15.81:0/4153348768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa044b06640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa04014da90 0x7fa0401f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03f7fe640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa04014d680 0x7fa0401f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 -- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa04014d680 msgr2=0x7fa0401f6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa04014d680 0x7fa0401f6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 -- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa04014da90 msgr2=0x7fa0401f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa04014da90 0x7fa0401f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 -- 172.21.15.81:0/4153348768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0401521e0 con 0x7fa028005350 2024-09-21T06:45:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03ffff640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa0400b7d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa030003f00 tx=0x7fa030001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03cff9640 1 -- 172.21.15.81:0/4153348768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030015070 con 0x7fa028005350 2024-09-21T06:45:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03cff9640 1 -- 172.21.15.81:0/4153348768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa030011840 con 0x7fa028005350 2024-09-21T06:45:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0400b6a50 con 0x7fa028005350 2024-09-21T06:45:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa03cff9640 1 -- 172.21.15.81:0/4153348768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa030011c70 con 0x7fa028005350 2024-09-21T06:45:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.586+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0400b51d0 con 0x7fa028005350 2024-09-21T06:45:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.587+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04014df30 con 0x7fa028005350 2024-09-21T06:45:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.588+0000 7fa03cff9640 1 -- 172.21.15.81:0/4153348768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa030018070 con 0x7fa028005350 2024-09-21T06:45:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.589+0000 7fa03cff9640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa02c078b90 0x7fa02c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.589+0000 7fa03cff9640 1 -- 172.21.15.81:0/4153348768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fa03009b770 con 0x7fa028005350 2024-09-21T06:45:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.589+0000 7fa03f7fe640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa02c078b90 0x7fa02c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.590+0000 7fa03f7fe640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa02c078b90 0x7fa02c07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0400511a0 tx=0x7fa034005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.594+0000 7fa03cff9640 1 -- 172.21.15.81:0/4153348768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa030063650 con 0x7fa028005350 2024-09-21T06:45:14.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:14.808+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa0400b1be0 con 0x7fa028005350 2024-09-21T06:45:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.461+0000 7fa03cff9640 1 -- 172.21.15.81:0/4153348768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa030068080 con 0x7fa028005350 2024-09-21T06:45:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T06:45:15.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.468+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa02c078b90 msgr2=0x7fa02c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.468+0000 7fa046569640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa02c078b90 0x7fa02c07b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0400511a0 tx=0x7fa034005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.468+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 msgr2=0x7fa0400b7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.468+0000 7fa046569640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa0400b7d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa030003f00 tx=0x7fa030001630 comp rx=0 tx=0).stop 2024-09-21T06:45:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.469+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 shutdown_connections 2024-09-21T06:45:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.469+0000 7fa046569640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa02c078b90 0x7fa02c07b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.469+0000 7fa046569640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa04014d680 0x7fa0401f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.469+0000 7fa046569640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa04014da90 0x7fa0401f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.469+0000 7fa046569640 1 --2- 172.21.15.81:0/4153348768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa028005350 0x7fa0400b7d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.469+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 >> 172.21.15.81:0/4153348768 conn(0x7fa0400d25e0 msgr2=0x7fa04015b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:15.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.473+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 shutdown_connections 2024-09-21T06:45:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.474+0000 7fa046569640 1 -- 172.21.15.81:0/4153348768 wait complete. 2024-09-21T06:45:15.493 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T06:45:15.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 -- 172.21.15.81:0/3801432816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00cf760 msgr2=0x7f21e00d1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 --2- 172.21.15.81:0/3801432816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00cf760 0x7f21e00d1c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f21e0074a80 tx=0x7f21d802aa30 comp rx=0 tx=0).stop 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 -- 172.21.15.81:0/3801432816 shutdown_connections 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 --2- 172.21.15.81:0/3801432816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00cf760 0x7f21e00d1c90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 --2- 172.21.15.81:0/3801432816 >> v2:172.21.15.89:3300/0 conn(0x7f21e00b1bc0 0x7f21e00ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 -- 172.21.15.81:0/3801432816 >> 172.21.15.81:0/3801432816 conn(0x7f21e00b3f60 msgr2=0x7f21e00b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 -- 172.21.15.81:0/3801432816 shutdown_connections 2024-09-21T06:45:15.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.607+0000 7f21e7f50640 1 -- 172.21.15.81:0/3801432816 wait complete. 2024-09-21T06:45:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.609+0000 7f21e7f50640 1 Processor -- start 2024-09-21T06:45:15.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.609+0000 7f21e7f50640 1 -- start start 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e7f50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00b1bc0 0x7f21e00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e7f50640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21e00d1880 0x7f21e01f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e7f50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21e00cab40 0x7f21e01f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e7f50640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21e015cf80 con 0x7f21e00b1bc0 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e7f50640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f21e015ce00 con 0x7f21e00cab40 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e7f50640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f21e015d100 con 0x7f21e00d1880 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e5cec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00b1bc0 0x7f21e00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e5cec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00b1bc0 0x7f21e00c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48072/0 (socket says 172.21.15.81:48072) 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e5cec640 1 -- 172.21.15.81:0/1388922230 learned_addr learned my addr 172.21.15.81:0/1388922230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:15.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e64ed640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21e00cab40 0x7f21e01f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.610+0000 7f21e54eb640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21e00d1880 0x7f21e01f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e5cec640 1 -- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21e00d1880 msgr2=0x7f21e01f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e5cec640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21e00d1880 0x7f21e01f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e5cec640 1 -- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21e00cab40 msgr2=0x7f21e01f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e5cec640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21e00cab40 0x7f21e01f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e5cec640 1 -- 172.21.15.81:0/1388922230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e00cb320 con 0x7f21e00b1bc0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e54eb640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21e00d1880 0x7f21e01f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e5cec640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00b1bc0 0x7f21e00c89f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00d740 tx=0x7f21dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21d67fc640 1 -- 172.21.15.81:0/1388922230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc017070 con 0x7f21e00b1bc0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21d67fc640 1 -- 172.21.15.81:0/1388922230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21dc009d20 con 0x7f21e00b1bc0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e00cb600 con 0x7f21e00b1bc0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21d67fc640 1 -- 172.21.15.81:0/1388922230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0106c0 con 0x7f21e00b1bc0 2024-09-21T06:45:15.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.611+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e0146750 con 0x7f21e00b1bc0 2024-09-21T06:45:15.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.612+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e0146540 con 0x7f21e00b1bc0 2024-09-21T06:45:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.613+0000 7f21d67fc640 1 -- 172.21.15.81:0/1388922230 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21dc01a070 con 0x7f21e00b1bc0 2024-09-21T06:45:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.613+0000 7f21d67fc640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f21c4078b90 0x7f21c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.613+0000 7f21d67fc640 1 -- 172.21.15.81:0/1388922230 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f21dc09add0 con 0x7f21e00b1bc0 2024-09-21T06:45:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.614+0000 7f21e54eb640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f21c4078b90 0x7f21c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:15.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.614+0000 7f21e54eb640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f21c4078b90 0x7f21c407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21e0146410 tx=0x7f21d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:15.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.618+0000 7f21d67fc640 1 -- 172.21.15.81:0/1388922230 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21dc062c50 con 0x7f21e00b1bc0 2024-09-21T06:45:15.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:15.802+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f21e015d620 con 0x7f21e00b1bc0 2024-09-21T06:45:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.448+0000 7f21d67fc640 1 -- 172.21.15.81:0/1388922230 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f21dc067680 con 0x7f21e00b1bc0 2024-09-21T06:45:16.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f21c4078b90 msgr2=0x7f21c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f21c4078b90 0x7f21c407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21e0146410 tx=0x7f21d0009040 comp rx=0 tx=0).stop 2024-09-21T06:45:16.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00b1bc0 msgr2=0x7f21e00c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00b1bc0 0x7f21e00c89f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00d740 tx=0x7f21dc00dc00 comp rx=0 tx=0).stop 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 shutdown_connections 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f21c4078b90 0x7f21c407b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21e00d1880 0x7f21e01f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21e00cab40 0x7f21e01f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 --2- 172.21.15.81:0/1388922230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21e00b1bc0 0x7f21e00c89f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 >> 172.21.15.81:0/1388922230 conn(0x7f21e00b3f60 msgr2=0x7f21e0071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 shutdown_connections 2024-09-21T06:45:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.451+0000 7f21e7f50640 1 -- 172.21.15.81:0/1388922230 wait complete. 2024-09-21T06:45:16.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:45:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.610+0000 7f28eef39640 1 -- 172.21.15.81:0/639898444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e806f5a0 msgr2=0x7f28e80cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.610+0000 7f28eef39640 1 --2- 172.21.15.81:0/639898444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e806f5a0 0x7f28e80cc7c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f28e80b6e10 tx=0x7f28e402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.610+0000 7f28eef39640 1 -- 172.21.15.81:0/639898444 shutdown_connections 2024-09-21T06:45:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.610+0000 7f28eef39640 1 --2- 172.21.15.81:0/639898444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e806f5a0 0x7f28e80cc7c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.610+0000 7f28eef39640 1 -- 172.21.15.81:0/639898444 >> 172.21.15.81:0/639898444 conn(0x7f28e809aa30 msgr2=0x7f28e80b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.610+0000 7f28eef39640 1 -- 172.21.15.81:0/639898444 shutdown_connections 2024-09-21T06:45:16.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.610+0000 7f28eef39640 1 -- 172.21.15.81:0/639898444 wait complete. 2024-09-21T06:45:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.612+0000 7f28eef39640 1 Processor -- start 2024-09-21T06:45:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.612+0000 7f28eef39640 1 -- start start 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28eef39640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e806f5a0 0x7f28e80c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28eef39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e80cd990 0x7f28e81f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28eef39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e80cece0 0x7f28e8156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28eef39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80cd580 con 0x7f28e80cece0 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28eef39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80ce6c0 con 0x7f28e80cd990 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28eef39640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f28e8166e30 con 0x7f28e806f5a0 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28ed4d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e80cece0 0x7f28e8156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28ed4d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e80cece0 0x7f28e8156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48100/0 (socket says 172.21.15.81:48100) 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.613+0000 7f28ed4d6640 1 -- 172.21.15.81:0/2995025019 learned_addr learned my addr 172.21.15.81:0/2995025019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28eccd5640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e806f5a0 0x7f28e80c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28dffff640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e80cd990 0x7f28e81f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28ed4d6640 1 -- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e806f5a0 msgr2=0x7f28e80c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28ed4d6640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e806f5a0 0x7f28e80c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28ed4d6640 1 -- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e80cd990 msgr2=0x7f28e81f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28ed4d6640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e80cd990 0x7f28e81f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28ed4d6640 1 -- 172.21.15.81:0/2995025019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e81570a0 con 0x7f28e80cece0 2024-09-21T06:45:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28ed4d6640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e80cece0 0x7f28e8156890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c730 tx=0x7f28e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28dd7fa640 1 -- 172.21.15.81:0/2995025019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0003b70 con 0x7f28e80cece0 2024-09-21T06:45:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28dd7fa640 1 -- 172.21.15.81:0/2995025019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28e0003d30 con 0x7f28e80cece0 2024-09-21T06:45:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e81f7a30 con 0x7f28e80cece0 2024-09-21T06:45:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28dd7fa640 1 -- 172.21.15.81:0/2995025019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00052d0 con 0x7f28e80cece0 2024-09-21T06:45:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.614+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e80caed0 con 0x7f28e80cece0 2024-09-21T06:45:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.615+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e80cdda0 con 0x7f28e80cece0 2024-09-21T06:45:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.616+0000 7f28dd7fa640 1 -- 172.21.15.81:0/2995025019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28e0005680 con 0x7f28e80cece0 2024-09-21T06:45:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.616+0000 7f28dd7fa640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f28d4078bc0 0x7f28d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.617+0000 7f28dd7fa640 1 -- 172.21.15.81:0/2995025019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f28e009ac60 con 0x7f28e80cece0 2024-09-21T06:45:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.617+0000 7f28eccd5640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f28d4078bc0 0x7f28d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.617+0000 7f28eccd5640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f28d4078bc0 0x7f28d407b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28e4034000 tx=0x7f28e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.621+0000 7f28dd7fa640 1 -- 172.21.15.81:0/2995025019 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f28e00629b0 con 0x7f28e80cece0 2024-09-21T06:45:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:16.802+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f28e8074750 con 0x7f28e80cece0 2024-09-21T06:45:18.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.471+0000 7f28dd7fa640 1 -- 172.21.15.81:0/2995025019 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f28e00673e0 con 0x7f28e80cece0 2024-09-21T06:45:18.474 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2024-09-21T06:45:18.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f28d4078bc0 msgr2=0x7f28d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f28d4078bc0 0x7f28d407b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28e4034000 tx=0x7f28e4004730 comp rx=0 tx=0).stop 2024-09-21T06:45:18.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e80cece0 msgr2=0x7f28e8156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e80cece0 0x7f28e8156890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c730 tx=0x7f28e000cbf0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 shutdown_connections 2024-09-21T06:45:18.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f28d4078bc0 0x7f28d407b0d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e80cece0 0x7f28e8156890 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28e80cd990 0x7f28e81f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 --2- 172.21.15.81:0/2995025019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28e806f5a0 0x7f28e80c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.475+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 >> 172.21.15.81:0/2995025019 conn(0x7f28e809aa30 msgr2=0x7f28e80affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.476+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 shutdown_connections 2024-09-21T06:45:18.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.476+0000 7f28eef39640 1 -- 172.21.15.81:0/2995025019 wait complete. 2024-09-21T06:45:18.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T06:45:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.616+0000 7f427069b640 1 -- 172.21.15.81:0/1810141528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4268161ec0 msgr2=0x7f42680cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.616+0000 7f427069b640 1 --2- 172.21.15.81:0/1810141528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4268161ec0 0x7f42680cf230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4258009830 tx=0x7f425802a480 comp rx=0 tx=0).stop 2024-09-21T06:45:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.616+0000 7f427069b640 1 -- 172.21.15.81:0/1810141528 shutdown_connections 2024-09-21T06:45:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.616+0000 7f427069b640 1 --2- 172.21.15.81:0/1810141528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4268161ec0 0x7f42680cf230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.616+0000 7f427069b640 1 -- 172.21.15.81:0/1810141528 >> 172.21.15.81:0/1810141528 conn(0x7f42680b7320 msgr2=0x7f42680b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.616+0000 7f427069b640 1 -- 172.21.15.81:0/1810141528 shutdown_connections 2024-09-21T06:45:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.616+0000 7f427069b640 1 -- 172.21.15.81:0/1810141528 wait complete. 2024-09-21T06:45:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.618+0000 7f427069b640 1 Processor -- start 2024-09-21T06:45:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.618+0000 7f427069b640 1 -- start start 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.619+0000 7f427069b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42680b8f70 0x7f42680b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.619+0000 7f427069b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42680cf770 0x7f42680b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.619+0000 7f427069b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4268161ec0 0x7f42681f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.619+0000 7f427069b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f42680d1720 con 0x7f42680b8f70 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.619+0000 7f427069b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f42680d15a0 con 0x7f4268161ec0 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.619+0000 7f427069b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f42680d18a0 con 0x7f42680cf770 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.619+0000 7f426e437640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42680b8f70 0x7f42680b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42680b8f70 0x7f42680b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49496/0 (socket says 172.21.15.81:49496) 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 -- 172.21.15.81:0/2515543495 learned_addr learned my addr 172.21.15.81:0/2515543495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426dc36640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42680cf770 0x7f42680b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426ec38640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4268161ec0 0x7f42681f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 -- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42680cf770 msgr2=0x7f42680b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42680cf770 0x7f42680b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 -- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4268161ec0 msgr2=0x7f42681f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4268161ec0 0x7f42681f5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 -- 172.21.15.81:0/2515543495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42681f5680 con 0x7f42680b8f70 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426dc36640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42680cf770 0x7f42680b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f426e437640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42680b8f70 0x7f42680b6960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f426400c3c0 tx=0x7f426400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f425effd640 1 -- 172.21.15.81:0/2515543495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264017070 con 0x7f42680b8f70 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f425effd640 1 -- 172.21.15.81:0/2515543495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42640035f0 con 0x7f42680b8f70 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f425effd640 1 -- 172.21.15.81:0/2515543495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264003a80 con 0x7f42680b8f70 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42680c8000 con 0x7f42680b8f70 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.620+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42680c85c0 con 0x7f42680b8f70 2024-09-21T06:45:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.621+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42680cf230 con 0x7f42680b8f70 2024-09-21T06:45:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.622+0000 7f425effd640 1 -- 172.21.15.81:0/2515543495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f426401a070 con 0x7f42680b8f70 2024-09-21T06:45:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.622+0000 7f425effd640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f424c078b90 0x7f424c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.622+0000 7f425effd640 1 -- 172.21.15.81:0/2515543495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f426409a250 con 0x7f42680b8f70 2024-09-21T06:45:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.623+0000 7f426dc36640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f424c078b90 0x7f424c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.623+0000 7f426dc36640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f424c078b90 0x7f424c07b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4258034000 tx=0x7f4258004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.627+0000 7f425effd640 1 -- 172.21.15.81:0/2515543495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4264062490 con 0x7f42680b8f70 2024-09-21T06:45:18.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:18.803+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f42680b78d0 con 0x7f42680b8f70 2024-09-21T06:45:19.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.473+0000 7f425effd640 1 -- 172.21.15.81:0/2515543495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f4264061d90 con 0x7f42680b8f70 2024-09-21T06:45:19.476 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T06:45:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.478+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f424c078b90 msgr2=0x7f424c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.478+0000 7f427069b640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f424c078b90 0x7f424c07b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4258034000 tx=0x7f4258004730 comp rx=0 tx=0).stop 2024-09-21T06:45:19.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42680b8f70 msgr2=0x7f42680b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42680b8f70 0x7f42680b6960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f426400c3c0 tx=0x7f426400c880 comp rx=0 tx=0).stop 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 shutdown_connections 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f424c078b90 0x7f424c07b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42680cf770 0x7f42680b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4268161ec0 0x7f42681f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 --2- 172.21.15.81:0/2515543495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42680b8f70 0x7f42680b6960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 >> 172.21.15.81:0/2515543495 conn(0x7f42680b7320 msgr2=0x7f4268160d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.479+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 shutdown_connections 2024-09-21T06:45:19.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.480+0000 7f427069b640 1 -- 172.21.15.81:0/2515543495 wait complete. 2024-09-21T06:45:19.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T06:45:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.628+0000 7f17375ad640 1 -- 172.21.15.81:0/2221822342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c005350 msgr2=0x7f171c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.628+0000 7f17375ad640 1 --2- 172.21.15.81:0/2221822342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c005350 0x7f171c00b9c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1728006fd0 tx=0x7f171c005830 comp rx=0 tx=0).stop 2024-09-21T06:45:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.628+0000 7f17375ad640 1 -- 172.21.15.81:0/2221822342 shutdown_connections 2024-09-21T06:45:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.628+0000 7f17375ad640 1 --2- 172.21.15.81:0/2221822342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c005350 0x7f171c00b9c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.628+0000 7f17375ad640 1 -- 172.21.15.81:0/2221822342 >> 172.21.15.81:0/2221822342 conn(0x7f17300b7330 msgr2=0x7f17300b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.628+0000 7f17375ad640 1 -- 172.21.15.81:0/2221822342 shutdown_connections 2024-09-21T06:45:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.628+0000 7f17375ad640 1 -- 172.21.15.81:0/2221822342 wait complete. 2024-09-21T06:45:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.630+0000 7f17375ad640 1 Processor -- start 2024-09-21T06:45:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.630+0000 7f17375ad640 1 -- start start 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f17375ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f171c005350 0x7f17300a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f17375ad640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17300a1780 0x7f17301f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f17375ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300a1c00 0x7f17301f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f17375ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f173015f130 con 0x7f17300a1c00 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f17375ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f173015efb0 con 0x7f171c005350 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f17375ad640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f173015f2b0 con 0x7f17300a1780 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f1735b4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300a1c00 0x7f17301f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f1735349640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f171c005350 0x7f17300a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f1735b4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300a1c00 0x7f17301f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49508/0 (socket says 172.21.15.81:49508) 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f1735b4a640 1 -- 172.21.15.81:0/541822360 learned_addr learned my addr 172.21.15.81:0/541822360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.631+0000 7f1734b48640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17300a1780 0x7f17301f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1735b4a640 1 -- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17300a1780 msgr2=0x7f17301f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1735b4a640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17300a1780 0x7f17301f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1735b4a640 1 -- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f171c005350 msgr2=0x7f17300a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1735b4a640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f171c005350 0x7f17300a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1735b4a640 1 -- 172.21.15.81:0/541822360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173009ee70 con 0x7f17300a1c00 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1735349640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f171c005350 0x7f17300a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1735b4a640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300a1c00 0x7f17301f7160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1728000f80 tx=0x7f1728001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1725ffb640 1 -- 172.21.15.81:0/541822360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172802bbb0 con 0x7f17300a1c00 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1725ffb640 1 -- 172.21.15.81:0/541822360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f172803a070 con 0x7f17300a1c00 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173009f150 con 0x7f17300a1c00 2024-09-21T06:45:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f1725ffb640 1 -- 172.21.15.81:0/541822360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17280063a0 con 0x7f17300a1c00 2024-09-21T06:45:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.632+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173009f710 con 0x7f17300a1c00 2024-09-21T06:45:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.633+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173008d110 con 0x7f17300a1c00 2024-09-21T06:45:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.634+0000 7f1725ffb640 1 -- 172.21.15.81:0/541822360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f172803c020 con 0x7f17300a1c00 2024-09-21T06:45:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.634+0000 7f1725ffb640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1714078b90 0x7f171407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.634+0000 7f1725ffb640 1 -- 172.21.15.81:0/541822360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f17280bb160 con 0x7f17300a1c00 2024-09-21T06:45:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.635+0000 7f1735349640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1714078b90 0x7f171407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.635+0000 7f1735349640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1714078b90 0x7f171407b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f172c0066b0 tx=0x7f172c006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.639+0000 7f1725ffb640 1 -- 172.21.15.81:0/541822360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f173008d110 con 0x7f17300a1c00 2024-09-21T06:45:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:19.853+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f17300d4490 con 0x7f17300a1c00 2024-09-21T06:45:20.430 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-21T06:45:20.428+0000 7f1d2e63d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:45:20.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.510+0000 7f1725ffb640 1 -- 172.21.15.81:0/541822360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f1728083450 con 0x7f17300a1c00 2024-09-21T06:45:20.512 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 4 to fsmap 2024-09-21T06:45:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1714078b90 msgr2=0x7f171407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1714078b90 0x7f171407b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f172c0066b0 tx=0x7f172c006b70 comp rx=0 tx=0).stop 2024-09-21T06:45:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300a1c00 msgr2=0x7f17301f7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300a1c00 0x7f17301f7160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1728000f80 tx=0x7f1728001b20 comp rx=0 tx=0).stop 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 shutdown_connections 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1714078b90 0x7f171407b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17300a1780 0x7f17301f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17300a1c00 0x7f17301f7160 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 --2- 172.21.15.81:0/541822360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f171c005350 0x7f17300a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 >> 172.21.15.81:0/541822360 conn(0x7f17300b7330 msgr2=0x7f17300d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 shutdown_connections 2024-09-21T06:45:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.513+0000 7f17375ad640 1 -- 172.21.15.81:0/541822360 wait complete. 2024-09-21T06:45:20.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.645+0000 7f39a0339640 1 -- 172.21.15.81:0/3230700493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3984003a00 msgr2=0x7f3984003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.645+0000 7f39a0339640 1 --2- 172.21.15.81:0/3230700493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3984003a00 0x7f3984003e70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3998069f70 tx=0x7f3984005830 comp rx=0 tx=0).stop 2024-09-21T06:45:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.645+0000 7f399e8d6640 1 -- 172.21.15.81:0/3230700493 reap_dead start 2024-09-21T06:45:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.645+0000 7f39a0339640 1 -- 172.21.15.81:0/3230700493 shutdown_connections 2024-09-21T06:45:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.645+0000 7f39a0339640 1 -- 172.21.15.81:0/3230700493 >> 172.21.15.81:0/3230700493 conn(0x7f39980740a0 msgr2=0x7f39980b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.645+0000 7f39a0339640 1 -- 172.21.15.81:0/3230700493 shutdown_connections 2024-09-21T06:45:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.645+0000 7f39a0339640 1 -- 172.21.15.81:0/3230700493 wait complete. 2024-09-21T06:45:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.647+0000 7f39a0339640 1 Processor -- start 2024-09-21T06:45:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.647+0000 7f39a0339640 1 -- start start 2024-09-21T06:45:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f39a0339640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3984003a00 0x7f3998144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f39a0339640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399815a8a0 0x7f3998155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f39a0339640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3998143580 0x7f39980cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f39a0339640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f399815cf70 con 0x7f3998143580 2024-09-21T06:45:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f39a0339640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f399806fa30 con 0x7f399815a8a0 2024-09-21T06:45:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f39a0339640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f399815d0f0 con 0x7f3984003a00 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3998143580 0x7f39980cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3998143580 0x7f39980cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49526/0 (socket says 172.21.15.81:49526) 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 -- 172.21.15.81:0/1850387509 learned_addr learned my addr 172.21.15.81:0/1850387509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399d8d4640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399815a8a0 0x7f3998155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e0d5640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3984003a00 0x7f3998144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 -- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3984003a00 msgr2=0x7f3998144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3984003a00 0x7f3998144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 -- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399815a8a0 msgr2=0x7f3998155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399815a8a0 0x7f3998155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.648+0000 7f399e8d6640 1 -- 172.21.15.81:0/1850387509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399815ada0 con 0x7f3998143580 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.649+0000 7f399e8d6640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3998143580 0x7f39980cf7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f399809f460 tx=0x7f399000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.649+0000 7f398effd640 1 -- 172.21.15.81:0/1850387509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399000dc20 con 0x7f3998143580 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.649+0000 7f398effd640 1 -- 172.21.15.81:0/1850387509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3990003970 con 0x7f3998143580 2024-09-21T06:45:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.649+0000 7f398effd640 1 -- 172.21.15.81:0/1850387509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990003dc0 con 0x7f3998143580 2024-09-21T06:45:20.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.649+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3998159d60 con 0x7f3998143580 2024-09-21T06:45:20.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.649+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399815a2e0 con 0x7f3998143580 2024-09-21T06:45:20.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.650+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39980cf080 con 0x7f3998143580 2024-09-21T06:45:20.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.650+0000 7f398effd640 1 -- 172.21.15.81:0/1850387509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3990004030 con 0x7f3998143580 2024-09-21T06:45:20.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.651+0000 7f398effd640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f397c078b90 0x7f397c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.651+0000 7f398effd640 1 -- 172.21.15.81:0/1850387509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f399009b870 con 0x7f3998143580 2024-09-21T06:45:20.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.651+0000 7f399e0d5640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f397c078b90 0x7f397c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.652+0000 7f399e0d5640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f397c078b90 0x7f397c07b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3994036000 tx=0x7f399403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.656+0000 7f398effd640 1 -- 172.21.15.81:0/1850387509 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3998159d60 con 0x7f3998143580 2024-09-21T06:45:20.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.869+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f399815bdb0 con 0x7f3998143580 2024-09-21T06:45:20.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.869+0000 7f398effd640 1 -- 172.21.15.81:0/1850387509 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5213 (secure 0 0 0) 0x7f3990063320 con 0x7f3998143580 2024-09-21T06:45:20.872 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:20.872 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-21T06:45:20:498333+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:19.855725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:20.872 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f397c078b90 msgr2=0x7f397c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f397c078b90 0x7f397c07b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3994036000 tx=0x7f399403d040 comp rx=0 tx=0).stop 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3998143580 msgr2=0x7f39980cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3998143580 0x7f39980cf7b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f399809f460 tx=0x7f399000fcb0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 shutdown_connections 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f397c078b90 0x7f397c07b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3998143580 0x7f39980cf7b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f399815a8a0 0x7f3998155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 --2- 172.21.15.81:0/1850387509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3984003a00 0x7f3998144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 >> 172.21.15.81:0/1850387509 conn(0x7f39980740a0 msgr2=0x7f3998147c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 shutdown_connections 2024-09-21T06:45:20.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.871+0000 7f39a0339640 1 -- 172.21.15.81:0/1850387509 wait complete. 2024-09-21T06:45:20.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:20.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/868943475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15eda0 msgr2=0x7fc3bc0b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/868943475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15eda0 0x7fc3bc0b96c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0d3e70 tx=0x7fc3a802a560 comp rx=0 tx=0).stop 2024-09-21T06:45:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/868943475 shutdown_connections 2024-09-21T06:45:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/868943475 >> v2:172.21.15.89:3300/0 conn(0x7fc3bc0b9c00 0x7fc3bc0d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/868943475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15eda0 0x7fc3bc0b96c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/868943475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3bc15c450 0x7fc3bc0d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/868943475 >> 172.21.15.81:0/868943475 conn(0x7fc3bc0b7330 msgr2=0x7fc3bc0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/868943475 shutdown_connections 2024-09-21T06:45:20.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.993+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/868943475 wait complete. 2024-09-21T06:45:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.995+0000 7fc3c2f8b640 1 Processor -- start 2024-09-21T06:45:20.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.995+0000 7fc3c2f8b640 1 -- start start 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c2f8b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3bc0b9c00 0x7fc3bc157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c2f8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15c450 0x7fc3bc15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c2f8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3bc15eda0 0x7fc3bc15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c2f8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc0b3230 con 0x7fc3bc15c450 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c2f8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc0d4b00 con 0x7fc3bc15eda0 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c2f8b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fc3bc0b33b0 con 0x7fc3bc0b9c00 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15c450 0x7fc3bc15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15c450 0x7fc3bc15d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49542/0 (socket says 172.21.15.81:49542) 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3bbfff640 1 -- 172.21.15.81:0/395865012 learned_addr learned my addr 172.21.15.81:0/395865012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c0d27640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3bc0b9c00 0x7fc3bc157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.996+0000 7fc3c1528640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3bc15eda0 0x7fc3bc15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3bbfff640 1 -- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3bc0b9c00 msgr2=0x7fc3bc157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3bc0b9c00 0x7fc3bc157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3bbfff640 1 -- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3bc15eda0 msgr2=0x7fc3bc15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3bc15eda0 0x7fc3bc15d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3bbfff640 1 -- 172.21.15.81:0/395865012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc1f5900 con 0x7fc3bc15c450 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3bbfff640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15c450 0x7fc3bc15d4b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8034040 tx=0x7fc3a80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3b97fa640 1 -- 172.21.15.81:0/395865012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a803e030 con 0x7fc3bc15c450 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3b97fa640 1 -- 172.21.15.81:0/395865012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3a80047a0 con 0x7fc3bc15c450 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc1f9090 con 0x7fc3bc15c450 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3b97fa640 1 -- 172.21.15.81:0/395865012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8035040 con 0x7fc3bc15c450 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.997+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc1f9650 con 0x7fc3bc15c450 2024-09-21T06:45:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.998+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc08d110 con 0x7fc3bc15c450 2024-09-21T06:45:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.999+0000 7fc3b97fa640 1 -- 172.21.15.81:0/395865012 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3a8041030 con 0x7fc3bc15c450 2024-09-21T06:45:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.999+0000 7fc3b97fa640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc3a0078b90 0x7fc3a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.999+0000 7fc3b97fa640 1 -- 172.21.15.81:0/395865012 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc3a80bb860 con 0x7fc3bc15c450 2024-09-21T06:45:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:20.999+0000 7fc3c0d27640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc3a0078b90 0x7fc3a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.000+0000 7fc3c0d27640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc3a0078b90 0x7fc3a007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc08c9c0 tx=0x7fc3b0009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.004+0000 7fc3b97fa640 1 -- 172.21.15.81:0/395865012 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc3bc08d110 con 0x7fc3bc15c450 2024-09-21T06:45:21.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.185+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3bc1f5ad0 con 0x7fc3bc15c450 2024-09-21T06:45:21.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.186+0000 7fc3b97fa640 1 -- 172.21.15.81:0/395865012 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7fc3a80833a0 con 0x7fc3bc15c450 2024-09-21T06:45:21.188 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:21.189 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.188+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc3a0078b90 msgr2=0x7fc3a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.188+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc3a0078b90 0x7fc3a007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc08c9c0 tx=0x7fc3b0009060 comp rx=0 tx=0).stop 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.188+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15c450 msgr2=0x7fc3bc15d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.188+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15c450 0x7fc3bc15d4b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8034040 tx=0x7fc3a80039e0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 shutdown_connections 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc3a0078b90 0x7fc3a007b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3bc15eda0 0x7fc3bc15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3bc15c450 0x7fc3bc15d4b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 --2- 172.21.15.81:0/395865012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc3bc0b9c00 0x7fc3bc157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 >> 172.21.15.81:0/395865012 conn(0x7fc3bc0b7330 msgr2=0x7fc3bc15c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:21.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 shutdown_connections 2024-09-21T06:45:21.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.189+0000 7fc3c2f8b640 1 -- 172.21.15.81:0/395865012 wait complete. 2024-09-21T06:45:21.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 -- 172.21.15.81:0/757999581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c06f630 msgr2=0x7f165c0ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 --2- 172.21.15.81:0/757999581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c06f630 0x7f165c0ada70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f165c0cc4a0 tx=0x7f165002a530 comp rx=0 tx=0).stop 2024-09-21T06:45:21.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 -- 172.21.15.81:0/757999581 shutdown_connections 2024-09-21T06:45:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 --2- 172.21.15.81:0/757999581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c06f630 0x7f165c0ada70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 --2- 172.21.15.81:0/757999581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f165c0b4c60 0x7f165c0b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 -- 172.21.15.81:0/757999581 >> 172.21.15.81:0/757999581 conn(0x7f165c0b2030 msgr2=0x7f165c0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 -- 172.21.15.81:0/757999581 shutdown_connections 2024-09-21T06:45:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.313+0000 7f16631ba640 1 -- 172.21.15.81:0/757999581 wait complete. 2024-09-21T06:45:21.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.315+0000 7f16631ba640 1 Processor -- start 2024-09-21T06:45:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.315+0000 7f16631ba640 1 -- start start 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f16631ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c06f630 0x7f165c0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f16631ba640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f165c0adfb0 0x7f165c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f16631ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c0b4c60 0x7f165c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f16631ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f165c158c30 con 0x7f165c06f630 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f16631ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f165c158ab0 con 0x7f165c0b4c60 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f16631ba640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f165c06d780 con 0x7f165c0adfb0 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f1660f56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c06f630 0x7f165c0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f1660f56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c06f630 0x7f165c0cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49550/0 (socket says 172.21.15.81:49550) 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f1660f56640 1 -- 172.21.15.81:0/3009224648 learned_addr learned my addr 172.21.15.81:0/3009224648 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f1661757640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c0b4c60 0x7f165c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.316+0000 7f165bfff640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f165c0adfb0 0x7f165c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f1660f56640 1 -- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f165c0adfb0 msgr2=0x7f165c14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f1660f56640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f165c0adfb0 0x7f165c14df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f1660f56640 1 -- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c0b4c60 msgr2=0x7f165c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f1660f56640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c0b4c60 0x7f165c14c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f1660f56640 1 -- 172.21.15.81:0/3009224648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c14efa0 con 0x7f165c06f630 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f165bfff640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f165c0adfb0 0x7f165c14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f1660f56640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c06f630 0x7f165c0cca70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f164c00ea20 tx=0x7f164c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f16597fa640 1 -- 172.21.15.81:0/3009224648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c00ce40 con 0x7f165c06f630 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f16597fa640 1 -- 172.21.15.81:0/3009224648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f164c004020 con 0x7f165c06f630 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c1f7940 con 0x7f165c06f630 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f16597fa640 1 -- 172.21.15.81:0/3009224648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c004470 con 0x7f165c06f630 2024-09-21T06:45:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.317+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c14d770 con 0x7f165c06f630 2024-09-21T06:45:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.318+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c06dc00 con 0x7f165c06f630 2024-09-21T06:45:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.319+0000 7f16597fa640 1 -- 172.21.15.81:0/3009224648 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f164c0035f0 con 0x7f165c06f630 2024-09-21T06:45:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.319+0000 7f16597fa640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1648078b90 0x7f164807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.319+0000 7f16597fa640 1 -- 172.21.15.81:0/3009224648 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f164c09ba10 con 0x7f165c06f630 2024-09-21T06:45:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.319+0000 7f165bfff640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1648078b90 0x7f164807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.320+0000 7f165bfff640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1648078b90 0x7f164807b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1650033000 tx=0x7f1650004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.324+0000 7f16597fa640 1 -- 172.21.15.81:0/3009224648 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f165c14efa0 con 0x7f165c06f630 2024-09-21T06:45:21.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.500+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f165c1586b0 con 0x7f165c06f630 2024-09-21T06:45:21.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.504+0000 7f16597fa640 1 -- 172.21.15.81:0/3009224648 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f164c063b10 con 0x7f165c06f630 2024-09-21T06:45:21.506 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:21.507 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1648078b90 msgr2=0x7f164807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1648078b90 0x7f164807b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1650033000 tx=0x7f1650004730 comp rx=0 tx=0).stop 2024-09-21T06:45:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c06f630 msgr2=0x7f165c0cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c06f630 0x7f165c0cca70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f164c00ea20 tx=0x7f164c00eee0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 shutdown_connections 2024-09-21T06:45:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1648078b90 0x7f164807b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f165c0adfb0 0x7f165c14df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f165c0b4c60 0x7f165c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 --2- 172.21.15.81:0/3009224648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c06f630 0x7f165c0cca70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 >> 172.21.15.81:0/3009224648 conn(0x7f165c0b2030 msgr2=0x7f165c0b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 shutdown_connections 2024-09-21T06:45:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.506+0000 7f16631ba640 1 -- 172.21.15.81:0/3009224648 wait complete. 2024-09-21T06:45:21.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 -- 172.21.15.81:0/4062920740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c0d41a0 msgr2=0x7f9d5c0d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 --2- 172.21.15.81:0/4062920740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c0d41a0 0x7f9d5c0d45b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9d54005fd0 tx=0x7f9d5402aa90 comp rx=0 tx=0).stop 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 -- 172.21.15.81:0/4062920740 shutdown_connections 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 --2- 172.21.15.81:0/4062920740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c0d41a0 0x7f9d5c0d45b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 --2- 172.21.15.81:0/4062920740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d5c15c450 0x7f9d5c0d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 -- 172.21.15.81:0/4062920740 >> 172.21.15.81:0/4062920740 conn(0x7f9d5c0b7330 msgr2=0x7f9d5c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 -- 172.21.15.81:0/4062920740 shutdown_connections 2024-09-21T06:45:21.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.647+0000 7f9d61720640 1 -- 172.21.15.81:0/4062920740 wait complete. 2024-09-21T06:45:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.649+0000 7f9d61720640 1 Processor -- start 2024-09-21T06:45:21.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.649+0000 7f9d61720640 1 -- start start 2024-09-21T06:45:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.650+0000 7f9d61720640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d5c0d41a0 0x7f9d5c1f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.650+0000 7f9d61720640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c15c450 0x7f9d5c1f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.650+0000 7f9d61720640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d5c15eda0 0x7f9d5c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.650+0000 7f9d61720640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c0b35c0 con 0x7f9d5c15c450 2024-09-21T06:45:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.650+0000 7f9d61720640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c0b3440 con 0x7f9d5c0d41a0 2024-09-21T06:45:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.650+0000 7f9d61720640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5c0b3740 con 0x7f9d5c15eda0 2024-09-21T06:45:21.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c15c450 0x7f9d5c1f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c15c450 0x7f9d5c1f9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49562/0 (socket says 172.21.15.81:49562) 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 -- 172.21.15.81:0/3245589909 learned_addr learned my addr 172.21.15.81:0/3245589909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d5affd640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d5c0d41a0 0x7f9d5c1f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d5b7fe640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d5c15eda0 0x7f9d5c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 -- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d5c15eda0 msgr2=0x7f9d5c14a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d5c15eda0 0x7f9d5c14a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 -- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d5c0d41a0 msgr2=0x7f9d5c1f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d5c0d41a0 0x7f9d5c1f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 -- 172.21.15.81:0/3245589909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c06e330 con 0x7f9d5c15c450 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d527fc640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c15c450 0x7f9d5c1f9560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c3a0 tx=0x7f9d4400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d53fff640 1 -- 172.21.15.81:0/3245589909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44017070 con 0x7f9d5c15c450 2024-09-21T06:45:21.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d53fff640 1 -- 172.21.15.81:0/3245589909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d440053c0 con 0x7f9d5c15c450 2024-09-21T06:45:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5c0b6500 con 0x7f9d5c15c450 2024-09-21T06:45:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d53fff640 1 -- 172.21.15.81:0/3245589909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44003850 con 0x7f9d5c15c450 2024-09-21T06:45:21.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.651+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5c06e5d0 con 0x7f9d5c15c450 2024-09-21T06:45:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.652+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5c08d110 con 0x7f9d5c15c450 2024-09-21T06:45:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.653+0000 7f9d53fff640 1 -- 172.21.15.81:0/3245589909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d4401a070 con 0x7f9d5c15c450 2024-09-21T06:45:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.653+0000 7f9d53fff640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.653+0000 7f9d53fff640 1 -- 172.21.15.81:0/3245589909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9d4409a380 con 0x7f9d5c15c450 2024-09-21T06:45:21.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.654+0000 7f9d5affd640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.654+0000 7f9d5affd640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c08c9c0 tx=0x7f9d4c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.658+0000 7f9d53fff640 1 -- 172.21.15.81:0/3245589909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9d5c08d110 con 0x7f9d5c15c450 2024-09-21T06:45:21.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.872+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d5c0b6730 con 0x7f9d5c15c450 2024-09-21T06:45:21.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.873+0000 7f9d53fff640 1 -- 172.21.15.81:0/3245589909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5213 (secure 0 0 0) 0x7f9d44061ec0 con 0x7f9d5c15c450 2024-09-21T06:45:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:21.875 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-21T06:45:20:498333+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:19.855725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:21.876 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9d3c078b90 msgr2=0x7f9d3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c08c9c0 tx=0x7f9d4c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c15c450 msgr2=0x7f9d5c1f9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c15c450 0x7f9d5c1f9560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c3a0 tx=0x7f9d4400c860 comp rx=0 tx=0).stop 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 shutdown_connections 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9d3c078b90 0x7f9d3c07b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9d5c15eda0 0x7f9d5c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c15c450 0x7f9d5c1f9560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 --2- 172.21.15.81:0/3245589909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9d5c0d41a0 0x7f9d5c1f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 >> 172.21.15.81:0/3245589909 conn(0x7f9d5c0b7330 msgr2=0x7f9d5c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 shutdown_connections 2024-09-21T06:45:21.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.875+0000 7f9d61720640 1 -- 172.21.15.81:0/3245589909 wait complete. 2024-09-21T06:45:21.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 -- 172.21.15.81:0/1246676520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f40b9c00 msgr2=0x7f07f40d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 --2- 172.21.15.81:0/1246676520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f40b9c00 0x7f07f40d41a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07ec005fd0 tx=0x7f07ec02aa90 comp rx=0 tx=0).stop 2024-09-21T06:45:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 -- 172.21.15.81:0/1246676520 shutdown_connections 2024-09-21T06:45:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 --2- 172.21.15.81:0/1246676520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f40b9c00 0x7f07f40d41a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 --2- 172.21.15.81:0/1246676520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07f40d3220 0x7f07f40b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 -- 172.21.15.81:0/1246676520 >> 172.21.15.81:0/1246676520 conn(0x7f07f40b7330 msgr2=0x7f07f40b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 -- 172.21.15.81:0/1246676520 shutdown_connections 2024-09-21T06:45:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:21.998+0000 7f07fa630640 1 -- 172.21.15.81:0/1246676520 wait complete. 2024-09-21T06:45:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.000+0000 7f07fa630640 1 Processor -- start 2024-09-21T06:45:22.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.000+0000 7f07fa630640 1 -- start start 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.001+0000 7f07fa630640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07f40b9c00 0x7f07f41518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07fa630640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07f40d3220 0x7f07f40b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07fa630640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f415c450 0x7f07f40ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07fa630640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40b33b0 con 0x7f07f415c450 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07fa630640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f07f40b3230 con 0x7f07f40b9c00 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07fa630640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f07f40b3530 con 0x7f07f40d3220 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f415c450 0x7f07f40ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f415c450 0x7f07f40ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49578/0 (socket says 172.21.15.81:49578) 2024-09-21T06:45:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 -- 172.21.15.81:0/3843042630 learned_addr learned my addr 172.21.15.81:0/3843042630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f37fe640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07f40d3220 0x7f07f40b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f3fff640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07f40b9c00 0x7f07f41518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 -- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07f40d3220 msgr2=0x7f07f40b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07f40d3220 0x7f07f40b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 -- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07f40b9c00 msgr2=0x7f07f41518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07f40b9c00 0x7f07f41518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 -- 172.21.15.81:0/3843042630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f4151df0 con 0x7f07f415c450 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f8bcd640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f415c450 0x7f07f40ca250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009d90 tx=0x7f07ec003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f0ff9640 1 -- 172.21.15.81:0/3843042630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec044070 con 0x7f07f415c450 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f0ff9640 1 -- 172.21.15.81:0/3843042630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07ec004250 con 0x7f07f415c450 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07f0ff9640 1 -- 172.21.15.81:0/3843042630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004660 con 0x7f07f415c450 2024-09-21T06:45:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f40c91b0 con 0x7f07f415c450 2024-09-21T06:45:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.002+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f40c9770 con 0x7f07f415c450 2024-09-21T06:45:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.003+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f408d110 con 0x7f07f415c450 2024-09-21T06:45:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.004+0000 7f07f0ff9640 1 -- 172.21.15.81:0/3843042630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07ec047070 con 0x7f07f415c450 2024-09-21T06:45:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.005+0000 7f07f0ff9640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f07e0078b90 0x7f07e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.005+0000 7f07f0ff9640 1 -- 172.21.15.81:0/3843042630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f07ec0bbf00 con 0x7f07f415c450 2024-09-21T06:45:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.005+0000 7f07f3fff640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f07e0078b90 0x7f07e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.005+0000 7f07f3fff640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f07e0078b90 0x7f07e007b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f408c9c0 tx=0x7f07e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.009+0000 7f07f0ff9640 1 -- 172.21.15.81:0/3843042630 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f07f408d110 con 0x7f07f415c450 2024-09-21T06:45:22.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.184+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07f40b3a50 con 0x7f07f415c450 2024-09-21T06:45:22.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.185+0000 7f07f0ff9640 1 -- 172.21.15.81:0/3843042630 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f07ec032030 con 0x7f07f415c450 2024-09-21T06:45:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:22.188 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f07e0078b90 msgr2=0x7f07e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f07e0078b90 0x7f07e007b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f408c9c0 tx=0x7f07e4009040 comp rx=0 tx=0).stop 2024-09-21T06:45:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f415c450 msgr2=0x7f07f40ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f415c450 0x7f07f40ca250 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009d90 tx=0x7f07ec003ce0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 shutdown_connections 2024-09-21T06:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f07e0078b90 0x7f07e007b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07f40d3220 0x7f07f40b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f415c450 0x7f07f40ca250 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 --2- 172.21.15.81:0/3843042630 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07f40b9c00 0x7f07f41518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 >> 172.21.15.81:0/3843042630 conn(0x7f07f40b7330 msgr2=0x7f07f415eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 shutdown_connections 2024-09-21T06:45:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.187+0000 7f07fa630640 1 -- 172.21.15.81:0/3843042630 wait complete. 2024-09-21T06:45:22.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:45:14.810455+0000', 'modified': '2024-09-21T06:45:19.855725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4377}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4377': {'gid': 4377, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/1093840929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 1093840929}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1093840929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4377, 'qdb_cluster': [4377]} 2024-09-21T06:45:22.604 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:45:22.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:45:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.716+0000 7f9c7eca9640 1 -- 172.21.15.81:0/3576712028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c60003a30 msgr2=0x7f9c60003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.716+0000 7f9c7eca9640 1 --2- 172.21.15.81:0/3576712028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c60003a30 0x7f9c60003ea0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9c740016c0 tx=0x7f9c60005830 comp rx=0 tx=0).stop 2024-09-21T06:45:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.716+0000 7f9c7d246640 1 -- 172.21.15.81:0/3576712028 reap_dead start 2024-09-21T06:45:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.716+0000 7f9c7eca9640 1 -- 172.21.15.81:0/3576712028 shutdown_connections 2024-09-21T06:45:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.716+0000 7f9c7eca9640 1 -- 172.21.15.81:0/3576712028 >> 172.21.15.81:0/3576712028 conn(0x7f9c78074080 msgr2=0x7f9c780b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.716+0000 7f9c7eca9640 1 -- 172.21.15.81:0/3576712028 shutdown_connections 2024-09-21T06:45:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.716+0000 7f9c7eca9640 1 -- 172.21.15.81:0/3576712028 wait complete. 2024-09-21T06:45:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.718+0000 7f9c7eca9640 1 Processor -- start 2024-09-21T06:45:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.718+0000 7f9c7eca9640 1 -- start start 2024-09-21T06:45:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7eca9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c60003a30 0x7f9c7809b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7eca9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c781f21f0 0x7f9c780cff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7eca9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c780c6720 0x7f9c780c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7eca9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7806f860 con 0x7f9c781f21f0 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7eca9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7806f6e0 con 0x7f9c60003a30 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7eca9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9c780b1c30 con 0x7f9c780c6720 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c781f21f0 0x7f9c780cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c781f21f0 0x7f9c780cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49586/0 (socket says 172.21.15.81:49586) 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 -- 172.21.15.81:0/4255691707 learned_addr learned my addr 172.21.15.81:0/4255691707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7d246640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c780c6720 0x7f9c780c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c60003a30 0x7f9c7809b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 -- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c780c6720 msgr2=0x7f9c780c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c780c6720 0x7f9c780c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 -- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c60003a30 msgr2=0x7f9c7809b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c60003a30 0x7f9c7809b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.719+0000 7f9c6ffff640 1 -- 172.21.15.81:0/4255691707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c780c7070 con 0x7f9c781f21f0 2024-09-21T06:45:22.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.720+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c781f21f0 0x7f9c780cff10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c68011ae0 tx=0x7f9c68009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.720+0000 7f9c6d7fa640 1 -- 172.21.15.81:0/4255691707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6801e070 con 0x7f9c781f21f0 2024-09-21T06:45:22.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.720+0000 7f9c6d7fa640 1 -- 172.21.15.81:0/4255691707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6800fc10 con 0x7f9c781f21f0 2024-09-21T06:45:22.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.720+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7809bb20 con 0x7f9c781f21f0 2024-09-21T06:45:22.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.720+0000 7f9c6d7fa640 1 -- 172.21.15.81:0/4255691707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68019410 con 0x7f9c781f21f0 2024-09-21T06:45:22.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.720+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7809c0e0 con 0x7f9c781f21f0 2024-09-21T06:45:22.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.721+0000 7f9c6d7fa640 1 -- 172.21.15.81:0/4255691707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c68021070 con 0x7f9c781f21f0 2024-09-21T06:45:22.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.722+0000 7f9c6d7fa640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c64078b90 0x7f9c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.722+0000 7f9c6d7fa640 1 -- 172.21.15.81:0/4255691707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c6809b7b0 con 0x7f9c781f21f0 2024-09-21T06:45:22.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.722+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c64078b90 0x7f9c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.723+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c64078b90 0x7f9c6407b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c74032000 tx=0x7f9c74001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.723+0000 7f9c85c19740 1 Processor -- start 2024-09-21T06:45:22.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.723+0000 7f9c85c19740 1 -- start start 2024-09-21T06:45:22.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a709990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a717e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7183d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c85c19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55906a663820 con 0x55906a349270 2024-09-21T06:45:22.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55906a652c50 con 0x55906a3203b0 2024-09-21T06:45:22.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x55906a656a60 con 0x55906a328590 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a709990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a709990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49594/0 (socket says 172.21.15.81:49594) 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 -- 172.21.15.81:0/609196838 learned_addr learned my addr 172.21.15.81:0/609196838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a717e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7d246640 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 -- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 msgr2=0x55906a7183d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7183d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 -- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 msgr2=0x55906a717e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a717e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.724+0000 7f9c7ca45640 1 -- 172.21.15.81:0/609196838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55906a3b4850 con 0x55906a349270 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.725+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a709990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c7402a930 tx=0x7f9c7403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428ceecfdaf28157 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.725+0000 7f9c5e7fc640 1 -- 172.21.15.81:0/609196838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7404d070 con 0x55906a349270 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.725+0000 7f9c5e7fc640 1 -- 172.21.15.81:0/609196838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c74043050 con 0x55906a349270 2024-09-21T06:45:22.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.725+0000 7f9c5e7fc640 1 -- 172.21.15.81:0/609196838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74038040 con 0x55906a349270 2024-09-21T06:45:22.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 -- 172.21.15.81:0/609196838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 msgr2=0x55906a709990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a709990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c7402a930 tx=0x7f9c7403a000 comp rx=0 tx=0).stop 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 -- 172.21.15.81:0/609196838 shutdown_connections 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7183d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a717e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 --2- 172.21.15.81:0/609196838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a709990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 -- 172.21.15.81:0/609196838 >> 172.21.15.81:0/609196838 conn(0x55906a33d3c0 msgr2=0x55906a6f1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 -- 172.21.15.81:0/609196838 shutdown_connections 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 -- 172.21.15.81:0/609196838 wait complete. 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.726+0000 7f9c85c19740 1 -- start start 2024-09-21T06:45:22.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.727+0000 7f9c85c19740 1 Processor -- start 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a72e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a328590 0x55906a7341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a349270 0x55906a72d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c85c19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55906a3c3620 con 0x55906a328590 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55906a5f85f0 con 0x55906a3203b0 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x55906a72ee70 con 0x55906a349270 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c85c19740 10 client.0 _ll_register_callbacks cb 0x55906a5fc0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a328590 0x55906a7341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a328590 0x55906a7341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49600/0 (socket says 172.21.15.81:49600) 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 -- 172.21.15.81:0/923375528 learned_addr learned my addr 172.21.15.81:0/923375528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a72e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c7d246640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a349270 0x55906a72d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 -- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a349270 msgr2=0x55906a72d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a349270 0x55906a72d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 -- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 msgr2=0x55906a72e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a72e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c6ffff640 1 -- 172.21.15.81:0/923375528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55906a42b6b0 con 0x55906a328590 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.728+0000 7f9c7d246640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a349270 0x55906a72d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a328590 0x55906a7341e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c68099900 tx=0x7f9c68062c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85d0b7267c4b77e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c577fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c577fe640 1 -- 172.21.15.81:0/923375528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68067c80 con 0x55906a328590 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c577fe640 1 -- 172.21.15.81:0/923375528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c6805eba0 con 0x55906a328590 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c74043050 con 0x55906a328590 2024-09-21T06:45:22.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c577fe640 1 -- 172.21.15.81:0/923375528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f9c6806cb30 con 0x55906a328590 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 10 client.4494 fetch_fsmap learned FSMap version 7 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55906a72ec10 con 0x55906a328590 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c577fe640 1 -- 172.21.15.81:0/923375528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c74043050 con 0x55906a328590 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c577fe640 1 -- 172.21.15.81:0/923375528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f9c6805eda0 con 0x55906a328590 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 10 client.4494 fetch_fsmap finished waiting for FSMap version 7 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 10 client.4494 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 20 client.4494 populate_metadata read hostname 'smithi081' 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a307e40 0x55906a74cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 4 client.4494 mds_command: new command op to 4377 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 --> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55906a665770 con 0x55906a307e40 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.729+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a307e40 0x55906a74cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.730+0000 7f9c577fe640 10 client.4494 ms_handle_connect on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.730+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a307e40 0x55906a74cff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12f45f448763ec65 server_cookie=718e716ab7380502 in_seq=0 out_seq=0 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.730+0000 7f9c577fe640 1 -- 172.21.15.81:0/923375528 <== mds.0 v2:172.21.15.81:6833/1093840929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55906a665770 con 0x55906a307e40 2024-09-21T06:45:22.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.730+0000 7f9c577fe640 10 client.4494 handle_command_reply: tid=0 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.730+0000 7f9c85c19740 1 client.4494 shutdown 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a328590 msgr2=0x55906a7341e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a328590 0x55906a7341e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c68099900 tx=0x7f9c68062c60 comp rx=0 tx=0).stop 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 shutdown_connections 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a307e40 0x55906a74cff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a349270 0x55906a72d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a328590 0x55906a7341e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c577fe640 0 client.4494 ms_handle_reset on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 --2- 172.21.15.81:0/923375528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a72e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 >> 172.21.15.81:0/923375528 conn(0x55906a33d3c0 msgr2=0x55906a71aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 shutdown_connections 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 1 -- 172.21.15.81:0/923375528 wait complete. 2024-09-21T06:45:22.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.731+0000 7f9c85c19740 20 client.4494 trim_cache size 0 max 16384 2024-09-21T06:45:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.749+0000 7f9c85c19740 1 Processor -- start 2024-09-21T06:45:22.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.749+0000 7f9c85c19740 1 -- start start 2024-09-21T06:45:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.750+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a3203b0 0x55906a711c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.750+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a328590 0x55906a712190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.750+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a719cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.750+0000 7f9c85c19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781fe6a0 con 0x55906a349270 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.750+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781f6510 con 0x55906a328590 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.750+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9c7806db20 con 0x55906a3203b0 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.750+0000 7f9c7d246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a719cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a719cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49606/0 (socket says 172.21.15.81:49606) 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 -- 172.21.15.81:0/1638475089 learned_addr learned my addr 172.21.15.81:0/1638475089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a3203b0 0x55906a711c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a328590 0x55906a712190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 -- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a3203b0 msgr2=0x55906a711c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a3203b0 0x55906a711c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 -- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a328590 msgr2=0x55906a712190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a328590 0x55906a712190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 -- 172.21.15.81:0/1638475089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55906a6e6ee0 con 0x55906a349270 2024-09-21T06:45:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a328590 0x55906a712190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c7d246640 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a719cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c70003ab0 tx=0x7f9c70003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe708d8aa4fae24f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c5dffb640 1 -- 172.21.15.81:0/1638475089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70006720 con 0x55906a349270 2024-09-21T06:45:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c5dffb640 1 -- 172.21.15.81:0/1638475089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c700068e0 con 0x55906a349270 2024-09-21T06:45:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.751+0000 7f9c5dffb640 1 -- 172.21.15.81:0/1638475089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c700136b0 con 0x55906a349270 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 -- 172.21.15.81:0/1638475089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 msgr2=0x55906a719cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a719cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c70003ab0 tx=0x7f9c70003f70 comp rx=0 tx=0).stop 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 -- 172.21.15.81:0/1638475089 shutdown_connections 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a719cf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a328590 0x55906a712190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 --2- 172.21.15.81:0/1638475089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a3203b0 0x55906a711c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 -- 172.21.15.81:0/1638475089 >> 172.21.15.81:0/1638475089 conn(0x55906a33d3c0 msgr2=0x55906a71aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 -- 172.21.15.81:0/1638475089 shutdown_connections 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.752+0000 7f9c85c19740 1 -- 172.21.15.81:0/1638475089 wait complete. 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.753+0000 7f9c85c19740 1 -- start start 2024-09-21T06:45:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.753+0000 7f9c85c19740 1 Processor -- start 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a6eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c85c19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a7b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c85c19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55906a6f0ed0 con 0x55906a349270 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55906a6f0ad0 con 0x55906a3203b0 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c85c19740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x55906a749e30 con 0x55906a328590 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c85c19740 10 client.0 _ll_register_callbacks cb 0x7f9c70001490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c7d246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a7b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c7d246640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a7b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49614/0 (socket says 172.21.15.81:49614) 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c7d246640 1 -- 172.21.15.81:0/473997324 learned_addr learned my addr 172.21.15.81:0/473997324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c6ffff640 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.754+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a6eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c7d246640 1 -- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 msgr2=0x55906a7b92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c7d246640 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7b92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c7d246640 1 -- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 msgr2=0x55906a6eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c7d246640 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a6eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c7d246640 1 -- 172.21.15.81:0/473997324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55906a7348f0 con 0x55906a349270 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c7d246640 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a7b97f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9c70006af0 tx=0x7f9c700067a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f794e500423d43bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c577fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c577fe640 1 -- 172.21.15.81:0/473997324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70015570 con 0x55906a349270 2024-09-21T06:45:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c577fe640 1 -- 172.21.15.81:0/473997324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c70015710 con 0x55906a349270 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c700068e0 con 0x55906a349270 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c577fe640 1 -- 172.21.15.81:0/473997324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f9c70030050 con 0x55906a349270 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 10 client.4500 fetch_fsmap learned FSMap version 7 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55906a7b9d50 con 0x55906a349270 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c577fe640 1 -- 172.21.15.81:0/473997324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c700068e0 con 0x55906a349270 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c577fe640 1 -- 172.21.15.81:0/473997324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f9c70033020 con 0x55906a349270 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 10 client.4500 fetch_fsmap finished waiting for FSMap version 7 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 10 client.4500 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 20 client.4500 populate_metadata read hostname 'smithi081' 2024-09-21T06:45:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a73f500 0x55906a6eece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 4 client.4500 mds_command: new command op to 4377 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 --> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] -- command(tid 0: {"prefix": "status"}) -- 0x55906a661220 con 0x55906a73f500 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.755+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a73f500 0x55906a6eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c577fe640 10 client.4500 ms_handle_connect on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c7ca45640 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a73f500 0x55906a6eece0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cfa891bd4d3c6e server_cookie=80ac29714afb1d31 in_seq=0 out_seq=0 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c577fe640 1 -- 172.21.15.81:0/473997324 <== mds.0 v2:172.21.15.81:6833/1093840929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55906a661220 con 0x55906a73f500 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c577fe640 10 client.4500 handle_command_reply: tid=0 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 client.4500 shutdown 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 msgr2=0x55906a7b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a7b97f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9c70006af0 tx=0x7f9c700067a0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 shutdown_connections 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x55906a73f500 0x55906a6eece0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55906a328590 0x55906a7b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55906a349270 0x55906a7b97f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c577fe640 0 client.4500 ms_handle_reset on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 --2- 172.21.15.81:0/473997324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55906a3203b0 0x55906a6eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.756+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 >> 172.21.15.81:0/473997324 conn(0x55906a33d3c0 msgr2=0x55906a6ea550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 shutdown_connections 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c85c19740 1 -- 172.21.15.81:0/473997324 wait complete. 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c85c19740 20 client.4500 trim_cache size 0 max 16384 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "5acf265c-1f37-45bc-9438-eb9ad71b6190", 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T06:45:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4377, 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 7.2940076149999999, 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 26, 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 26, 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.338721521 2024-09-21T06:45:22.765 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c64078b90 msgr2=0x7f9c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c64078b90 0x7f9c6407b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c74032000 tx=0x7f9c74001190 comp rx=0 tx=0).stop 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c781f21f0 msgr2=0x7f9c780cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c781f21f0 0x7f9c780cff10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c68011ae0 tx=0x7f9c68009e60 comp rx=0 tx=0).stop 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 shutdown_connections 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c64078b90 0x7f9c6407b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c780c6720 0x7f9c780c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c781f21f0 0x7f9c780cff10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 --2- 172.21.15.81:0/4255691707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c60003a30 0x7f9c7809b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 >> 172.21.15.81:0/4255691707 conn(0x7f9c78074080 msgr2=0x7f9c7815e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 shutdown_connections 2024-09-21T06:45:22.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.757+0000 7f9c7eca9640 1 -- 172.21.15.81:0/4255691707 wait complete. 2024-09-21T06:45:22.770 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:45:22.770 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:22.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:45:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.881+0000 7f5c0c750640 1 -- 172.21.15.81:0/2687096875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bf0003a50 msgr2=0x7f5bf0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.881+0000 7f5c0c750640 1 --2- 172.21.15.81:0/2687096875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bf0003a50 0x7f5bf0003ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5c0408c9c0 tx=0x7f5bf0005830 comp rx=0 tx=0).stop 2024-09-21T06:45:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.881+0000 7f5c0c750640 1 -- 172.21.15.81:0/2687096875 shutdown_connections 2024-09-21T06:45:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.881+0000 7f5c0c750640 1 --2- 172.21.15.81:0/2687096875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bf0003a50 0x7f5bf0003ec0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.881+0000 7f5c0c750640 1 -- 172.21.15.81:0/2687096875 >> 172.21.15.81:0/2687096875 conn(0x7f5c040b7330 msgr2=0x7f5c040b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.881+0000 7f5c0c750640 1 -- 172.21.15.81:0/2687096875 shutdown_connections 2024-09-21T06:45:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.881+0000 7f5c0c750640 1 -- 172.21.15.81:0/2687096875 wait complete. 2024-09-21T06:45:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.883+0000 7f5c0c750640 1 Processor -- start 2024-09-21T06:45:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.883+0000 7f5c0c750640 1 -- start start 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c0c750640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf0003a50 0x7f5c040cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c0c750640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c041534b0 0x7f5c040ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c0c750640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c041f8eb0 0x7f5c041f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c0c750640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0415ef20 con 0x7f5c041534b0 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c0c750640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0415eda0 con 0x7f5bf0003a50 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c0c750640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0415f0a0 con 0x7f5c041f8eb0 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c09ceb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c041534b0 0x7f5c040ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c09ceb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c041534b0 0x7f5c040ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49632/0 (socket says 172.21.15.81:49632) 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c09ceb640 1 -- 172.21.15.81:0/913040072 learned_addr learned my addr 172.21.15.81:0/913040072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c0a4ec640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf0003a50 0x7f5c040cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.884+0000 7f5c0aced640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c041f8eb0 0x7f5c041f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c09ceb640 1 -- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c041f8eb0 msgr2=0x7f5c041f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c09ceb640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c041f8eb0 0x7f5c041f92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c09ceb640 1 -- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf0003a50 msgr2=0x7f5c040cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c09ceb640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf0003a50 0x7f5c040cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c09ceb640 1 -- 172.21.15.81:0/913040072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c040b6b80 con 0x7f5c041534b0 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c09ceb640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c041534b0 0x7f5c040ca410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4003ef0 tx=0x7f5bf4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5bfaffd640 1 -- 172.21.15.81:0/913040072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4015070 con 0x7f5c041534b0 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5bfaffd640 1 -- 172.21.15.81:0/913040072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bf4011840 con 0x7f5c041534b0 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c041f9c30 con 0x7f5c041534b0 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5bfaffd640 1 -- 172.21.15.81:0/913040072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4011c70 con 0x7f5c041534b0 2024-09-21T06:45:22.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.885+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0406dc90 con 0x7f5c041534b0 2024-09-21T06:45:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.886+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0408d110 con 0x7f5c041534b0 2024-09-21T06:45:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.887+0000 7f5bfaffd640 1 -- 172.21.15.81:0/913040072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bf4018070 con 0x7f5c041534b0 2024-09-21T06:45:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.887+0000 7f5bfaffd640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5be8078b90 0x7f5be807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.887+0000 7f5bfaffd640 1 -- 172.21.15.81:0/913040072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5bf409bb10 con 0x7f5c041534b0 2024-09-21T06:45:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.888+0000 7f5c0a4ec640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5be8078b90 0x7f5be807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:22.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.888+0000 7f5c0a4ec640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5be8078b90 0x7f5be807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c00033000 tx=0x7f5c00000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:22.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:22.892+0000 7f5bfaffd640 1 -- 172.21.15.81:0/913040072 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5c0408d110 con 0x7f5c041534b0 2024-09-21T06:45:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.103+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c040b9830 con 0x7f5c041534b0 2024-09-21T06:45:23.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.103+0000 7f5bfaffd640 1 -- 172.21.15.81:0/913040072 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f5c040b6b80 con 0x7f5c041534b0 2024-09-21T06:45:23.105 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5be8078b90 msgr2=0x7f5be807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5be8078b90 0x7f5be807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c00033000 tx=0x7f5c00000fe0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c041534b0 msgr2=0x7f5c040ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c041534b0 0x7f5c040ca410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4003ef0 tx=0x7f5bf4001630 comp rx=0 tx=0).stop 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 shutdown_connections 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5be8078b90 0x7f5be807b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c041f8eb0 0x7f5c041f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c041534b0 0x7f5c040ca410 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 --2- 172.21.15.81:0/913040072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bf0003a50 0x7f5c040cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 >> 172.21.15.81:0/913040072 conn(0x7f5c040b7330 msgr2=0x7f5c040b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 shutdown_connections 2024-09-21T06:45:23.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23.106+0000 7f5c0c750640 1 -- 172.21.15.81:0/913040072 wait complete. 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:45:23.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:45:23.120 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T06:45:23.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:23.120 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:45:23.136 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:23.136 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:23.136 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:23.136 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:23.136 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-09-21T06:45:23.137 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:45:23.138 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:23.138 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:45:23.138 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:23.138 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:23.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:45:23.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-21T06:45:23.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-21T06:45:23.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:45:23.139 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:23.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:23.642 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:45:23.667 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:45:23.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:23.669 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:45:23.738 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:45:23.738 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:45:23.738 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:45:23.738 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:45:23.739 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:45:23.739 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:23.739 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:23.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:45:23.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:45:23.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:45:23.739 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:23.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:24.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:24.055 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:45:24.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:24.071 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-21T06:45:24.127 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:24.127 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:24.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:45:24.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T06:45:24.127 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:24.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:24.244 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T06:45:24.244 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:24.368 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:24.368 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:24.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:45:24.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:45:24.368 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:24.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:24.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:24.444 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T06:45:24.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:24.444 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:24.459 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T06:45:24.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:24.459 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:24.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-21T06:45:24.579 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T06:45:24.635 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-21T06:45:24.635 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-21T06:45:24.635 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-21T06:45:24.635 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-21T06:45:24.636 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-21T06:45:24.637 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:45:24.638 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:45:24.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:24.638 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-21T06:45:24.691 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T06:45:24.691 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T06:45:24.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-21T06:45:24.757 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T06:45:24.814 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-21T06:45:24.814 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-21T06:45:24.815 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-21T06:45:24.816 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-21T06:45:24.817 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-21T06:45:24.817 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-21T06:45:24.817 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:45:24.817 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:45:24.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:24.817 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-21T06:45:24.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2024-09-21T06:45:24.830+0000 7ff0a040e480 -1 init, newargv = 0x5633fd518130 newargc=15 2024-09-21T06:45:24.833 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[44069]: starting ceph client 2024-09-21T06:45:24.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[44069]: starting fuse 2024-09-21T06:45:24.848 INFO:teuthology.orchestra.run.smithi081.stdout:42 2024-09-21T06:45:24.848 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-21T06:45:24.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-21T06:45:24.848 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T06:45:24.849 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2024-09-21T06:45:24.850 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-21T06:45:24.964 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.44069.asok 2024-09-21T06:45:24.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:24.975 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44069.asok 2024-09-21T06:45:24.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:24.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44069.asok status 2024-09-21T06:45:25.116 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:45:25.116 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "44069", 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4515, 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-21T06:45:25.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4515 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3563366227 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3563366227 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4515 192.168.0.1:0/3563366227", 2024-09-21T06:45:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/3563366227", 2024-09-21T06:45:25.119 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-21T06:45:25.119 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2024-09-21T06:45:25.119 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 26, 2024-09-21T06:45:25.119 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-21T06:45:25.119 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-21T06:45:25.119 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-21T06:45:25.119 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:45:25.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:25.125 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-21T06:45:25.125 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:25.140 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-21T06:45:25.141 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:25.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:25.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:25.206 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T06:45:25.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:25.311 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2024-09-21T06:45:25.312 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T06:45:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:25.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:25.318 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:25.318 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:25.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:45:25.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.486+0000 7fd4c9771640 1 -- 172.21.15.81:0/1334042858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac005350 msgr2=0x7fd4ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.486+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1334042858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac005350 0x7fd4ac00b9c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40d21f0 tx=0x7fd4ac005830 comp rx=0 tx=0).stop 2024-09-21T06:45:25.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.486+0000 7fd4c9771640 1 -- 172.21.15.81:0/1334042858 shutdown_connections 2024-09-21T06:45:25.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.486+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1334042858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4ac005350 0x7fd4ac00b9c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.486+0000 7fd4c9771640 1 -- 172.21.15.81:0/1334042858 >> 172.21.15.81:0/1334042858 conn(0x7fd4c4074080 msgr2=0x7fd4c40b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:25.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.486+0000 7fd4c9771640 1 -- 172.21.15.81:0/1334042858 shutdown_connections 2024-09-21T06:45:25.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.486+0000 7fd4c9771640 1 -- 172.21.15.81:0/1334042858 wait complete. 2024-09-21T06:45:25.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.488+0000 7fd4c9771640 1 Processor -- start 2024-09-21T06:45:25.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.488+0000 7fd4c9771640 1 -- start start 2024-09-21T06:45:25.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c9771640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac005350 0x7fd4c4143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c9771640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c41e4910 0x7fd4c409e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c9771640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4c409eae0 0x7fd4c40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c9771640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c406ec80 con 0x7fd4c41e4910 2024-09-21T06:45:25.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c9771640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c406eb00 con 0x7fd4c409eae0 2024-09-21T06:45:25.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c9771640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c406ee00 con 0x7fd4ac005350 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c41e4910 0x7fd4c409e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c41e4910 0x7fd4c409e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49658/0 (socket says 172.21.15.81:49658) 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 -- 172.21.15.81:0/1590480216 learned_addr learned my addr 172.21.15.81:0/1590480216 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c2ffd640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac005350 0x7fd4c4143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c37fe640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4c409eae0 0x7fd4c40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 -- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac005350 msgr2=0x7fd4c4143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac005350 0x7fd4c4143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 -- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4c409eae0 msgr2=0x7fd4c40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4c409eae0 0x7fd4c40ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 -- 172.21.15.81:0/1590480216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c409eef0 con 0x7fd4c41e4910 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.489+0000 7fd4c27fc640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c41e4910 0x7fd4c409e5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8011ae0 tx=0x7fd4b8009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.490+0000 7fd4ab7fe640 1 -- 172.21.15.81:0/1590480216 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b801e070 con 0x7fd4c41e4910 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.490+0000 7fd4ab7fe640 1 -- 172.21.15.81:0/1590480216 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4b8004480 con 0x7fd4c41e4910 2024-09-21T06:45:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.490+0000 7fd4ab7fe640 1 -- 172.21.15.81:0/1590480216 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b800fc60 con 0x7fd4c41e4910 2024-09-21T06:45:25.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.490+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c41f6370 con 0x7fd4c41e4910 2024-09-21T06:45:25.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.490+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41f6930 con 0x7fd4c41e4910 2024-09-21T06:45:25.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.491+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c415cec0 con 0x7fd4c41e4910 2024-09-21T06:45:25.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.492+0000 7fd4ab7fe640 1 -- 172.21.15.81:0/1590480216 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4b8021070 con 0x7fd4c41e4910 2024-09-21T06:45:25.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.492+0000 7fd4ab7fe640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd4b0078bc0 0x7fd4b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.492+0000 7fd4ab7fe640 1 -- 172.21.15.81:0/1590480216 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd4b809bb80 con 0x7fd4c41e4910 2024-09-21T06:45:25.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.492+0000 7fd4c2ffd640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd4b0078bc0 0x7fd4b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.493+0000 7fd4c2ffd640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd4b0078bc0 0x7fd4b007b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4006fa0 tx=0x7fd4b4006b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:25.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.497+0000 7fd4ab7fe640 1 -- 172.21.15.81:0/1590480216 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd4c409eef0 con 0x7fd4c41e4910 2024-09-21T06:45:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.685+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4c40696c0 con 0x7fd4c41e4910 2024-09-21T06:45:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.685+0000 7fd4ab7fe640 1 -- 172.21.15.81:0/1590480216 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fd4b80635b0 con 0x7fd4c41e4910 2024-09-21T06:45:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:45:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd4b0078bc0 msgr2=0x7fd4b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd4b0078bc0 0x7fd4b007b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4006fa0 tx=0x7fd4b4006b20 comp rx=0 tx=0).stop 2024-09-21T06:45:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c41e4910 msgr2=0x7fd4c409e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c41e4910 0x7fd4c409e5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8011ae0 tx=0x7fd4b8009e40 comp rx=0 tx=0).stop 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 shutdown_connections 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd4b0078bc0 0x7fd4b007b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4c409eae0 0x7fd4c40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c41e4910 0x7fd4c409e5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 --2- 172.21.15.81:0/1590480216 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4ac005350 0x7fd4c4143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 >> 172.21.15.81:0/1590480216 conn(0x7fd4c4074080 msgr2=0x7fd4c415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 shutdown_connections 2024-09-21T06:45:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.688+0000 7fd4c9771640 1 -- 172.21.15.81:0/1590480216 wait complete. 2024-09-21T06:45:25.701 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:25.701 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:25.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:45:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 -- 172.21.15.81:0/3538848019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc15c450 msgr2=0x7faacc0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 --2- 172.21.15.81:0/3538848019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc15c450 0x7faacc0d3220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faabc009830 tx=0x7faabc02a510 comp rx=0 tx=0).stop 2024-09-21T06:45:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 -- 172.21.15.81:0/3538848019 shutdown_connections 2024-09-21T06:45:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 --2- 172.21.15.81:0/3538848019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faacc15eda0 0x7faacc0b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 --2- 172.21.15.81:0/3538848019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc15c450 0x7faacc0d3220 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 -- 172.21.15.81:0/3538848019 >> 172.21.15.81:0/3538848019 conn(0x7faacc0b7330 msgr2=0x7faacc0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 -- 172.21.15.81:0/3538848019 shutdown_connections 2024-09-21T06:45:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.868+0000 7faad2b19640 1 -- 172.21.15.81:0/3538848019 wait complete. 2024-09-21T06:45:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.870+0000 7faad2b19640 1 Processor -- start 2024-09-21T06:45:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.870+0000 7faad2b19640 1 -- start start 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad2b19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc0b9c00 0x7faacc0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad2b19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faacc15c450 0x7faacc0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad2b19640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faacc15eda0 0x7faacc0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad2b19640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faacc0b35c0 con 0x7faacc0b9c00 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad2b19640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faacc0b3440 con 0x7faacc15c450 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad2b19640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7faacc0b3740 con 0x7faacc15eda0 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad08b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc0b9c00 0x7faacc0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad08b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc0b9c00 0x7faacc0ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49680/0 (socket says 172.21.15.81:49680) 2024-09-21T06:45:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.871+0000 7faad08b5640 1 -- 172.21.15.81:0/2709416211 learned_addr learned my addr 172.21.15.81:0/2709416211 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faacbfff640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faacc15c450 0x7faacc0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad10b6640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faacc15eda0 0x7faacc0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad08b5640 1 -- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faacc15eda0 msgr2=0x7faacc0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad08b5640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faacc15eda0 0x7faacc0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad08b5640 1 -- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faacc15c450 msgr2=0x7faacc0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad08b5640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faacc15c450 0x7faacc0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad08b5640 1 -- 172.21.15.81:0/2709416211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc0b6b60 con 0x7faacc0b9c00 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad10b6640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faacc15eda0 0x7faacc0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad08b5640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc0b9c00 0x7faacc0ca7e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faabc009950 tx=0x7faabc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faac97fa640 1 -- 172.21.15.81:0/2709416211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc005c90 con 0x7faacc0b9c00 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faac97fa640 1 -- 172.21.15.81:0/2709416211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faabc031e50 con 0x7faacc0b9c00 2024-09-21T06:45:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc06ef50 con 0x7faacc0b9c00 2024-09-21T06:45:25.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faac97fa640 1 -- 172.21.15.81:0/2709416211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc005260 con 0x7faacc0b9c00 2024-09-21T06:45:25.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.872+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc0cad20 con 0x7faacc0b9c00 2024-09-21T06:45:25.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.873+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc08d110 con 0x7faacc0b9c00 2024-09-21T06:45:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.874+0000 7faac97fa640 1 -- 172.21.15.81:0/2709416211 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faabc005400 con 0x7faacc0b9c00 2024-09-21T06:45:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.874+0000 7faac97fa640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7faab8078b90 0x7faab807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.874+0000 7faac97fa640 1 -- 172.21.15.81:0/2709416211 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faabc0bc0c0 con 0x7faacc0b9c00 2024-09-21T06:45:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.874+0000 7faacbfff640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7faab8078b90 0x7faab807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.875+0000 7faacbfff640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7faab8078b90 0x7faab807b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faacc06dfe0 tx=0x7faac0009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:25.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:25.879+0000 7faac97fa640 1 -- 172.21.15.81:0/2709416211 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faacc08d110 con 0x7faacc0b9c00 2024-09-21T06:45:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.068+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faacc0d26c0 con 0x7faacc0b9c00 2024-09-21T06:45:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.068+0000 7faac97fa640 1 -- 172.21.15.81:0/2709416211 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7faabc03f030 con 0x7faacc0b9c00 2024-09-21T06:45:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:45:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7faab8078b90 msgr2=0x7faab807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7faab8078b90 0x7faab807b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faacc06dfe0 tx=0x7faac0009500 comp rx=0 tx=0).stop 2024-09-21T06:45:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc0b9c00 msgr2=0x7faacc0ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc0b9c00 0x7faacc0ca7e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faabc009950 tx=0x7faabc033c20 comp rx=0 tx=0).stop 2024-09-21T06:45:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 shutdown_connections 2024-09-21T06:45:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7faab8078b90 0x7faab807b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faacc15eda0 0x7faacc0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faacc15c450 0x7faacc0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 --2- 172.21.15.81:0/2709416211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faacc0b9c00 0x7faacc0ca7e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 >> 172.21.15.81:0/2709416211 conn(0x7faacc0b7330 msgr2=0x7faacc0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 shutdown_connections 2024-09-21T06:45:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.071+0000 7faad2b19640 1 -- 172.21.15.81:0/2709416211 wait complete. 2024-09-21T06:45:26.084 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-21T06:45:26.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:26.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T06:45:26.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[44069]: fuse finished with error 0 and tester_r 0 2024-09-21T06:45:26.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:45:26.209 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:45:26.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:26.209 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T06:45:26.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 -- 172.21.15.81:0/1817557672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c0d41a0 msgr2=0x7f985c0d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 --2- 172.21.15.81:0/1817557672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c0d41a0 0x7f985c0d45b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9854005fd0 tx=0x7f985402aa00 comp rx=0 tx=0).stop 2024-09-21T06:45:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 -- 172.21.15.81:0/1817557672 shutdown_connections 2024-09-21T06:45:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 --2- 172.21.15.81:0/1817557672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c0d41a0 0x7f985c0d45b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 --2- 172.21.15.81:0/1817557672 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f985c15c450 0x7f985c0d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 -- 172.21.15.81:0/1817557672 >> 172.21.15.81:0/1817557672 conn(0x7f985c0b7330 msgr2=0x7f985c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 -- 172.21.15.81:0/1817557672 shutdown_connections 2024-09-21T06:45:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.380+0000 7f986295e640 1 -- 172.21.15.81:0/1817557672 wait complete. 2024-09-21T06:45:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.381+0000 7f986295e640 1 Processor -- start 2024-09-21T06:45:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.382+0000 7f986295e640 1 -- start start 2024-09-21T06:45:26.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f986295e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f985c0d41a0 0x7f985c14b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f986295e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c15c450 0x7f985c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f986295e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c15eda0 0x7f985c0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f986295e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f985c0b35c0 con 0x7f985c15c450 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f986295e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f985c0b3440 con 0x7f985c15eda0 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f986295e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f985c0b3740 con 0x7f985c0d41a0 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c15c450 0x7f985c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c15c450 0x7f985c0b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49700/0 (socket says 172.21.15.81:49700) 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 -- 172.21.15.81:0/3873118403 learned_addr learned my addr 172.21.15.81:0/3873118403 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985bfff640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f985c0d41a0 0x7f985c14b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f9860efb640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c15eda0 0x7f985c0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 -- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f985c0d41a0 msgr2=0x7f985c14b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f985c0d41a0 0x7f985c14b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 -- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c15eda0 msgr2=0x7f985c0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c15eda0 0x7f985c0b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.383+0000 7f985b7fe640 1 -- 172.21.15.81:0/3873118403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c14b650 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.384+0000 7f985b7fe640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c15c450 0x7f985c0b5da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f985000b3f0 tx=0x7f985000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.384+0000 7f9858ff9640 1 -- 172.21.15.81:0/3873118403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850015020 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.384+0000 7f9858ff9640 1 -- 172.21.15.81:0/3873118403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9850011920 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.384+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c0cb470 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.384+0000 7f9858ff9640 1 -- 172.21.15.81:0/3873118403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850011d70 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.384+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c0ce110 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.385+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c08d110 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.386+0000 7f9858ff9640 1 -- 172.21.15.81:0/3873118403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9850018020 con 0x7f985c15c450 2024-09-21T06:45:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.386+0000 7f9858ff9640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9848078b90 0x7f984807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.386+0000 7f9858ff9640 1 -- 172.21.15.81:0/3873118403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f985009ac10 con 0x7f985c15c450 2024-09-21T06:45:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.386+0000 7f985bfff640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9848078b90 0x7f984807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.387+0000 7f985bfff640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9848078b90 0x7f984807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f985c08c9c0 tx=0x7f984c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.391+0000 7f9858ff9640 1 -- 172.21.15.81:0/3873118403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f985c08d110 con 0x7f985c15c450 2024-09-21T06:45:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.569+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f985c0b6820 con 0x7f985c15c450 2024-09-21T06:45:26.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.571+0000 7f9858ff9640 1 -- 172.21.15.81:0/3873118403 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f985001f030 con 0x7f985c15c450 2024-09-21T06:45:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:26.573 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9848078b90 msgr2=0x7f984807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9848078b90 0x7f984807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f985c08c9c0 tx=0x7f984c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c15c450 msgr2=0x7f985c0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c15c450 0x7f985c0b5da0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f985000b3f0 tx=0x7f985000b8b0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 shutdown_connections 2024-09-21T06:45:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9848078b90 0x7f984807b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f985c15eda0 0x7f985c0b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f985c15c450 0x7f985c0b5da0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 --2- 172.21.15.81:0/3873118403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f985c0d41a0 0x7f985c14b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 >> 172.21.15.81:0/3873118403 conn(0x7f985c0b7330 msgr2=0x7f985c160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 shutdown_connections 2024-09-21T06:45:26.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.573+0000 7f986295e640 1 -- 172.21.15.81:0/3873118403 wait complete. 2024-09-21T06:45:26.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 -- 172.21.15.81:0/1778525185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34100b9c00 msgr2=0x7f34100d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 --2- 172.21.15.81:0/1778525185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34100b9c00 0x7f34100d41a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3408005fd0 tx=0x7f340802a8b0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 -- 172.21.15.81:0/1778525185 shutdown_connections 2024-09-21T06:45:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 --2- 172.21.15.81:0/1778525185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34100b9c00 0x7f34100d41a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 --2- 172.21.15.81:0/1778525185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34100d3220 0x7f34100b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 -- 172.21.15.81:0/1778525185 >> 172.21.15.81:0/1778525185 conn(0x7f34100b7330 msgr2=0x7f34100b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 -- 172.21.15.81:0/1778525185 shutdown_connections 2024-09-21T06:45:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.697+0000 7f341824d640 1 -- 172.21.15.81:0/1778525185 wait complete. 2024-09-21T06:45:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.699+0000 7f341824d640 1 Processor -- start 2024-09-21T06:45:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.699+0000 7f341824d640 1 -- start start 2024-09-21T06:45:26.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f341824d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34100b9c00 0x7f34101598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f341824d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34100d3220 0x7f34100c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f341824d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341015c450 0x7f34100c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f341824d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34100b35c0 con 0x7f341015c450 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f341824d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34100b3440 con 0x7f34100b9c00 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f341824d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f34100b3740 con 0x7f34100d3220 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f34167ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341015c450 0x7f34100c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f34167ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341015c450 0x7f34100c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49716/0 (socket says 172.21.15.81:49716) 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f34167ea640 1 -- 172.21.15.81:0/2431483070 learned_addr learned my addr 172.21.15.81:0/2431483070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f34157e8640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34100d3220 0x7f34100c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f34167ea640 1 -- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34100d3220 msgr2=0x7f34100c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f34167ea640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34100d3220 0x7f34100c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f3415fe9640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34100b9c00 0x7f34101598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.700+0000 7f34167ea640 1 -- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34100b9c00 msgr2=0x7f34101598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f34167ea640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34100b9c00 0x7f34101598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f34167ea640 1 -- 172.21.15.81:0/2431483070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34100b5b30 con 0x7f341015c450 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f34167ea640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341015c450 0x7f34100c9620 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3408005fd0 tx=0x7f3408031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f34067fc640 1 -- 172.21.15.81:0/2431483070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408031990 con 0x7f341015c450 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f34067fc640 1 -- 172.21.15.81:0/2431483070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3408031c20 con 0x7f341015c450 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34100b5e10 con 0x7f341015c450 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f34067fc640 1 -- 172.21.15.81:0/2431483070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408033070 con 0x7f341015c450 2024-09-21T06:45:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.701+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34100b63d0 con 0x7f341015c450 2024-09-21T06:45:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.702+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f341008d110 con 0x7f341015c450 2024-09-21T06:45:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.703+0000 7f34067fc640 1 -- 172.21.15.81:0/2431483070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3408033210 con 0x7f341015c450 2024-09-21T06:45:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.703+0000 7f34067fc640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f33f4078b90 0x7f33f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.703+0000 7f34067fc640 1 -- 172.21.15.81:0/2431483070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f34080bc640 con 0x7f341015c450 2024-09-21T06:45:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.703+0000 7f3415fe9640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f33f4078b90 0x7f33f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.704+0000 7f3415fe9640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f33f4078b90 0x7f33f407b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f340c000f60 tx=0x7f340c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.708+0000 7f34067fc640 1 -- 172.21.15.81:0/2431483070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f341008d110 con 0x7f341015c450 2024-09-21T06:45:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.889+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34100d1370 con 0x7f341015c450 2024-09-21T06:45:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.890+0000 7f34067fc640 1 -- 172.21.15.81:0/2431483070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f340803f030 con 0x7f341015c450 2024-09-21T06:45:26.892 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:26.892 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f33f4078b90 msgr2=0x7f33f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f33f4078b90 0x7f33f407b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f340c000f60 tx=0x7f340c009040 comp rx=0 tx=0).stop 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341015c450 msgr2=0x7f34100c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341015c450 0x7f34100c9620 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3408005fd0 tx=0x7f3408031760 comp rx=0 tx=0).stop 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 shutdown_connections 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f33f4078b90 0x7f33f407b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34100d3220 0x7f34100c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f341015c450 0x7f34100c9620 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 --2- 172.21.15.81:0/2431483070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34100b9c00 0x7f34101598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 >> 172.21.15.81:0/2431483070 conn(0x7f34100b7330 msgr2=0x7f341015d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 shutdown_connections 2024-09-21T06:45:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:26.893+0000 7f341824d640 1 -- 172.21.15.81:0/2431483070 wait complete. 2024-09-21T06:45:26.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:45:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.018+0000 7f2b21b72640 1 -- 172.21.15.81:0/857529365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 msgr2=0x7f2b080040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.018+0000 7f2b21b72640 1 --2- 172.21.15.81:0/857529365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b080040d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c08c9c0 tx=0x7f2b08005830 comp rx=0 tx=0).stop 2024-09-21T06:45:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.018+0000 7f2b21b72640 1 -- 172.21.15.81:0/857529365 shutdown_connections 2024-09-21T06:45:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.018+0000 7f2b21b72640 1 --2- 172.21.15.81:0/857529365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b080040d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.018+0000 7f2b21b72640 1 -- 172.21.15.81:0/857529365 >> 172.21.15.81:0/857529365 conn(0x7f2b1c0b7330 msgr2=0x7f2b1c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.018+0000 7f2b21b72640 1 -- 172.21.15.81:0/857529365 shutdown_connections 2024-09-21T06:45:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.018+0000 7f2b21b72640 1 -- 172.21.15.81:0/857529365 wait complete. 2024-09-21T06:45:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.020+0000 7f2b21b72640 1 Processor -- start 2024-09-21T06:45:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.020+0000 7f2b21b72640 1 -- start start 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.021+0000 7f2b21b72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b1c1f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.021+0000 7f2b21b72640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c0b67e0 0x7f2b1c06df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.021+0000 7f2b21b72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c1528b0 0x7f2b1c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b21b72640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c15ef20 con 0x7f2b08003c80 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b21b72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c15eda0 con 0x7f2b1c1528b0 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b21b72640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1c15f0a0 con 0x7f2b1c0b67e0 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b1c1f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b1c1f5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49732/0 (socket says 172.21.15.81:49732) 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 -- 172.21.15.81:0/809433688 learned_addr learned my addr 172.21.15.81:0/809433688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1affd640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c0b67e0 0x7f2b1c06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1bfff640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c1528b0 0x7f2b1c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 -- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c0b67e0 msgr2=0x7f2b1c06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c0b67e0 0x7f2b1c06df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 -- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c1528b0 msgr2=0x7f2b1c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c1528b0 0x7f2b1c06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 -- 172.21.15.81:0/809433688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1c06cd90 con 0x7f2b08003c80 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b1b7fe640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b1c1f5190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c031040 tx=0x7f2b0c0066a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:27.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b13fff640 1 -- 172.21.15.81:0/809433688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0037f0 con 0x7f2b08003c80 2024-09-21T06:45:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b13fff640 1 -- 172.21.15.81:0/809433688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b0c03f070 con 0x7f2b08003c80 2024-09-21T06:45:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1c1f5a50 con 0x7f2b08003c80 2024-09-21T06:45:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b13fff640 1 -- 172.21.15.81:0/809433688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c003ce0 con 0x7f2b08003c80 2024-09-21T06:45:27.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.022+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b1c1f6010 con 0x7f2b08003c80 2024-09-21T06:45:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.023+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b1c08d110 con 0x7f2b08003c80 2024-09-21T06:45:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.024+0000 7f2b13fff640 1 -- 172.21.15.81:0/809433688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b0c044470 con 0x7f2b08003c80 2024-09-21T06:45:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.025+0000 7f2b13fff640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2afc078b90 0x7f2afc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.025+0000 7f2b13fff640 1 -- 172.21.15.81:0/809433688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2b0c0bc550 con 0x7f2b08003c80 2024-09-21T06:45:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.025+0000 7f2b1affd640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2afc078b90 0x7f2afc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.025+0000 7f2b1affd640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2afc078b90 0x7f2afc07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0c7910 tx=0x7f2b04006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:27.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.029+0000 7f2b13fff640 1 -- 172.21.15.81:0/809433688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2b1c08d110 con 0x7f2b08003c80 2024-09-21T06:45:27.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.242+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2b1c0b9830 con 0x7f2b08003c80 2024-09-21T06:45:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.723+0000 7f2b13fff640 1 -- 172.21.15.81:0/809433688 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f2b0c049060 con 0x7f2b08003c80 2024-09-21T06:45:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2afc078b90 msgr2=0x7f2afc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2afc078b90 0x7f2afc07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0c7910 tx=0x7f2b04006b10 comp rx=0 tx=0).stop 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 msgr2=0x7f2b1c1f5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b1c1f5190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c031040 tx=0x7f2b0c0066a0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 shutdown_connections 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2afc078b90 0x7f2afc07b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1c0b67e0 0x7f2b1c06df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1c1528b0 0x7f2b1c06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 --2- 172.21.15.81:0/809433688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b08003c80 0x7f2b1c1f5190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 >> 172.21.15.81:0/809433688 conn(0x7f2b1c0b7330 msgr2=0x7f2b1c15e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 shutdown_connections 2024-09-21T06:45:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.725+0000 7f2b21b72640 1 -- 172.21.15.81:0/809433688 wait complete. 2024-09-21T06:45:27.740 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-21T06:45:27.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:45:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.853+0000 7f92cccf9640 1 -- 172.21.15.81:0/33040441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 msgr2=0x7f92b0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.853+0000 7f92cccf9640 1 --2- 172.21.15.81:0/33040441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92b0004c10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00c310 tx=0x7f92b0005830 comp rx=0 tx=0).stop 2024-09-21T06:45:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.853+0000 7f92cccf9640 1 -- 172.21.15.81:0/33040441 shutdown_connections 2024-09-21T06:45:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.853+0000 7f92cccf9640 1 --2- 172.21.15.81:0/33040441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92b0004c10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.853+0000 7f92cccf9640 1 -- 172.21.15.81:0/33040441 >> 172.21.15.81:0/33040441 conn(0x7f92c80740a0 msgr2=0x7f92c80b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.853+0000 7f92cccf9640 1 -- 172.21.15.81:0/33040441 shutdown_connections 2024-09-21T06:45:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.853+0000 7f92cccf9640 1 -- 172.21.15.81:0/33040441 wait complete. 2024-09-21T06:45:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.855+0000 7f92cccf9640 1 Processor -- start 2024-09-21T06:45:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.855+0000 7f92cccf9640 1 -- start start 2024-09-21T06:45:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92c8146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c80b36f0 0x7f92c80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c814ad20 0x7f92c81f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92c809abb0 con 0x7f92b0004800 2024-09-21T06:45:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f92c809aa30 con 0x7f92c814ad20 2024-09-21T06:45:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f92c806eab0 con 0x7f92c80b36f0 2024-09-21T06:45:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92c8146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92c8146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49746/0 (socket says 172.21.15.81:49746) 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 -- 172.21.15.81:0/2022247841 learned_addr learned my addr 172.21.15.81:0/2022247841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c5d9b640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c80b36f0 0x7f92c80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c6d9d640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c814ad20 0x7f92c81f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 -- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c80b36f0 msgr2=0x7f92c80b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c80b36f0 0x7f92c80b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 -- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c814ad20 msgr2=0x7f92c81f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c814ad20 0x7f92c81f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 -- 172.21.15.81:0/2022247841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c80b2650 con 0x7f92b0004800 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c5d9b640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c80b36f0 0x7f92c80b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c6d9d640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c814ad20 0x7f92c81f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92c659c640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92c8146cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92b800a4a0 tx=0x7f92b800a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:27.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92b6ffd640 1 -- 172.21.15.81:0/2022247841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b800e260 con 0x7f92b0004800 2024-09-21T06:45:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92b6ffd640 1 -- 172.21.15.81:0/2022247841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92b80060d0 con 0x7f92b0004800 2024-09-21T06:45:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c80b2930 con 0x7f92b0004800 2024-09-21T06:45:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92b6ffd640 1 -- 172.21.15.81:0/2022247841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b8006520 con 0x7f92b0004800 2024-09-21T06:45:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.857+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c80b2ef0 con 0x7f92b0004800 2024-09-21T06:45:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.858+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c806f010 con 0x7f92b0004800 2024-09-21T06:45:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.859+0000 7f92b6ffd640 1 -- 172.21.15.81:0/2022247841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92b80038f0 con 0x7f92b0004800 2024-09-21T06:45:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.860+0000 7f92b6ffd640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f92a8078b90 0x7f92a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.860+0000 7f92b6ffd640 1 -- 172.21.15.81:0/2022247841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f92b809c880 con 0x7f92b0004800 2024-09-21T06:45:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.860+0000 7f92c5d9b640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f92a8078b90 0x7f92a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.861+0000 7f92c5d9b640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f92a8078b90 0x7f92a807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92bc033000 tx=0x7f92bc02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:27.865+0000 7f92b6ffd640 1 -- 172.21.15.81:0/2022247841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92b8064a10 con 0x7f92b0004800 2024-09-21T06:45:28.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.079+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f92c8071440 con 0x7f92b0004800 2024-09-21T06:45:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.730+0000 7f92b6ffd640 1 -- 172.21.15.81:0/2022247841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f92b8064310 con 0x7f92b0004800 2024-09-21T06:45:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f92a8078b90 msgr2=0x7f92a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f92a8078b90 0x7f92a807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92bc033000 tx=0x7f92bc02d000 comp rx=0 tx=0).stop 2024-09-21T06:45:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 msgr2=0x7f92c8146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92c8146cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92b800a4a0 tx=0x7f92b800a960 comp rx=0 tx=0).stop 2024-09-21T06:45:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 shutdown_connections 2024-09-21T06:45:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f92a8078b90 0x7f92a807b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c80b36f0 0x7f92c80b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c814ad20 0x7f92c81f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 --2- 172.21.15.81:0/2022247841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b0004800 0x7f92c8146cc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 >> 172.21.15.81:0/2022247841 conn(0x7f92c80740a0 msgr2=0x7f92c8068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 shutdown_connections 2024-09-21T06:45:28.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.733+0000 7f92cccf9640 1 -- 172.21.15.81:0/2022247841 wait complete. 2024-09-21T06:45:28.749 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:45:28.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 -- 172.21.15.81:0/2823431612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb52415c450 msgr2=0x7fb5240d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 --2- 172.21.15.81:0/2823431612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb52415c450 0x7fb5240d3220 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb520005fd0 tx=0x7fb52002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 -- 172.21.15.81:0/2823431612 shutdown_connections 2024-09-21T06:45:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 --2- 172.21.15.81:0/2823431612 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5240d41a0 0x7fb5240d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 --2- 172.21.15.81:0/2823431612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb52415c450 0x7fb5240d3220 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 -- 172.21.15.81:0/2823431612 >> 172.21.15.81:0/2823431612 conn(0x7fb5240b7330 msgr2=0x7fb5240b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 -- 172.21.15.81:0/2823431612 shutdown_connections 2024-09-21T06:45:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.864+0000 7fb52b16e640 1 -- 172.21.15.81:0/2823431612 wait complete. 2024-09-21T06:45:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.866+0000 7fb52b16e640 1 Processor -- start 2024-09-21T06:45:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.866+0000 7fb52b16e640 1 -- start start 2024-09-21T06:45:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52b16e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240d41a0 0x7fb5240cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:28.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52b16e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb52415c450 0x7fb5241599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52b16e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb52415eda0 0x7fb5241f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52b16e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5240b35c0 con 0x7fb5240d41a0 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52b16e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb5240b3440 con 0x7fb52415eda0 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52b16e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fb5240b3740 con 0x7fb52415c450 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240d41a0 0x7fb5240cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240d41a0 0x7fb5240cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54464/0 (socket says 172.21.15.81:54464) 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 -- 172.21.15.81:0/793906234 learned_addr learned my addr 172.21.15.81:0/793906234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb51bfff640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb52415c450 0x7fb5241599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52970b640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb52415eda0 0x7fb5241f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 -- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb52415c450 msgr2=0x7fb5241599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb52415c450 0x7fb5241599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 -- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb52415eda0 msgr2=0x7fb5241f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:28.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb52415eda0 0x7fb5241f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb528f0a640 1 -- 172.21.15.81:0/793906234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5241f9ac0 con 0x7fb5240d41a0 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb51bfff640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb52415c450 0x7fb5241599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.867+0000 7fb52970b640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb52415eda0 0x7fb5241f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.868+0000 7fb528f0a640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240d41a0 0x7fb5240cacf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb520006010 tx=0x7fb5200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.868+0000 7fb5197fa640 1 -- 172.21.15.81:0/793906234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52003e030 con 0x7fb5240d41a0 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.868+0000 7fb5197fa640 1 -- 172.21.15.81:0/793906234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb520003ca0 con 0x7fb5240d41a0 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.868+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5240cbaf0 con 0x7fb5240d41a0 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.868+0000 7fb5197fa640 1 -- 172.21.15.81:0/793906234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb520035040 con 0x7fb5240d41a0 2024-09-21T06:45:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.868+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5240cb530 con 0x7fb5240d41a0 2024-09-21T06:45:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.869+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52408d110 con 0x7fb5240d41a0 2024-09-21T06:45:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.870+0000 7fb5197fa640 1 -- 172.21.15.81:0/793906234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb520041030 con 0x7fb5240d41a0 2024-09-21T06:45:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.870+0000 7fb5197fa640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb510078bc0 0x7fb51007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.870+0000 7fb5197fa640 1 -- 172.21.15.81:0/793906234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb5200bb5a0 con 0x7fb5240d41a0 2024-09-21T06:45:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.870+0000 7fb51bfff640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb510078bc0 0x7fb51007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:28.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.871+0000 7fb51bfff640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb510078bc0 0x7fb51007b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5241f9060 tx=0x7fb514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:28.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:28.875+0000 7fb5197fa640 1 -- 172.21.15.81:0/793906234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb52408d110 con 0x7fb5240d41a0 2024-09-21T06:45:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.089+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5240d45b0 con 0x7fb5240d41a0 2024-09-21T06:45:29.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.090+0000 7fb5197fa640 1 -- 172.21.15.81:0/793906234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7fb5241f9ac0 con 0x7fb5240d41a0 2024-09-21T06:45:29.092 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:29.092 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:29.093 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb510078bc0 msgr2=0x7fb51007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb510078bc0 0x7fb51007b0d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb5241f9060 tx=0x7fb514009040 comp rx=0 tx=0).stop 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240d41a0 msgr2=0x7fb5240cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240d41a0 0x7fb5240cacf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb520006010 tx=0x7fb5200038a0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 shutdown_connections 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb510078bc0 0x7fb51007b0d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb52415c450 0x7fb5241599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb52415eda0 0x7fb5241f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 --2- 172.21.15.81:0/793906234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5240d41a0 0x7fb5240cacf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 >> 172.21.15.81:0/793906234 conn(0x7fb5240b7330 msgr2=0x7fb5240cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 shutdown_connections 2024-09-21T06:45:29.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.092+0000 7fb52b16e640 1 -- 172.21.15.81:0/793906234 wait complete. 2024-09-21T06:45:29.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:29.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 -- 172.21.15.81:0/1150680559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d00d41a0 msgr2=0x7f66d00d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1150680559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d00d41a0 0x7f66d00d45b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66d008d040 tx=0x7f66c802a560 comp rx=0 tx=0).stop 2024-09-21T06:45:29.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 -- 172.21.15.81:0/1150680559 shutdown_connections 2024-09-21T06:45:29.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1150680559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d00d41a0 0x7f66d00d45b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1150680559 >> v2:172.21.15.89:3300/0 conn(0x7f66d015c450 0x7f66d00d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 -- 172.21.15.81:0/1150680559 >> 172.21.15.81:0/1150680559 conn(0x7f66d00b7330 msgr2=0x7f66d00b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 -- 172.21.15.81:0/1150680559 shutdown_connections 2024-09-21T06:45:29.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.216+0000 7f66d71f1640 1 -- 172.21.15.81:0/1150680559 wait complete. 2024-09-21T06:45:29.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.218+0000 7f66d71f1640 1 Processor -- start 2024-09-21T06:45:29.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.218+0000 7f66d71f1640 1 -- start start 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d71f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66d00d41a0 0x7f66d0159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d71f1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66d015c450 0x7f66d0151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d71f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d015eda0 0x7f66d0151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d71f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00b35c0 con 0x7f66d015eda0 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d71f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00b3440 con 0x7f66d00d41a0 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d71f1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f66d00b3740 con 0x7f66d015c450 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d578e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d015eda0 0x7f66d0151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d578e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d015eda0 0x7f66d0151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54476/0 (socket says 172.21.15.81:54476) 2024-09-21T06:45:29.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d578e640 1 -- 172.21.15.81:0/1788746361 learned_addr learned my addr 172.21.15.81:0/1788746361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66d4f8d640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66d00d41a0 0x7f66d0159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.219+0000 7f66cffff640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66d015c450 0x7f66d0151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d578e640 1 -- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66d015c450 msgr2=0x7f66d0151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d578e640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66d015c450 0x7f66d0151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d578e640 1 -- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66d00d41a0 msgr2=0x7f66d0159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d578e640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66d00d41a0 0x7f66d0159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d578e640 1 -- 172.21.15.81:0/1788746361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d00b69c0 con 0x7f66d015eda0 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d578e640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d015eda0 0x7f66d0151590 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66c8034040 tx=0x7f66c8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66cd7fa640 1 -- 172.21.15.81:0/1788746361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c803e030 con 0x7f66d015eda0 2024-09-21T06:45:29.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66cd7fa640 1 -- 172.21.15.81:0/1788746361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66c8003e50 con 0x7f66d015eda0 2024-09-21T06:45:29.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d00b6ca0 con 0x7f66d015eda0 2024-09-21T06:45:29.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66cd7fa640 1 -- 172.21.15.81:0/1788746361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8035040 con 0x7f66d015eda0 2024-09-21T06:45:29.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.220+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d00ca430 con 0x7f66d015eda0 2024-09-21T06:45:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.221+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d008d110 con 0x7f66d015eda0 2024-09-21T06:45:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.222+0000 7f66cd7fa640 1 -- 172.21.15.81:0/1788746361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66c8041030 con 0x7f66d015eda0 2024-09-21T06:45:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.222+0000 7f66cd7fa640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078bc0 0x7f66bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.222+0000 7f66cd7fa640 1 -- 172.21.15.81:0/1788746361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f66c80bb780 con 0x7f66d015eda0 2024-09-21T06:45:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.223+0000 7f66d4f8d640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078bc0 0x7f66bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.223+0000 7f66d4f8d640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078bc0 0x7f66bc07b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66d008c9c0 tx=0x7f66c000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.227+0000 7f66cd7fa640 1 -- 172.21.15.81:0/1788746361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66d008d110 con 0x7f66d015eda0 2024-09-21T06:45:29.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.403+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66d00d45b0 con 0x7f66d015eda0 2024-09-21T06:45:29.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.404+0000 7f66cd7fa640 1 -- 172.21.15.81:0/1788746361 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f66c8083220 con 0x7f66d015eda0 2024-09-21T06:45:29.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:29.407 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:29.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078bc0 msgr2=0x7f66bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078bc0 0x7f66bc07b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66d008c9c0 tx=0x7f66c000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d015eda0 msgr2=0x7f66d0151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d015eda0 0x7f66d0151590 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66c8034040 tx=0x7f66c8003960 comp rx=0 tx=0).stop 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 shutdown_connections 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078bc0 0x7f66bc07b0d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66d015c450 0x7f66d0151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66d015eda0 0x7f66d0151590 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 --2- 172.21.15.81:0/1788746361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66d00d41a0 0x7f66d0159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 >> 172.21.15.81:0/1788746361 conn(0x7f66d00b7330 msgr2=0x7f66d0160d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 shutdown_connections 2024-09-21T06:45:29.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.406+0000 7f66d71f1640 1 -- 172.21.15.81:0/1788746361 wait complete. 2024-09-21T06:45:29.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:45:29.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:45:29.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/3965989376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 msgr2=0x7fbf340d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/3965989376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf340d41a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbf340b91a0 tx=0x7fbf2c02a820 comp rx=0 tx=0).stop 2024-09-21T06:45:29.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/3965989376 shutdown_connections 2024-09-21T06:45:29.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/3965989376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf340d41a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/3965989376 >> v2:172.21.15.89:3300/0 conn(0x7fbf340d3220 0x7fbf340b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/3965989376 >> 172.21.15.81:0/3965989376 conn(0x7fbf340b7330 msgr2=0x7fbf340b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/3965989376 shutdown_connections 2024-09-21T06:45:29.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.532+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/3965989376 wait complete. 2024-09-21T06:45:29.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.533+0000 7fbf3a5ba640 1 Processor -- start 2024-09-21T06:45:29.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.534+0000 7fbf3a5ba640 1 -- start start 2024-09-21T06:45:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf3a5ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf3406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf3a5ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf340d3220 0x7fbf34159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf3a5ba640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf3415c450 0x7fbf340cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf3a5ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf340b3440 con 0x7fbf340b9c00 2024-09-21T06:45:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf3a5ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbf340d4b40 con 0x7fbf340d3220 2024-09-21T06:45:29.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf3a5ba640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fbf340b35c0 con 0x7fbf3415c450 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf3406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf3406d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54482/0 (socket says 172.21.15.81:54482) 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 -- 172.21.15.81:0/4215296170 learned_addr learned my addr 172.21.15.81:0/4215296170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf38b57640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf3415c450 0x7fbf340cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf337fe640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf340d3220 0x7fbf34159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 -- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf3415c450 msgr2=0x7fbf340cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf3415c450 0x7fbf340cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 -- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf340d3220 msgr2=0x7fbf34159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf340d3220 0x7fbf34159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf33fff640 1 -- 172.21.15.81:0/4215296170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf340c7f90 con 0x7fbf340b9c00 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.535+0000 7fbf337fe640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf340d3220 0x7fbf34159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.536+0000 7fbf33fff640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf3406d7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400c3c0 tx=0x7fbf2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.536+0000 7fbf30ff9640 1 -- 172.21.15.81:0/4215296170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24017070 con 0x7fbf340b9c00 2024-09-21T06:45:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.536+0000 7fbf30ff9640 1 -- 172.21.15.81:0/4215296170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf240035f0 con 0x7fbf340b9c00 2024-09-21T06:45:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.536+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf340c8270 con 0x7fbf340b9c00 2024-09-21T06:45:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.536+0000 7fbf30ff9640 1 -- 172.21.15.81:0/4215296170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24003a20 con 0x7fbf340b9c00 2024-09-21T06:45:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.536+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf340c9c80 con 0x7fbf340b9c00 2024-09-21T06:45:29.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.537+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3408d110 con 0x7fbf340b9c00 2024-09-21T06:45:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.538+0000 7fbf30ff9640 1 -- 172.21.15.81:0/4215296170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf2401a070 con 0x7fbf340b9c00 2024-09-21T06:45:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.538+0000 7fbf30ff9640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf20078bc0 0x7fbf2007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.538+0000 7fbf30ff9640 1 -- 172.21.15.81:0/4215296170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbf2409a550 con 0x7fbf340b9c00 2024-09-21T06:45:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.539+0000 7fbf337fe640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf20078bc0 0x7fbf2007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.539+0000 7fbf337fe640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf20078bc0 0x7fbf2007b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf3415efd0 tx=0x7fbf28005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.542+0000 7fbf30ff9640 1 -- 172.21.15.81:0/4215296170 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbf3408d110 con 0x7fbf340b9c00 2024-09-21T06:45:29.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.717+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf340b3ae0 con 0x7fbf20078bc0 2024-09-21T06:45:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.724+0000 7fbf30ff9640 1 -- 172.21.15.81:0/4215296170 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332579 (secure 0 0 0) 0x7fbf340b3ae0 con 0x7fbf20078bc0 2024-09-21T06:45:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:29.731 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf20078bc0 msgr2=0x7fbf2007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf20078bc0 0x7fbf2007b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf3415efd0 tx=0x7fbf28005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 msgr2=0x7fbf3406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf3406d7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400c3c0 tx=0x7fbf2400c880 comp rx=0 tx=0).stop 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 shutdown_connections 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf20078bc0 0x7fbf2007b0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf3415c450 0x7fbf340cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf340d3220 0x7fbf34159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 --2- 172.21.15.81:0/4215296170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf340b9c00 0x7fbf3406d7a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 >> 172.21.15.81:0/4215296170 conn(0x7fbf340b7330 msgr2=0x7fbf3415fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 shutdown_connections 2024-09-21T06:45:29.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.728+0000 7fbf3a5ba640 1 -- 172.21.15.81:0/4215296170 wait complete. 2024-09-21T06:45:29.741 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-21T06:45:28.654047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":304,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2040010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.176790"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508468+0000","last_change":"2024-09-21T06:45:14.464339+0000","last_active":"2024-09-21T06:45:20.508468+0000","last_peered":"2024-09-21T06:45:20.508468+0000","last_clean":"2024-09-21T06:45:20.508468+0000","last_became_active":"2024-09-21T06:45:14.464012+0000","last_became_peered":"2024-09-21T06:45:14.464012+0000","last_unstale":"2024-09-21T06:45:20.508468+0000","last_undegraded":"2024-09-21T06:45:20.508468+0000","last_fullsized":"2024-09-21T06:45:20.508468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:36.925765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032175+0000","last_change":"2024-09-21T06:45:15.471510+0000","last_active":"2024-09-21T06:45:21.032175+0000","last_peered":"2024-09-21T06:45:21.032175+0000","last_clean":"2024-09-21T06:45:21.032175+0000","last_became_active":"2024-09-21T06:45:15.471143+0000","last_became_peered":"2024-09-21T06:45:15.471143+0000","last_unstale":"2024-09-21T06:45:21.032175+0000","last_undegraded":"2024-09-21T06:45:21.032175+0000","last_fullsized":"2024-09-21T06:45:21.032175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030689+0000","last_change":"2024-09-21T06:45:19.508650+0000","last_active":"2024-09-21T06:45:21.030689+0000","last_peered":"2024-09-21T06:45:21.030689+0000","last_clean":"2024-09-21T06:45:21.030689+0000","last_became_active":"2024-09-21T06:45:19.508068+0000","last_became_peered":"2024-09-21T06:45:19.508068+0000","last_unstale":"2024-09-21T06:45:21.030689+0000","last_undegraded":"2024-09-21T06:45:21.030689+0000","last_fullsized":"2024-09-21T06:45:21.030689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:00.812495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032318+0000","last_change":"2024-09-21T06:45:14.463510+0000","last_active":"2024-09-21T06:45:21.032318+0000","last_peered":"2024-09-21T06:45:21.032318+0000","last_clean":"2024-09-21T06:45:21.032318+0000","last_became_active":"2024-09-21T06:45:14.462560+0000","last_became_peered":"2024-09-21T06:45:14.462560+0000","last_unstale":"2024-09-21T06:45:21.032318+0000","last_undegraded":"2024-09-21T06:45:21.032318+0000","last_fullsized":"2024-09-21T06:45:21.032318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032076+0000","last_change":"2024-09-21T06:45:15.469206+0000","last_active":"2024-09-21T06:45:21.032076+0000","last_peered":"2024-09-21T06:45:21.032076+0000","last_clean":"2024-09-21T06:45:21.032076+0000","last_became_active":"2024-09-21T06:45:15.468852+0000","last_became_peered":"2024-09-21T06:45:15.468852+0000","last_unstale":"2024-09-21T06:45:21.032076+0000","last_undegraded":"2024-09-21T06:45:21.032076+0000","last_fullsized":"2024-09-21T06:45:21.032076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:53.718982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.029911+0000","last_change":"2024-09-21T06:45:19.499958+0000","last_active":"2024-09-21T06:45:21.029911+0000","last_peered":"2024-09-21T06:45:21.029911+0000","last_clean":"2024-09-21T06:45:21.029911+0000","last_became_active":"2024-09-21T06:45:19.498778+0000","last_became_peered":"2024-09-21T06:45:19.498778+0000","last_unstale":"2024-09-21T06:45:21.029911+0000","last_undegraded":"2024-09-21T06:45:21.029911+0000","last_fullsized":"2024-09-21T06:45:21.029911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:30.663232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031112+0000","last_change":"2024-09-21T06:45:14.467815+0000","last_active":"2024-09-21T06:45:21.031112+0000","last_peered":"2024-09-21T06:45:21.031112+0000","last_clean":"2024-09-21T06:45:21.031112+0000","last_became_active":"2024-09-21T06:45:14.467402+0000","last_became_peered":"2024-09-21T06:45:14.467402+0000","last_unstale":"2024-09-21T06:45:21.031112+0000","last_undegraded":"2024-09-21T06:45:21.031112+0000","last_fullsized":"2024-09-21T06:45:21.031112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032375+0000","last_change":"2024-09-21T06:45:15.472639+0000","last_active":"2024-09-21T06:45:21.032375+0000","last_peered":"2024-09-21T06:45:21.032375+0000","last_clean":"2024-09-21T06:45:21.032375+0000","last_became_active":"2024-09-21T06:45:15.472020+0000","last_became_peered":"2024-09-21T06:45:15.472020+0000","last_unstale":"2024-09-21T06:45:21.032375+0000","last_undegraded":"2024-09-21T06:45:21.032375+0000","last_fullsized":"2024-09-21T06:45:21.032375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031061+0000","last_change":"2024-09-21T06:45:19.506108+0000","last_active":"2024-09-21T06:45:21.031061+0000","last_peered":"2024-09-21T06:45:21.031061+0000","last_clean":"2024-09-21T06:45:21.031061+0000","last_became_active":"2024-09-21T06:45:19.505693+0000","last_became_peered":"2024-09-21T06:45:19.505693+0000","last_unstale":"2024-09-21T06:45:21.031061+0000","last_undegraded":"2024-09-21T06:45:21.031061+0000","last_fullsized":"2024-09-21T06:45:21.031061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:04.498857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031623+0000","last_change":"2024-09-21T06:45:14.468290+0000","last_active":"2024-09-21T06:45:21.031623+0000","last_peered":"2024-09-21T06:45:21.031623+0000","last_clean":"2024-09-21T06:45:21.031623+0000","last_became_active":"2024-09-21T06:45:14.466952+0000","last_became_peered":"2024-09-21T06:45:14.466952+0000","last_unstale":"2024-09-21T06:45:21.031623+0000","last_undegraded":"2024-09-21T06:45:21.031623+0000","last_fullsized":"2024-09-21T06:45:21.031623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506797+0000","last_change":"2024-09-21T06:45:15.478969+0000","last_active":"2024-09-21T06:45:20.506797+0000","last_peered":"2024-09-21T06:45:20.506797+0000","last_clean":"2024-09-21T06:45:20.506797+0000","last_became_active":"2024-09-21T06:45:15.478560+0000","last_became_peered":"2024-09-21T06:45:15.478560+0000","last_unstale":"2024-09-21T06:45:20.506797+0000","last_undegraded":"2024-09-21T06:45:20.506797+0000","last_fullsized":"2024-09-21T06:45:20.506797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030140+0000","last_change":"2024-09-21T06:45:19.501225+0000","last_active":"2024-09-21T06:45:21.030140+0000","last_peered":"2024-09-21T06:45:21.030140+0000","last_clean":"2024-09-21T06:45:21.030140+0000","last_became_active":"2024-09-21T06:45:19.500690+0000","last_became_peered":"2024-09-21T06:45:19.500690+0000","last_unstale":"2024-09-21T06:45:21.030140+0000","last_undegraded":"2024-09-21T06:45:21.030140+0000","last_fullsized":"2024-09-21T06:45:21.030140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:19.848228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506286+0000","last_change":"2024-09-21T06:45:15.464877+0000","last_active":"2024-09-21T06:45:20.506286+0000","last_peered":"2024-09-21T06:45:20.506286+0000","last_clean":"2024-09-21T06:45:20.506286+0000","last_became_active":"2024-09-21T06:45:15.464588+0000","last_became_peered":"2024-09-21T06:45:15.464588+0000","last_unstale":"2024-09-21T06:45:20.506286+0000","last_undegraded":"2024-09-21T06:45:20.506286+0000","last_fullsized":"2024-09-21T06:45:20.506286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:42.134939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506529+0000","last_change":"2024-09-21T06:45:14.467476+0000","last_active":"2024-09-21T06:45:20.506529+0000","last_peered":"2024-09-21T06:45:20.506529+0000","last_clean":"2024-09-21T06:45:20.506529+0000","last_became_active":"2024-09-21T06:45:14.466897+0000","last_became_peered":"2024-09-21T06:45:14.466897+0000","last_unstale":"2024-09-21T06:45:20.506529+0000","last_undegraded":"2024-09-21T06:45:20.506529+0000","last_fullsized":"2024-09-21T06:45:20.506529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:10.023372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506859+0000","last_change":"2024-09-21T06:45:19.498544+0000","last_active":"2024-09-21T06:45:20.506859+0000","last_peered":"2024-09-21T06:45:20.506859+0000","last_clean":"2024-09-21T06:45:20.506859+0000","last_became_active":"2024-09-21T06:45:19.497658+0000","last_became_peered":"2024-09-21T06:45:19.497658+0000","last_unstale":"2024-09-21T06:45:20.506859+0000","last_undegraded":"2024-09-21T06:45:20.506859+0000","last_fullsized":"2024-09-21T06:45:20.506859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:52.803324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031062+0000","last_change":"2024-09-21T06:45:15.468182+0000","last_active":"2024-09-21T06:45:21.031062+0000","last_peered":"2024-09-21T06:45:21.031062+0000","last_clean":"2024-09-21T06:45:21.031062+0000","last_became_active":"2024-09-21T06:45:15.467824+0000","last_became_peered":"2024-09-21T06:45:15.467824+0000","last_unstale":"2024-09-21T06:45:21.031062+0000","last_undegraded":"2024-09-21T06:45:21.031062+0000","last_fullsized":"2024-09-21T06:45:21.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508135+0000","last_change":"2024-09-21T06:45:14.466757+0000","last_active":"2024-09-21T06:45:20.508135+0000","last_peered":"2024-09-21T06:45:20.508135+0000","last_clean":"2024-09-21T06:45:20.508135+0000","last_became_active":"2024-09-21T06:45:14.466415+0000","last_became_peered":"2024-09-21T06:45:14.466415+0000","last_unstale":"2024-09-21T06:45:20.508135+0000","last_undegraded":"2024-09-21T06:45:20.508135+0000","last_fullsized":"2024-09-21T06:45:20.508135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:07.383477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031176+0000","last_change":"2024-09-21T06:45:19.499423+0000","last_active":"2024-09-21T06:45:21.031176+0000","last_peered":"2024-09-21T06:45:21.031176+0000","last_clean":"2024-09-21T06:45:21.031176+0000","last_became_active":"2024-09-21T06:45:19.498952+0000","last_became_peered":"2024-09-21T06:45:19.498952+0000","last_unstale":"2024-09-21T06:45:21.031176+0000","last_undegraded":"2024-09-21T06:45:21.031176+0000","last_fullsized":"2024-09-21T06:45:21.031176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508529+0000","last_change":"2024-09-21T06:45:15.466008+0000","last_active":"2024-09-21T06:45:20.508529+0000","last_peered":"2024-09-21T06:45:20.508529+0000","last_clean":"2024-09-21T06:45:20.508529+0000","last_became_active":"2024-09-21T06:45:15.465647+0000","last_became_peered":"2024-09-21T06:45:15.465647+0000","last_unstale":"2024-09-21T06:45:20.508529+0000","last_undegraded":"2024-09-21T06:45:20.508529+0000","last_fullsized":"2024-09-21T06:45:20.508529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:31.085363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507731+0000","last_change":"2024-09-21T06:45:14.469576+0000","last_active":"2024-09-21T06:45:20.507731+0000","last_peered":"2024-09-21T06:45:20.507731+0000","last_clean":"2024-09-21T06:45:20.507731+0000","last_became_active":"2024-09-21T06:45:14.469236+0000","last_became_peered":"2024-09-21T06:45:14.469236+0000","last_unstale":"2024-09-21T06:45:20.507731+0000","last_undegraded":"2024-09-21T06:45:20.507731+0000","last_fullsized":"2024-09-21T06:45:20.507731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:02.696088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032184+0000","last_change":"2024-09-21T06:45:19.510297+0000","last_active":"2024-09-21T06:45:21.032184+0000","last_peered":"2024-09-21T06:45:21.032184+0000","last_clean":"2024-09-21T06:45:21.032184+0000","last_became_active":"2024-09-21T06:45:19.509889+0000","last_became_peered":"2024-09-21T06:45:19.509889+0000","last_unstale":"2024-09-21T06:45:21.032184+0000","last_undegraded":"2024-09-21T06:45:21.032184+0000","last_fullsized":"2024-09-21T06:45:21.032184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:59.748038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506005+0000","last_change":"2024-09-21T06:45:15.464901+0000","last_active":"2024-09-21T06:45:20.506005+0000","last_peered":"2024-09-21T06:45:20.506005+0000","last_clean":"2024-09-21T06:45:20.506005+0000","last_became_active":"2024-09-21T06:45:15.464616+0000","last_became_peered":"2024-09-21T06:45:15.464616+0000","last_unstale":"2024-09-21T06:45:20.506005+0000","last_undegraded":"2024-09-21T06:45:20.506005+0000","last_fullsized":"2024-09-21T06:45:20.506005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030008+0000","last_change":"2024-09-21T06:45:14.469791+0000","last_active":"2024-09-21T06:45:21.030008+0000","last_peered":"2024-09-21T06:45:21.030008+0000","last_clean":"2024-09-21T06:45:21.030008+0000","last_became_active":"2024-09-21T06:45:14.469113+0000","last_became_peered":"2024-09-21T06:45:14.469113+0000","last_unstale":"2024-09-21T06:45:21.030008+0000","last_undegraded":"2024-09-21T06:45:21.030008+0000","last_fullsized":"2024-09-21T06:45:21.030008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030884+0000","last_change":"2024-09-21T06:45:19.503593+0000","last_active":"2024-09-21T06:45:21.030884+0000","last_peered":"2024-09-21T06:45:21.030884+0000","last_clean":"2024-09-21T06:45:21.030884+0000","last_became_active":"2024-09-21T06:45:19.503150+0000","last_became_peered":"2024-09-21T06:45:19.503150+0000","last_unstale":"2024-09-21T06:45:21.030884+0000","last_undegraded":"2024-09-21T06:45:21.030884+0000","last_fullsized":"2024-09-21T06:45:21.030884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.348456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507905+0000","last_change":"2024-09-21T06:45:15.464731+0000","last_active":"2024-09-21T06:45:20.507905+0000","last_peered":"2024-09-21T06:45:20.507905+0000","last_clean":"2024-09-21T06:45:20.507905+0000","last_became_active":"2024-09-21T06:45:15.464397+0000","last_became_peered":"2024-09-21T06:45:15.464397+0000","last_unstale":"2024-09-21T06:45:20.507905+0000","last_undegraded":"2024-09-21T06:45:20.507905+0000","last_fullsized":"2024-09-21T06:45:20.507905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:24.268833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507028+0000","last_change":"2024-09-21T06:45:14.463206+0000","last_active":"2024-09-21T06:45:20.507028+0000","last_peered":"2024-09-21T06:45:20.507028+0000","last_clean":"2024-09-21T06:45:20.507028+0000","last_became_active":"2024-09-21T06:45:14.462858+0000","last_became_peered":"2024-09-21T06:45:14.462858+0000","last_unstale":"2024-09-21T06:45:20.507028+0000","last_undegraded":"2024-09-21T06:45:20.507028+0000","last_fullsized":"2024-09-21T06:45:20.507028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:09.685089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030880+0000","last_change":"2024-09-21T06:45:19.504734+0000","last_active":"2024-09-21T06:45:21.030880+0000","last_peered":"2024-09-21T06:45:21.030880+0000","last_clean":"2024-09-21T06:45:21.030880+0000","last_became_active":"2024-09-21T06:45:19.504280+0000","last_became_peered":"2024-09-21T06:45:19.504280+0000","last_unstale":"2024-09-21T06:45:21.030880+0000","last_undegraded":"2024-09-21T06:45:21.030880+0000","last_fullsized":"2024-09-21T06:45:21.030880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:29.145421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508777+0000","last_change":"2024-09-21T06:45:15.470507+0000","last_active":"2024-09-21T06:45:20.508777+0000","last_peered":"2024-09-21T06:45:20.508777+0000","last_clean":"2024-09-21T06:45:20.508777+0000","last_became_active":"2024-09-21T06:45:15.470151+0000","last_became_peered":"2024-09-21T06:45:15.470151+0000","last_unstale":"2024-09-21T06:45:20.508777+0000","last_undegraded":"2024-09-21T06:45:20.508777+0000","last_fullsized":"2024-09-21T06:45:20.508777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:23.908138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508277+0000","last_change":"2024-09-21T06:45:14.463895+0000","last_active":"2024-09-21T06:45:20.508277+0000","last_peered":"2024-09-21T06:45:20.508277+0000","last_clean":"2024-09-21T06:45:20.508277+0000","last_became_active":"2024-09-21T06:45:14.463553+0000","last_became_peered":"2024-09-21T06:45:14.463553+0000","last_unstale":"2024-09-21T06:45:20.508277+0000","last_undegraded":"2024-09-21T06:45:20.508277+0000","last_fullsized":"2024-09-21T06:45:20.508277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:18.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508458+0000","last_change":"2024-09-21T06:45:19.501027+0000","last_active":"2024-09-21T06:45:20.508458+0000","last_peered":"2024-09-21T06:45:20.508458+0000","last_clean":"2024-09-21T06:45:20.508458+0000","last_became_active":"2024-09-21T06:45:19.500456+0000","last_became_peered":"2024-09-21T06:45:19.500456+0000","last_unstale":"2024-09-21T06:45:20.508458+0000","last_undegraded":"2024-09-21T06:45:20.508458+0000","last_fullsized":"2024-09-21T06:45:20.508458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:24.217258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509016+0000","last_change":"2024-09-21T06:45:15.475607+0000","last_active":"2024-09-21T06:45:20.509016+0000","last_peered":"2024-09-21T06:45:20.509016+0000","last_clean":"2024-09-21T06:45:20.509016+0000","last_became_active":"2024-09-21T06:45:15.475256+0000","last_became_peered":"2024-09-21T06:45:15.475256+0000","last_unstale":"2024-09-21T06:45:20.509016+0000","last_undegraded":"2024-09-21T06:45:20.509016+0000","last_fullsized":"2024-09-21T06:45:20.509016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:18.300400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507126+0000","last_change":"2024-09-21T06:45:14.463043+0000","last_active":"2024-09-21T06:45:20.507126+0000","last_peered":"2024-09-21T06:45:20.507126+0000","last_clean":"2024-09-21T06:45:20.507126+0000","last_became_active":"2024-09-21T06:45:14.462253+0000","last_became_peered":"2024-09-21T06:45:14.462253+0000","last_unstale":"2024-09-21T06:45:20.507126+0000","last_undegraded":"2024-09-21T06:45:20.507126+0000","last_fullsized":"2024-09-21T06:45:20.507126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508325+0000","last_change":"2024-09-21T06:45:19.499431+0000","last_active":"2024-09-21T06:45:20.508325+0000","last_peered":"2024-09-21T06:45:20.508325+0000","last_clean":"2024-09-21T06:45:20.508325+0000","last_became_active":"2024-09-21T06:45:19.498990+0000","last_became_peered":"2024-09-21T06:45:19.498990+0000","last_unstale":"2024-09-21T06:45:20.508325+0000","last_undegraded":"2024-09-21T06:45:20.508325+0000","last_fullsized":"2024-09-21T06:45:20.508325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:22.135690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030357+0000","last_change":"2024-09-21T06:45:15.476862+0000","last_active":"2024-09-21T06:45:21.030357+0000","last_peered":"2024-09-21T06:45:21.030357+0000","last_clean":"2024-09-21T06:45:21.030357+0000","last_became_active":"2024-09-21T06:45:15.476545+0000","last_became_peered":"2024-09-21T06:45:15.476545+0000","last_unstale":"2024-09-21T06:45:21.030357+0000","last_undegraded":"2024-09-21T06:45:21.030357+0000","last_fullsized":"2024-09-21T06:45:21.030357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031479+0000","last_change":"2024-09-21T06:45:14.465001+0000","last_active":"2024-09-21T06:45:21.031479+0000","last_peered":"2024-09-21T06:45:21.031479+0000","last_clean":"2024-09-21T06:45:21.031479+0000","last_became_active":"2024-09-21T06:45:14.463300+0000","last_became_peered":"2024-09-21T06:45:14.463300+0000","last_unstale":"2024-09-21T06:45:21.031479+0000","last_undegraded":"2024-09-21T06:45:21.031479+0000","last_fullsized":"2024-09-21T06:45:21.031479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508546+0000","last_change":"2024-09-21T06:45:19.504273+0000","last_active":"2024-09-21T06:45:20.508546+0000","last_peered":"2024-09-21T06:45:20.508546+0000","last_clean":"2024-09-21T06:45:20.508546+0000","last_became_active":"2024-09-21T06:45:19.503505+0000","last_became_peered":"2024-09-21T06:45:19.503505+0000","last_unstale":"2024-09-21T06:45:20.508546+0000","last_undegraded":"2024-09-21T06:45:20.508546+0000","last_fullsized":"2024-09-21T06:45:20.508546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:17.053992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030362+0000","last_change":"2024-09-21T06:45:15.478404+0000","last_active":"2024-09-21T06:45:21.030362+0000","last_peered":"2024-09-21T06:45:21.030362+0000","last_clean":"2024-09-21T06:45:21.030362+0000","last_became_active":"2024-09-21T06:45:15.478121+0000","last_became_peered":"2024-09-21T06:45:15.478121+0000","last_unstale":"2024-09-21T06:45:21.030362+0000","last_undegraded":"2024-09-21T06:45:21.030362+0000","last_fullsized":"2024-09-21T06:45:21.030362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506726+0000","last_change":"2024-09-21T06:45:14.465807+0000","last_active":"2024-09-21T06:45:20.506726+0000","last_peered":"2024-09-21T06:45:20.506726+0000","last_clean":"2024-09-21T06:45:20.506726+0000","last_became_active":"2024-09-21T06:45:14.464509+0000","last_became_peered":"2024-09-21T06:45:14.464509+0000","last_unstale":"2024-09-21T06:45:20.506726+0000","last_undegraded":"2024-09-21T06:45:20.506726+0000","last_fullsized":"2024-09-21T06:45:20.506726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508935+0000","last_change":"2024-09-21T06:45:19.504015+0000","last_active":"2024-09-21T06:45:20.508935+0000","last_peered":"2024-09-21T06:45:20.508935+0000","last_clean":"2024-09-21T06:45:20.508935+0000","last_became_active":"2024-09-21T06:45:19.503577+0000","last_became_peered":"2024-09-21T06:45:19.503577+0000","last_unstale":"2024-09-21T06:45:20.508935+0000","last_undegraded":"2024-09-21T06:45:20.508935+0000","last_fullsized":"2024-09-21T06:45:20.508935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030571+0000","last_change":"2024-09-21T06:45:15.474182+0000","last_active":"2024-09-21T06:45:21.030571+0000","last_peered":"2024-09-21T06:45:21.030571+0000","last_clean":"2024-09-21T06:45:21.030571+0000","last_became_active":"2024-09-21T06:45:15.473818+0000","last_became_peered":"2024-09-21T06:45:15.473818+0000","last_unstale":"2024-09-21T06:45:21.030571+0000","last_undegraded":"2024-09-21T06:45:21.030571+0000","last_fullsized":"2024-09-21T06:45:21.030571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030836+0000","last_change":"2024-09-21T06:45:14.469718+0000","last_active":"2024-09-21T06:45:21.030836+0000","last_peered":"2024-09-21T06:45:21.030836+0000","last_clean":"2024-09-21T06:45:21.030836+0000","last_became_active":"2024-09-21T06:45:14.469379+0000","last_became_peered":"2024-09-21T06:45:14.469379+0000","last_unstale":"2024-09-21T06:45:21.030836+0000","last_undegraded":"2024-09-21T06:45:21.030836+0000","last_fullsized":"2024-09-21T06:45:21.030836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507427+0000","last_change":"2024-09-21T06:45:19.496958+0000","last_active":"2024-09-21T06:45:20.507427+0000","last_peered":"2024-09-21T06:45:20.507427+0000","last_clean":"2024-09-21T06:45:20.507427+0000","last_became_active":"2024-09-21T06:45:19.496555+0000","last_became_peered":"2024-09-21T06:45:19.496555+0000","last_unstale":"2024-09-21T06:45:20.507427+0000","last_undegraded":"2024-09-21T06:45:20.507427+0000","last_fullsized":"2024-09-21T06:45:20.507427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:44.406905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506844+0000","last_change":"2024-09-21T06:45:15.472140+0000","last_active":"2024-09-21T06:45:20.506844+0000","last_peered":"2024-09-21T06:45:20.506844+0000","last_clean":"2024-09-21T06:45:20.506844+0000","last_became_active":"2024-09-21T06:45:15.471806+0000","last_became_peered":"2024-09-21T06:45:15.471806+0000","last_unstale":"2024-09-21T06:45:20.506844+0000","last_undegraded":"2024-09-21T06:45:20.506844+0000","last_fullsized":"2024-09-21T06:45:20.506844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:23.439120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506380+0000","last_change":"2024-09-21T06:45:14.469896+0000","last_active":"2024-09-21T06:45:20.506380+0000","last_peered":"2024-09-21T06:45:20.506380+0000","last_clean":"2024-09-21T06:45:20.506380+0000","last_became_active":"2024-09-21T06:45:14.469577+0000","last_became_peered":"2024-09-21T06:45:14.469577+0000","last_unstale":"2024-09-21T06:45:20.506380+0000","last_undegraded":"2024-09-21T06:45:20.506380+0000","last_fullsized":"2024-09-21T06:45:20.506380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031840+0000","last_change":"2024-09-21T06:45:19.500636+0000","last_active":"2024-09-21T06:45:21.031840+0000","last_peered":"2024-09-21T06:45:21.031840+0000","last_clean":"2024-09-21T06:45:21.031840+0000","last_became_active":"2024-09-21T06:45:19.500192+0000","last_became_peered":"2024-09-21T06:45:19.500192+0000","last_unstale":"2024-09-21T06:45:21.031840+0000","last_undegraded":"2024-09-21T06:45:21.031840+0000","last_fullsized":"2024-09-21T06:45:21.031840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.980314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507558+0000","last_change":"2024-09-21T06:45:15.472278+0000","last_active":"2024-09-21T06:45:20.507558+0000","last_peered":"2024-09-21T06:45:20.507558+0000","last_clean":"2024-09-21T06:45:20.507558+0000","last_became_active":"2024-09-21T06:45:15.471284+0000","last_became_peered":"2024-09-21T06:45:15.471284+0000","last_unstale":"2024-09-21T06:45:20.507558+0000","last_undegraded":"2024-09-21T06:45:20.507558+0000","last_fullsized":"2024-09-21T06:45:20.507558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:55.552947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506692+0000","last_change":"2024-09-21T06:45:14.467169+0000","last_active":"2024-09-21T06:45:20.506692+0000","last_peered":"2024-09-21T06:45:20.506692+0000","last_clean":"2024-09-21T06:45:20.506692+0000","last_became_active":"2024-09-21T06:45:14.466525+0000","last_became_peered":"2024-09-21T06:45:14.466525+0000","last_unstale":"2024-09-21T06:45:20.506692+0000","last_undegraded":"2024-09-21T06:45:20.506692+0000","last_fullsized":"2024-09-21T06:45:20.506692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:45.167373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032068+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:45:21.032068+0000","last_peered":"2024-09-21T06:45:21.032068+0000","last_clean":"2024-09-21T06:45:21.032068+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:45:21.032068+0000","last_undegraded":"2024-09-21T06:45:21.032068+0000","last_fullsized":"2024-09-21T06:45:21.032068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507129+0000","last_change":"2024-09-21T06:45:19.497733+0000","last_active":"2024-09-21T06:45:20.507129+0000","last_peered":"2024-09-21T06:45:20.507129+0000","last_clean":"2024-09-21T06:45:20.507129+0000","last_became_active":"2024-09-21T06:45:19.496641+0000","last_became_peered":"2024-09-21T06:45:19.496641+0000","last_unstale":"2024-09-21T06:45:20.507129+0000","last_undegraded":"2024-09-21T06:45:20.507129+0000","last_fullsized":"2024-09-21T06:45:20.507129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:51.619714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506921+0000","last_change":"2024-09-21T06:45:15.461030+0000","last_active":"2024-09-21T06:45:20.506921+0000","last_peered":"2024-09-21T06:45:20.506921+0000","last_clean":"2024-09-21T06:45:20.506921+0000","last_became_active":"2024-09-21T06:45:15.460706+0000","last_became_peered":"2024-09-21T06:45:15.460706+0000","last_unstale":"2024-09-21T06:45:20.506921+0000","last_undegraded":"2024-09-21T06:45:20.506921+0000","last_fullsized":"2024-09-21T06:45:20.506921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.152926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509104+0000","last_change":"2024-09-21T06:45:14.461396+0000","last_active":"2024-09-21T06:45:20.509104+0000","last_peered":"2024-09-21T06:45:20.509104+0000","last_clean":"2024-09-21T06:45:20.509104+0000","last_became_active":"2024-09-21T06:45:14.461060+0000","last_became_peered":"2024-09-21T06:45:14.461060+0000","last_unstale":"2024-09-21T06:45:20.509104+0000","last_undegraded":"2024-09-21T06:45:20.509104+0000","last_fullsized":"2024-09-21T06:45:20.509104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:55.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030371+0000","last_change":"2024-09-21T06:45:19.502382+0000","last_active":"2024-09-21T06:45:21.030371+0000","last_peered":"2024-09-21T06:45:21.030371+0000","last_clean":"2024-09-21T06:45:21.030371+0000","last_became_active":"2024-09-21T06:45:19.498046+0000","last_became_peered":"2024-09-21T06:45:19.498046+0000","last_unstale":"2024-09-21T06:45:21.030371+0000","last_undegraded":"2024-09-21T06:45:21.030371+0000","last_fullsized":"2024-09-21T06:45:21.030371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:24.671126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031519+0000","last_change":"2024-09-21T06:45:15.475752+0000","last_active":"2024-09-21T06:45:21.031519+0000","last_peered":"2024-09-21T06:45:21.031519+0000","last_clean":"2024-09-21T06:45:21.031519+0000","last_became_active":"2024-09-21T06:45:15.469527+0000","last_became_peered":"2024-09-21T06:45:15.469527+0000","last_unstale":"2024-09-21T06:45:21.031519+0000","last_undegraded":"2024-09-21T06:45:21.031519+0000","last_fullsized":"2024-09-21T06:45:21.031519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031784+0000","last_change":"2024-09-21T06:45:14.465420+0000","last_active":"2024-09-21T06:45:21.031784+0000","last_peered":"2024-09-21T06:45:21.031784+0000","last_clean":"2024-09-21T06:45:21.031784+0000","last_became_active":"2024-09-21T06:45:14.464543+0000","last_became_peered":"2024-09-21T06:45:14.464543+0000","last_unstale":"2024-09-21T06:45:21.031784+0000","last_undegraded":"2024-09-21T06:45:21.031784+0000","last_fullsized":"2024-09-21T06:45:21.031784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031628+0000","last_change":"2024-09-21T06:45:19.498221+0000","last_active":"2024-09-21T06:45:21.031628+0000","last_peered":"2024-09-21T06:45:21.031628+0000","last_clean":"2024-09-21T06:45:21.031628+0000","last_became_active":"2024-09-21T06:45:19.497811+0000","last_became_peered":"2024-09-21T06:45:19.497811+0000","last_unstale":"2024-09-21T06:45:21.031628+0000","last_undegraded":"2024-09-21T06:45:21.031628+0000","last_fullsized":"2024-09-21T06:45:21.031628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030455+0000","last_change":"2024-09-21T06:45:15.460768+0000","last_active":"2024-09-21T06:45:21.030455+0000","last_peered":"2024-09-21T06:45:21.030455+0000","last_clean":"2024-09-21T06:45:21.030455+0000","last_became_active":"2024-09-21T06:45:15.460450+0000","last_became_peered":"2024-09-21T06:45:15.460450+0000","last_unstale":"2024-09-21T06:45:21.030455+0000","last_undegraded":"2024-09-21T06:45:21.030455+0000","last_fullsized":"2024-09-21T06:45:21.030455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508036+0000","last_change":"2024-09-21T06:45:14.470579+0000","last_active":"2024-09-21T06:45:20.508036+0000","last_peered":"2024-09-21T06:45:20.508036+0000","last_clean":"2024-09-21T06:45:20.508036+0000","last_became_active":"2024-09-21T06:45:14.470201+0000","last_became_peered":"2024-09-21T06:45:14.470201+0000","last_unstale":"2024-09-21T06:45:20.508036+0000","last_undegraded":"2024-09-21T06:45:20.508036+0000","last_fullsized":"2024-09-21T06:45:20.508036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.320663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505901+0000","last_change":"2024-09-21T06:45:19.495223+0000","last_active":"2024-09-21T06:45:20.505901+0000","last_peered":"2024-09-21T06:45:20.505901+0000","last_clean":"2024-09-21T06:45:20.505901+0000","last_became_active":"2024-09-21T06:45:19.494717+0000","last_became_peered":"2024-09-21T06:45:19.494717+0000","last_unstale":"2024-09-21T06:45:20.505901+0000","last_undegraded":"2024-09-21T06:45:20.505901+0000","last_fullsized":"2024-09-21T06:45:20.505901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:24.234212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031148+0000","last_change":"2024-09-21T06:45:15.470009+0000","last_active":"2024-09-21T06:45:21.031148+0000","last_peered":"2024-09-21T06:45:21.031148+0000","last_clean":"2024-09-21T06:45:21.031148+0000","last_became_active":"2024-09-21T06:45:15.469587+0000","last_became_peered":"2024-09-21T06:45:15.469587+0000","last_unstale":"2024-09-21T06:45:21.031148+0000","last_undegraded":"2024-09-21T06:45:21.031148+0000","last_fullsized":"2024-09-21T06:45:21.031148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030553+0000","last_change":"2024-09-21T06:45:14.462600+0000","last_active":"2024-09-21T06:45:21.030553+0000","last_peered":"2024-09-21T06:45:21.030553+0000","last_clean":"2024-09-21T06:45:21.030553+0000","last_became_active":"2024-09-21T06:45:14.461889+0000","last_became_peered":"2024-09-21T06:45:14.461889+0000","last_unstale":"2024-09-21T06:45:21.030553+0000","last_undegraded":"2024-09-21T06:45:21.030553+0000","last_fullsized":"2024-09-21T06:45:21.030553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032139+0000","last_change":"2024-09-21T06:45:19.506001+0000","last_active":"2024-09-21T06:45:21.032139+0000","last_peered":"2024-09-21T06:45:21.032139+0000","last_clean":"2024-09-21T06:45:21.032139+0000","last_became_active":"2024-09-21T06:45:19.505578+0000","last_became_peered":"2024-09-21T06:45:19.505578+0000","last_unstale":"2024-09-21T06:45:21.032139+0000","last_undegraded":"2024-09-21T06:45:21.032139+0000","last_fullsized":"2024-09-21T06:45:21.032139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:57.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505958+0000","last_change":"2024-09-21T06:45:15.471185+0000","last_active":"2024-09-21T06:45:20.505958+0000","last_peered":"2024-09-21T06:45:20.505958+0000","last_clean":"2024-09-21T06:45:20.505958+0000","last_became_active":"2024-09-21T06:45:15.470821+0000","last_became_peered":"2024-09-21T06:45:15.470821+0000","last_unstale":"2024-09-21T06:45:20.505958+0000","last_undegraded":"2024-09-21T06:45:20.505958+0000","last_fullsized":"2024-09-21T06:45:20.505958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508648+0000","last_change":"2024-09-21T06:45:14.463644+0000","last_active":"2024-09-21T06:45:20.508648+0000","last_peered":"2024-09-21T06:45:20.508648+0000","last_clean":"2024-09-21T06:45:20.508648+0000","last_became_active":"2024-09-21T06:45:14.463293+0000","last_became_peered":"2024-09-21T06:45:14.463293+0000","last_unstale":"2024-09-21T06:45:20.508648+0000","last_undegraded":"2024-09-21T06:45:20.508648+0000","last_fullsized":"2024-09-21T06:45:20.508648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:29.580518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032313+0000","last_change":"2024-09-21T06:45:19.499445+0000","last_active":"2024-09-21T06:45:21.032313+0000","last_peered":"2024-09-21T06:45:21.032313+0000","last_clean":"2024-09-21T06:45:21.032313+0000","last_became_active":"2024-09-21T06:45:19.499033+0000","last_became_peered":"2024-09-21T06:45:19.499033+0000","last_unstale":"2024-09-21T06:45:21.032313+0000","last_undegraded":"2024-09-21T06:45:21.032313+0000","last_fullsized":"2024-09-21T06:45:21.032313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:39.968433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031953+0000","last_change":"2024-09-21T06:45:15.462244+0000","last_active":"2024-09-21T06:45:21.031953+0000","last_peered":"2024-09-21T06:45:21.031953+0000","last_clean":"2024-09-21T06:45:21.031953+0000","last_became_active":"2024-09-21T06:45:15.461962+0000","last_became_peered":"2024-09-21T06:45:15.461962+0000","last_unstale":"2024-09-21T06:45:21.031953+0000","last_undegraded":"2024-09-21T06:45:21.031953+0000","last_fullsized":"2024-09-21T06:45:21.031953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030514+0000","last_change":"2024-09-21T06:45:14.458035+0000","last_active":"2024-09-21T06:45:21.030514+0000","last_peered":"2024-09-21T06:45:21.030514+0000","last_clean":"2024-09-21T06:45:21.030514+0000","last_became_active":"2024-09-21T06:45:14.457478+0000","last_became_peered":"2024-09-21T06:45:14.457478+0000","last_unstale":"2024-09-21T06:45:21.030514+0000","last_undegraded":"2024-09-21T06:45:21.030514+0000","last_fullsized":"2024-09-21T06:45:21.030514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:46.341816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032245+0000","last_change":"2024-09-21T06:45:19.496692+0000","last_active":"2024-09-21T06:45:21.032245+0000","last_peered":"2024-09-21T06:45:21.032245+0000","last_clean":"2024-09-21T06:45:21.032245+0000","last_became_active":"2024-09-21T06:45:19.496273+0000","last_became_peered":"2024-09-21T06:45:19.496273+0000","last_unstale":"2024-09-21T06:45:21.032245+0000","last_undegraded":"2024-09-21T06:45:21.032245+0000","last_fullsized":"2024-09-21T06:45:21.032245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:08.738093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506263+0000","last_change":"2024-09-21T06:45:15.474239+0000","last_active":"2024-09-21T06:45:20.506263+0000","last_peered":"2024-09-21T06:45:20.506263+0000","last_clean":"2024-09-21T06:45:20.506263+0000","last_became_active":"2024-09-21T06:45:15.473936+0000","last_became_peered":"2024-09-21T06:45:15.473936+0000","last_unstale":"2024-09-21T06:45:20.506263+0000","last_undegraded":"2024-09-21T06:45:20.506263+0000","last_fullsized":"2024-09-21T06:45:20.506263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:07.138927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506611+0000","last_change":"2024-09-21T06:45:14.465782+0000","last_active":"2024-09-21T06:45:20.506611+0000","last_peered":"2024-09-21T06:45:20.506611+0000","last_clean":"2024-09-21T06:45:20.506611+0000","last_became_active":"2024-09-21T06:45:14.464892+0000","last_became_peered":"2024-09-21T06:45:14.464892+0000","last_unstale":"2024-09-21T06:45:20.506611+0000","last_undegraded":"2024-09-21T06:45:20.506611+0000","last_fullsized":"2024-09-21T06:45:20.506611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508817+0000","last_change":"2024-09-21T06:45:19.496653+0000","last_active":"2024-09-21T06:45:20.508817+0000","last_peered":"2024-09-21T06:45:20.508817+0000","last_clean":"2024-09-21T06:45:20.508817+0000","last_became_active":"2024-09-21T06:45:19.496215+0000","last_became_peered":"2024-09-21T06:45:19.496215+0000","last_unstale":"2024-09-21T06:45:20.508817+0000","last_undegraded":"2024-09-21T06:45:20.508817+0000","last_fullsized":"2024-09-21T06:45:20.508817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507938+0000","last_change":"2024-09-21T06:45:15.468032+0000","last_active":"2024-09-21T06:45:20.507938+0000","last_peered":"2024-09-21T06:45:20.507938+0000","last_clean":"2024-09-21T06:45:20.507938+0000","last_became_active":"2024-09-21T06:45:15.467695+0000","last_became_peered":"2024-09-21T06:45:15.467695+0000","last_unstale":"2024-09-21T06:45:20.507938+0000","last_undegraded":"2024-09-21T06:45:20.507938+0000","last_fullsized":"2024-09-21T06:45:20.507938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:48.275548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031757+0000","last_change":"2024-09-21T06:45:14.472291+0000","last_active":"2024-09-21T06:45:21.031757+0000","last_peered":"2024-09-21T06:45:21.031757+0000","last_clean":"2024-09-21T06:45:21.031757+0000","last_became_active":"2024-09-21T06:45:14.472043+0000","last_became_peered":"2024-09-21T06:45:14.472043+0000","last_unstale":"2024-09-21T06:45:21.031757+0000","last_undegraded":"2024-09-21T06:45:21.031757+0000","last_fullsized":"2024-09-21T06:45:21.031757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506551+0000","last_change":"2024-09-21T06:45:19.499994+0000","last_active":"2024-09-21T06:45:20.506551+0000","last_peered":"2024-09-21T06:45:20.506551+0000","last_clean":"2024-09-21T06:45:20.506551+0000","last_became_active":"2024-09-21T06:45:19.497222+0000","last_became_peered":"2024-09-21T06:45:19.497222+0000","last_unstale":"2024-09-21T06:45:20.506551+0000","last_undegraded":"2024-09-21T06:45:20.506551+0000","last_fullsized":"2024-09-21T06:45:20.506551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:50.997451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030936+0000","last_change":"2024-09-21T06:45:15.477441+0000","last_active":"2024-09-21T06:45:21.030936+0000","last_peered":"2024-09-21T06:45:21.030936+0000","last_clean":"2024-09-21T06:45:21.030936+0000","last_became_active":"2024-09-21T06:45:15.477115+0000","last_became_peered":"2024-09-21T06:45:15.477115+0000","last_unstale":"2024-09-21T06:45:21.030936+0000","last_undegraded":"2024-09-21T06:45:21.030936+0000","last_fullsized":"2024-09-21T06:45:21.030936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031065+0000","last_change":"2024-09-21T06:45:14.469539+0000","last_active":"2024-09-21T06:45:21.031065+0000","last_peered":"2024-09-21T06:45:21.031065+0000","last_clean":"2024-09-21T06:45:21.031065+0000","last_became_active":"2024-09-21T06:45:14.469221+0000","last_became_peered":"2024-09-21T06:45:14.469221+0000","last_unstale":"2024-09-21T06:45:21.031065+0000","last_undegraded":"2024-09-21T06:45:21.031065+0000","last_fullsized":"2024-09-21T06:45:21.031065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:28.598849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507385+0000","last_change":"2024-09-21T06:45:19.506781+0000","last_active":"2024-09-21T06:45:20.507385+0000","last_peered":"2024-09-21T06:45:20.507385+0000","last_clean":"2024-09-21T06:45:20.507385+0000","last_became_active":"2024-09-21T06:45:19.501911+0000","last_became_peered":"2024-09-21T06:45:19.501911+0000","last_unstale":"2024-09-21T06:45:20.507385+0000","last_undegraded":"2024-09-21T06:45:20.507385+0000","last_fullsized":"2024-09-21T06:45:20.507385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506203+0000","last_change":"2024-09-21T06:45:15.468579+0000","last_active":"2024-09-21T06:45:20.506203+0000","last_peered":"2024-09-21T06:45:20.506203+0000","last_clean":"2024-09-21T06:45:20.506203+0000","last_became_active":"2024-09-21T06:45:15.468329+0000","last_became_peered":"2024-09-21T06:45:15.468329+0000","last_unstale":"2024-09-21T06:45:20.506203+0000","last_undegraded":"2024-09-21T06:45:20.506203+0000","last_fullsized":"2024-09-21T06:45:20.506203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:07.302209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032248+0000","last_change":"2024-09-21T06:45:14.469511+0000","last_active":"2024-09-21T06:45:21.032248+0000","last_peered":"2024-09-21T06:45:21.032248+0000","last_clean":"2024-09-21T06:45:21.032248+0000","last_became_active":"2024-09-21T06:45:14.469153+0000","last_became_peered":"2024-09-21T06:45:14.469153+0000","last_unstale":"2024-09-21T06:45:21.032248+0000","last_undegraded":"2024-09-21T06:45:21.032248+0000","last_fullsized":"2024-09-21T06:45:21.032248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:21.542258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030751+0000","last_change":"2024-09-21T06:45:19.506219+0000","last_active":"2024-09-21T06:45:21.030751+0000","last_peered":"2024-09-21T06:45:21.030751+0000","last_clean":"2024-09-21T06:45:21.030751+0000","last_became_active":"2024-09-21T06:45:19.505827+0000","last_became_peered":"2024-09-21T06:45:19.505827+0000","last_unstale":"2024-09-21T06:45:21.030751+0000","last_undegraded":"2024-09-21T06:45:21.030751+0000","last_fullsized":"2024-09-21T06:45:21.030751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:15.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032207+0000","last_change":"2024-09-21T06:45:15.467787+0000","last_active":"2024-09-21T06:45:21.032207+0000","last_peered":"2024-09-21T06:45:21.032207+0000","last_clean":"2024-09-21T06:45:21.032207+0000","last_became_active":"2024-09-21T06:45:15.467470+0000","last_became_peered":"2024-09-21T06:45:15.467470+0000","last_unstale":"2024-09-21T06:45:21.032207+0000","last_undegraded":"2024-09-21T06:45:21.032207+0000","last_fullsized":"2024-09-21T06:45:21.032207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030710+0000","last_change":"2024-09-21T06:45:14.466812+0000","last_active":"2024-09-21T06:45:21.030710+0000","last_peered":"2024-09-21T06:45:21.030710+0000","last_clean":"2024-09-21T06:45:21.030710+0000","last_became_active":"2024-09-21T06:45:14.466356+0000","last_became_peered":"2024-09-21T06:45:14.466356+0000","last_unstale":"2024-09-21T06:45:21.030710+0000","last_undegraded":"2024-09-21T06:45:21.030710+0000","last_fullsized":"2024-09-21T06:45:21.030710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030568+0000","last_change":"2024-09-21T06:45:19.504492+0000","last_active":"2024-09-21T06:45:21.030568+0000","last_peered":"2024-09-21T06:45:21.030568+0000","last_clean":"2024-09-21T06:45:21.030568+0000","last_became_active":"2024-09-21T06:45:19.503845+0000","last_became_peered":"2024-09-21T06:45:19.503845+0000","last_unstale":"2024-09-21T06:45:21.030568+0000","last_undegraded":"2024-09-21T06:45:21.030568+0000","last_fullsized":"2024-09-21T06:45:21.030568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:50.206431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031079+0000","last_change":"2024-09-21T06:45:15.467027+0000","last_active":"2024-09-21T06:45:21.031079+0000","last_peered":"2024-09-21T06:45:21.031079+0000","last_clean":"2024-09-21T06:45:21.031079+0000","last_became_active":"2024-09-21T06:45:15.466419+0000","last_became_peered":"2024-09-21T06:45:15.466419+0000","last_unstale":"2024-09-21T06:45:21.031079+0000","last_undegraded":"2024-09-21T06:45:21.031079+0000","last_fullsized":"2024-09-21T06:45:21.031079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032027+0000","last_change":"2024-09-21T06:45:14.467184+0000","last_active":"2024-09-21T06:45:21.032027+0000","last_peered":"2024-09-21T06:45:21.032027+0000","last_clean":"2024-09-21T06:45:21.032027+0000","last_became_active":"2024-09-21T06:45:14.466888+0000","last_became_peered":"2024-09-21T06:45:14.466888+0000","last_unstale":"2024-09-21T06:45:21.032027+0000","last_undegraded":"2024-09-21T06:45:21.032027+0000","last_fullsized":"2024-09-21T06:45:21.032027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:14.862437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507441+0000","last_change":"2024-09-21T06:45:19.502432+0000","last_active":"2024-09-21T06:45:20.507441+0000","last_peered":"2024-09-21T06:45:20.507441+0000","last_clean":"2024-09-21T06:45:20.507441+0000","last_became_active":"2024-09-21T06:45:19.501859+0000","last_became_peered":"2024-09-21T06:45:19.501859+0000","last_unstale":"2024-09-21T06:45:20.507441+0000","last_undegraded":"2024-09-21T06:45:20.507441+0000","last_fullsized":"2024-09-21T06:45:20.507441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507823+0000","last_change":"2024-09-21T06:45:19.500757+0000","last_active":"2024-09-21T06:45:20.507823+0000","last_peered":"2024-09-21T06:45:20.507823+0000","last_clean":"2024-09-21T06:45:20.507823+0000","last_became_active":"2024-09-21T06:45:19.500330+0000","last_became_peered":"2024-09-21T06:45:19.500330+0000","last_unstale":"2024-09-21T06:45:20.507823+0000","last_undegraded":"2024-09-21T06:45:20.507823+0000","last_fullsized":"2024-09-21T06:45:20.507823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:54.472367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507536+0000","last_change":"2024-09-21T06:45:15.468255+0000","last_active":"2024-09-21T06:45:20.507536+0000","last_peered":"2024-09-21T06:45:20.507536+0000","last_clean":"2024-09-21T06:45:20.507536+0000","last_became_active":"2024-09-21T06:45:15.467926+0000","last_became_peered":"2024-09-21T06:45:15.467926+0000","last_unstale":"2024-09-21T06:45:20.507536+0000","last_undegraded":"2024-09-21T06:45:20.507536+0000","last_fullsized":"2024-09-21T06:45:20.507536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:46.878776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506248+0000","last_change":"2024-09-21T06:45:14.469185+0000","last_active":"2024-09-21T06:45:20.506248+0000","last_peered":"2024-09-21T06:45:20.506248+0000","last_clean":"2024-09-21T06:45:20.506248+0000","last_became_active":"2024-09-21T06:45:14.468890+0000","last_became_peered":"2024-09-21T06:45:14.468890+0000","last_unstale":"2024-09-21T06:45:20.506248+0000","last_undegraded":"2024-09-21T06:45:20.506248+0000","last_fullsized":"2024-09-21T06:45:20.506248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506605+0000","last_change":"2024-09-21T06:45:19.499608+0000","last_active":"2024-09-21T06:45:20.506605+0000","last_peered":"2024-09-21T06:45:20.506605+0000","last_clean":"2024-09-21T06:45:20.506605+0000","last_became_active":"2024-09-21T06:45:19.498220+0000","last_became_peered":"2024-09-21T06:45:19.498220+0000","last_unstale":"2024-09-21T06:45:20.506605+0000","last_undegraded":"2024-09-21T06:45:20.506605+0000","last_fullsized":"2024-09-21T06:45:20.506605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:22.588015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030646+0000","last_change":"2024-09-21T06:45:15.470401+0000","last_active":"2024-09-21T06:45:21.030646+0000","last_peered":"2024-09-21T06:45:21.030646+0000","last_clean":"2024-09-21T06:45:21.030646+0000","last_became_active":"2024-09-21T06:45:15.469676+0000","last_became_peered":"2024-09-21T06:45:15.469676+0000","last_unstale":"2024-09-21T06:45:21.030646+0000","last_undegraded":"2024-09-21T06:45:21.030646+0000","last_fullsized":"2024-09-21T06:45:21.030646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506888+0000","last_change":"2024-09-21T06:45:14.468923+0000","last_active":"2024-09-21T06:45:20.506888+0000","last_peered":"2024-09-21T06:45:20.506888+0000","last_clean":"2024-09-21T06:45:20.506888+0000","last_became_active":"2024-09-21T06:45:14.468591+0000","last_became_peered":"2024-09-21T06:45:14.468591+0000","last_unstale":"2024-09-21T06:45:20.506888+0000","last_undegraded":"2024-09-21T06:45:20.506888+0000","last_fullsized":"2024-09-21T06:45:20.506888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:25.844164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506904+0000","last_change":"2024-09-21T06:45:14.466145+0000","last_active":"2024-09-21T06:45:20.506904+0000","last_peered":"2024-09-21T06:45:20.506904+0000","last_clean":"2024-09-21T06:45:20.506904+0000","last_became_active":"2024-09-21T06:45:14.465260+0000","last_became_peered":"2024-09-21T06:45:14.465260+0000","last_unstale":"2024-09-21T06:45:20.506904+0000","last_undegraded":"2024-09-21T06:45:20.506904+0000","last_fullsized":"2024-09-21T06:45:20.506904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.506269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507474+0000","last_change":"2024-09-21T06:45:15.479102+0000","last_active":"2024-09-21T06:45:20.507474+0000","last_peered":"2024-09-21T06:45:20.507474+0000","last_clean":"2024-09-21T06:45:20.507474+0000","last_became_active":"2024-09-21T06:45:15.477931+0000","last_became_peered":"2024-09-21T06:45:15.477931+0000","last_unstale":"2024-09-21T06:45:20.507474+0000","last_undegraded":"2024-09-21T06:45:20.507474+0000","last_fullsized":"2024-09-21T06:45:20.507474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:15.776123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508961+0000","last_change":"2024-09-21T06:45:19.496596+0000","last_active":"2024-09-21T06:45:20.508961+0000","last_peered":"2024-09-21T06:45:20.508961+0000","last_clean":"2024-09-21T06:45:20.508961+0000","last_became_active":"2024-09-21T06:45:19.496164+0000","last_became_peered":"2024-09-21T06:45:19.496164+0000","last_unstale":"2024-09-21T06:45:20.508961+0000","last_undegraded":"2024-09-21T06:45:20.508961+0000","last_fullsized":"2024-09-21T06:45:20.508961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:50.753263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031547+0000","last_change":"2024-09-21T06:45:14.465515+0000","last_active":"2024-09-21T06:45:21.031547+0000","last_peered":"2024-09-21T06:45:21.031547+0000","last_clean":"2024-09-21T06:45:21.031547+0000","last_became_active":"2024-09-21T06:45:14.464349+0000","last_became_peered":"2024-09-21T06:45:14.464349+0000","last_unstale":"2024-09-21T06:45:21.031547+0000","last_undegraded":"2024-09-21T06:45:21.031547+0000","last_fullsized":"2024-09-21T06:45:21.031547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031752+0000","last_change":"2024-09-21T06:45:15.462226+0000","last_active":"2024-09-21T06:45:21.031752+0000","last_peered":"2024-09-21T06:45:21.031752+0000","last_clean":"2024-09-21T06:45:21.031752+0000","last_became_active":"2024-09-21T06:45:15.461939+0000","last_became_peered":"2024-09-21T06:45:15.461939+0000","last_unstale":"2024-09-21T06:45:21.031752+0000","last_undegraded":"2024-09-21T06:45:21.031752+0000","last_fullsized":"2024-09-21T06:45:21.031752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032165+0000","last_change":"2024-09-21T06:45:19.503463+0000","last_active":"2024-09-21T06:45:21.032165+0000","last_peered":"2024-09-21T06:45:21.032165+0000","last_clean":"2024-09-21T06:45:21.032165+0000","last_became_active":"2024-09-21T06:45:19.502870+0000","last_became_peered":"2024-09-21T06:45:19.502870+0000","last_unstale":"2024-09-21T06:45:21.032165+0000","last_undegraded":"2024-09-21T06:45:21.032165+0000","last_fullsized":"2024-09-21T06:45:21.032165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:41.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030040+0000","last_change":"2024-09-21T06:45:15.469971+0000","last_active":"2024-09-21T06:45:21.030040+0000","last_peered":"2024-09-21T06:45:21.030040+0000","last_clean":"2024-09-21T06:45:21.030040+0000","last_became_active":"2024-09-21T06:45:15.469549+0000","last_became_peered":"2024-09-21T06:45:15.469549+0000","last_unstale":"2024-09-21T06:45:21.030040+0000","last_undegraded":"2024-09-21T06:45:21.030040+0000","last_fullsized":"2024-09-21T06:45:21.030040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030790+0000","last_change":"2024-09-21T06:45:15.467015+0000","last_active":"2024-09-21T06:45:21.030790+0000","last_peered":"2024-09-21T06:45:21.030790+0000","last_clean":"2024-09-21T06:45:21.030790+0000","last_became_active":"2024-09-21T06:45:15.466693+0000","last_became_peered":"2024-09-21T06:45:15.466693+0000","last_unstale":"2024-09-21T06:45:21.030790+0000","last_undegraded":"2024-09-21T06:45:21.030790+0000","last_fullsized":"2024-09-21T06:45:21.030790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506161+0000","last_change":"2024-09-21T06:45:15.464050+0000","last_active":"2024-09-21T06:45:20.506161+0000","last_peered":"2024-09-21T06:45:20.506161+0000","last_clean":"2024-09-21T06:45:20.506161+0000","last_became_active":"2024-09-21T06:45:15.463716+0000","last_became_peered":"2024-09-21T06:45:15.463716+0000","last_unstale":"2024-09-21T06:45:20.506161+0000","last_undegraded":"2024-09-21T06:45:20.506161+0000","last_fullsized":"2024-09-21T06:45:20.506161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:06.081721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031406+0000","last_change":"2024-09-21T06:45:15.462023+0000","last_active":"2024-09-21T06:45:21.031406+0000","last_peered":"2024-09-21T06:45:21.031406+0000","last_clean":"2024-09-21T06:45:21.031406+0000","last_became_active":"2024-09-21T06:45:15.461673+0000","last_became_peered":"2024-09-21T06:45:15.461673+0000","last_unstale":"2024-09-21T06:45:21.031406+0000","last_undegraded":"2024-09-21T06:45:21.031406+0000","last_fullsized":"2024-09-21T06:45:21.031406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:34.273188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508975+0000","last_change":"2024-09-21T06:45:15.476773+0000","last_active":"2024-09-21T06:45:20.508975+0000","last_peered":"2024-09-21T06:45:20.508975+0000","last_clean":"2024-09-21T06:45:20.508975+0000","last_became_active":"2024-09-21T06:45:15.476452+0000","last_became_peered":"2024-09-21T06:45:15.476452+0000","last_unstale":"2024-09-21T06:45:20.508975+0000","last_undegraded":"2024-09-21T06:45:20.508975+0000","last_fullsized":"2024-09-21T06:45:20.508975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507490+0000","last_change":"2024-09-21T06:45:15.476075+0000","last_active":"2024-09-21T06:45:20.507490+0000","last_peered":"2024-09-21T06:45:20.507490+0000","last_clean":"2024-09-21T06:45:20.507490+0000","last_became_active":"2024-09-21T06:45:15.475645+0000","last_became_peered":"2024-09-21T06:45:15.475645+0000","last_unstale":"2024-09-21T06:45:20.507490+0000","last_undegraded":"2024-09-21T06:45:20.507490+0000","last_fullsized":"2024-09-21T06:45:20.507490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:11.856243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031037+0000","last_change":"2024-09-21T06:45:15.467350+0000","last_active":"2024-09-21T06:45:21.031037+0000","last_peered":"2024-09-21T06:45:21.031037+0000","last_clean":"2024-09-21T06:45:21.031037+0000","last_became_active":"2024-09-21T06:45:15.466738+0000","last_became_peered":"2024-09-21T06:45:15.466738+0000","last_unstale":"2024-09-21T06:45:21.031037+0000","last_undegraded":"2024-09-21T06:45:21.031037+0000","last_fullsized":"2024-09-21T06:45:21.031037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031917+0000","last_change":"2024-09-21T06:45:15.474042+0000","last_active":"2024-09-21T06:45:21.031917+0000","last_peered":"2024-09-21T06:45:21.031917+0000","last_clean":"2024-09-21T06:45:21.031917+0000","last_became_active":"2024-09-21T06:45:15.472921+0000","last_became_peered":"2024-09-21T06:45:15.472921+0000","last_unstale":"2024-09-21T06:45:21.031917+0000","last_undegraded":"2024-09-21T06:45:21.031917+0000","last_fullsized":"2024-09-21T06:45:21.031917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:55.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506242+0000","last_change":"2024-09-21T06:45:15.465615+0000","last_active":"2024-09-21T06:45:20.506242+0000","last_peered":"2024-09-21T06:45:20.506242+0000","last_clean":"2024-09-21T06:45:20.506242+0000","last_became_active":"2024-09-21T06:45:15.465295+0000","last_became_peered":"2024-09-21T06:45:15.465295+0000","last_unstale":"2024-09-21T06:45:20.506242+0000","last_undegraded":"2024-09-21T06:45:20.506242+0000","last_fullsized":"2024-09-21T06:45:20.506242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:49.579027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030830+0000","last_change":"2024-09-21T06:45:15.471829+0000","last_active":"2024-09-21T06:45:21.030830+0000","last_peered":"2024-09-21T06:45:21.030830+0000","last_clean":"2024-09-21T06:45:21.030830+0000","last_became_active":"2024-09-21T06:45:15.470063+0000","last_became_peered":"2024-09-21T06:45:15.470063+0000","last_unstale":"2024-09-21T06:45:21.030830+0000","last_undegraded":"2024-09-21T06:45:21.030830+0000","last_fullsized":"2024-09-21T06:45:21.030830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031632+0000","last_change":"2024-09-21T06:45:15.460833+0000","last_active":"2024-09-21T06:45:21.031632+0000","last_peered":"2024-09-21T06:45:21.031632+0000","last_clean":"2024-09-21T06:45:21.031632+0000","last_became_active":"2024-09-21T06:45:15.460524+0000","last_became_peered":"2024-09-21T06:45:15.460524+0000","last_unstale":"2024-09-21T06:45:21.031632+0000","last_undegraded":"2024-09-21T06:45:21.031632+0000","last_fullsized":"2024-09-21T06:45:21.031632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507357+0000","last_change":"2024-09-21T06:45:15.468655+0000","last_active":"2024-09-21T06:45:20.507357+0000","last_peered":"2024-09-21T06:45:20.507357+0000","last_clean":"2024-09-21T06:45:20.507357+0000","last_became_active":"2024-09-21T06:45:15.468310+0000","last_became_peered":"2024-09-21T06:45:15.468310+0000","last_unstale":"2024-09-21T06:45:20.507357+0000","last_undegraded":"2024-09-21T06:45:20.507357+0000","last_fullsized":"2024-09-21T06:45:20.507357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031414+0000","last_change":"2024-09-21T06:45:15.470151+0000","last_active":"2024-09-21T06:45:21.031414+0000","last_peered":"2024-09-21T06:45:21.031414+0000","last_clean":"2024-09-21T06:45:21.031414+0000","last_became_active":"2024-09-21T06:45:15.469649+0000","last_became_peered":"2024-09-21T06:45:15.469649+0000","last_unstale":"2024-09-21T06:45:21.031414+0000","last_undegraded":"2024-09-21T06:45:21.031414+0000","last_fullsized":"2024-09-21T06:45:21.031414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:37.996645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507052+0000","last_change":"2024-09-21T06:45:15.461412+0000","last_active":"2024-09-21T06:45:20.507052+0000","last_peered":"2024-09-21T06:45:20.507052+0000","last_clean":"2024-09-21T06:45:20.507052+0000","last_became_active":"2024-09-21T06:45:15.461063+0000","last_became_peered":"2024-09-21T06:45:15.461063+0000","last_unstale":"2024-09-21T06:45:20.507052+0000","last_undegraded":"2024-09-21T06:45:20.507052+0000","last_fullsized":"2024-09-21T06:45:20.507052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:15.663968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031669+0000","last_change":"2024-09-21T06:45:15.471096+0000","last_active":"2024-09-21T06:45:21.031669+0000","last_peered":"2024-09-21T06:45:21.031669+0000","last_clean":"2024-09-21T06:45:21.031669+0000","last_became_active":"2024-09-21T06:45:15.470745+0000","last_became_peered":"2024-09-21T06:45:15.470745+0000","last_unstale":"2024-09-21T06:45:21.031669+0000","last_undegraded":"2024-09-21T06:45:21.031669+0000","last_fullsized":"2024-09-21T06:45:21.031669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506933+0000","last_change":"2024-09-21T06:45:15.471359+0000","last_active":"2024-09-21T06:45:20.506933+0000","last_peered":"2024-09-21T06:45:20.506933+0000","last_clean":"2024-09-21T06:45:20.506933+0000","last_became_active":"2024-09-21T06:45:15.471058+0000","last_became_peered":"2024-09-21T06:45:15.471058+0000","last_unstale":"2024-09-21T06:45:20.506933+0000","last_undegraded":"2024-09-21T06:45:20.506933+0000","last_fullsized":"2024-09-21T06:45:20.506933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:16.265829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505982+0000","last_change":"2024-09-21T06:45:15.468454+0000","last_active":"2024-09-21T06:45:20.505982+0000","last_peered":"2024-09-21T06:45:20.505982+0000","last_clean":"2024-09-21T06:45:20.505982+0000","last_became_active":"2024-09-21T06:45:15.468156+0000","last_became_peered":"2024-09-21T06:45:15.468156+0000","last_unstale":"2024-09-21T06:45:20.505982+0000","last_undegraded":"2024-09-21T06:45:20.505982+0000","last_fullsized":"2024-09-21T06:45:20.505982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030537+0000","last_change":"2024-09-21T06:45:15.473222+0000","last_active":"2024-09-21T06:45:21.030537+0000","last_peered":"2024-09-21T06:45:21.030537+0000","last_clean":"2024-09-21T06:45:21.030537+0000","last_became_active":"2024-09-21T06:45:15.470238+0000","last_became_peered":"2024-09-21T06:45:15.470238+0000","last_unstale":"2024-09-21T06:45:21.030537+0000","last_undegraded":"2024-09-21T06:45:21.030537+0000","last_fullsized":"2024-09-21T06:45:21.030537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:15.814240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507835+0000","last_change":"2024-09-21T06:45:15.469249+0000","last_active":"2024-09-21T06:45:20.507835+0000","last_peered":"2024-09-21T06:45:20.507835+0000","last_clean":"2024-09-21T06:45:20.507835+0000","last_became_active":"2024-09-21T06:45:15.468891+0000","last_became_peered":"2024-09-21T06:45:15.468891+0000","last_unstale":"2024-09-21T06:45:20.507835+0000","last_undegraded":"2024-09-21T06:45:20.507835+0000","last_fullsized":"2024-09-21T06:45:20.507835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:30.588823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508365+0000","last_change":"2024-09-21T06:45:15.474819+0000","last_active":"2024-09-21T06:45:20.508365+0000","last_peered":"2024-09-21T06:45:20.508365+0000","last_clean":"2024-09-21T06:45:20.508365+0000","last_became_active":"2024-09-21T06:45:15.474480+0000","last_became_peered":"2024-09-21T06:45:15.474480+0000","last_unstale":"2024-09-21T06:45:20.508365+0000","last_undegraded":"2024-09-21T06:45:20.508365+0000","last_fullsized":"2024-09-21T06:45:20.508365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:33.846712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031351+0000","last_change":"2024-09-21T06:45:15.470503+0000","last_active":"2024-09-21T06:45:21.031351+0000","last_peered":"2024-09-21T06:45:21.031351+0000","last_clean":"2024-09-21T06:45:21.031351+0000","last_became_active":"2024-09-21T06:45:15.469857+0000","last_became_peered":"2024-09-21T06:45:15.469857+0000","last_unstale":"2024-09-21T06:45:21.031351+0000","last_undegraded":"2024-09-21T06:45:21.031351+0000","last_fullsized":"2024-09-21T06:45:21.031351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030846+0000","last_change":"2024-09-21T06:45:15.476713+0000","last_active":"2024-09-21T06:45:21.030846+0000","last_peered":"2024-09-21T06:45:21.030846+0000","last_clean":"2024-09-21T06:45:21.030846+0000","last_became_active":"2024-09-21T06:45:15.476116+0000","last_became_peered":"2024-09-21T06:45:15.476116+0000","last_unstale":"2024-09-21T06:45:21.030846+0000","last_undegraded":"2024-09-21T06:45:21.030846+0000","last_fullsized":"2024-09-21T06:45:21.030846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:38.613487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030607+0000","last_change":"2024-09-21T06:45:15.477443+0000","last_active":"2024-09-21T06:45:21.030607+0000","last_peered":"2024-09-21T06:45:21.030607+0000","last_clean":"2024-09-21T06:45:21.030607+0000","last_became_active":"2024-09-21T06:45:15.476960+0000","last_became_peered":"2024-09-21T06:45:15.476960+0000","last_unstale":"2024-09-21T06:45:21.030607+0000","last_undegraded":"2024-09-21T06:45:21.030607+0000","last_fullsized":"2024-09-21T06:45:21.030607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:43.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031952+0000","last_change":"2024-09-21T06:45:15.463639+0000","last_active":"2024-09-21T06:45:21.031952+0000","last_peered":"2024-09-21T06:45:21.031952+0000","last_clean":"2024-09-21T06:45:21.031952+0000","last_became_active":"2024-09-21T06:45:15.463208+0000","last_became_peered":"2024-09-21T06:45:15.463208+0000","last_unstale":"2024-09-21T06:45:21.031952+0000","last_undegraded":"2024-09-21T06:45:21.031952+0000","last_fullsized":"2024-09-21T06:45:21.031952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030528+0000","last_change":"2024-09-21T06:45:15.473790+0000","last_active":"2024-09-21T06:45:21.030528+0000","last_peered":"2024-09-21T06:45:21.030528+0000","last_clean":"2024-09-21T06:45:21.030528+0000","last_became_active":"2024-09-21T06:45:15.472962+0000","last_became_peered":"2024-09-21T06:45:15.472962+0000","last_unstale":"2024-09-21T06:45:21.030528+0000","last_undegraded":"2024-09-21T06:45:21.030528+0000","last_fullsized":"2024-09-21T06:45:21.030528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:47.239754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030418+0000","last_change":"2024-09-21T06:45:15.469545+0000","last_active":"2024-09-21T06:45:21.030418+0000","last_peered":"2024-09-21T06:45:21.030418+0000","last_clean":"2024-09-21T06:45:21.030418+0000","last_became_active":"2024-09-21T06:45:15.469169+0000","last_became_peered":"2024-09-21T06:45:15.469169+0000","last_unstale":"2024-09-21T06:45:21.030418+0000","last_undegraded":"2024-09-21T06:45:21.030418+0000","last_fullsized":"2024-09-21T06:45:21.030418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030577+0000","last_change":"2024-09-21T06:45:15.466759+0000","last_active":"2024-09-21T06:45:21.030577+0000","last_peered":"2024-09-21T06:45:21.030577+0000","last_clean":"2024-09-21T06:45:21.030577+0000","last_became_active":"2024-09-21T06:45:15.466478+0000","last_became_peered":"2024-09-21T06:45:15.466478+0000","last_unstale":"2024-09-21T06:45:21.030577+0000","last_undegraded":"2024-09-21T06:45:21.030577+0000","last_fullsized":"2024-09-21T06:45:21.030577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030244+0000","last_change":"2024-09-21T06:45:15.472637+0000","last_active":"2024-09-21T06:45:21.030244+0000","last_peered":"2024-09-21T06:45:21.030244+0000","last_clean":"2024-09-21T06:45:21.030244+0000","last_became_active":"2024-09-21T06:45:15.470326+0000","last_became_peered":"2024-09-21T06:45:15.470326+0000","last_unstale":"2024-09-21T06:45:21.030244+0000","last_undegraded":"2024-09-21T06:45:21.030244+0000","last_fullsized":"2024-09-21T06:45:21.030244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:20.637139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030961+0000","last_change":"2024-09-21T06:45:15.461625+0000","last_active":"2024-09-21T06:45:21.030961+0000","last_peered":"2024-09-21T06:45:21.030961+0000","last_clean":"2024-09-21T06:45:21.030961+0000","last_became_active":"2024-09-21T06:45:15.461296+0000","last_became_peered":"2024-09-21T06:45:15.461296+0000","last_unstale":"2024-09-21T06:45:21.030961+0000","last_undegraded":"2024-09-21T06:45:21.030961+0000","last_fullsized":"2024-09-21T06:45:21.030961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031625+0000","last_change":"2024-09-21T06:45:15.474538+0000","last_active":"2024-09-21T06:45:21.031625+0000","last_peered":"2024-09-21T06:45:21.031625+0000","last_clean":"2024-09-21T06:45:21.031625+0000","last_became_active":"2024-09-21T06:45:15.474164+0000","last_became_peered":"2024-09-21T06:45:15.474164+0000","last_unstale":"2024-09-21T06:45:21.031625+0000","last_undegraded":"2024-09-21T06:45:21.031625+0000","last_fullsized":"2024-09-21T06:45:21.031625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:08.489330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031957+0000","last_change":"2024-09-21T06:45:15.475008+0000","last_active":"2024-09-21T06:45:21.031957+0000","last_peered":"2024-09-21T06:45:21.031957+0000","last_clean":"2024-09-21T06:45:21.031957+0000","last_became_active":"2024-09-21T06:45:15.474621+0000","last_became_peered":"2024-09-21T06:45:15.474621+0000","last_unstale":"2024-09-21T06:45:21.031957+0000","last_undegraded":"2024-09-21T06:45:21.031957+0000","last_fullsized":"2024-09-21T06:45:21.031957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030146+0000","last_change":"2024-09-21T06:45:15.463461+0000","last_active":"2024-09-21T06:45:21.030146+0000","last_peered":"2024-09-21T06:45:21.030146+0000","last_clean":"2024-09-21T06:45:21.030146+0000","last_became_active":"2024-09-21T06:45:15.463156+0000","last_became_peered":"2024-09-21T06:45:15.463156+0000","last_unstale":"2024-09-21T06:45:21.030146+0000","last_undegraded":"2024-09-21T06:45:21.030146+0000","last_fullsized":"2024-09-21T06:45:21.030146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.464870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":108140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:45:29.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:45:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 -- 172.21.15.81:0/4250684611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485415d2c0 msgr2=0x7f485415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 --2- 172.21.15.81:0/4250684611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485415d2c0 0x7f485415d6d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f484c005fd0 tx=0x7f484c02a9c0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 -- 172.21.15.81:0/4250684611 shutdown_connections 2024-09-21T06:45:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 --2- 172.21.15.81:0/4250684611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f485415d2c0 0x7f485415d6d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 --2- 172.21.15.81:0/4250684611 >> v2:172.21.15.89:3300/0 conn(0x7f48540d19a0 0x7f485415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 -- 172.21.15.81:0/4250684611 >> 172.21.15.81:0/4250684611 conn(0x7f48540d25e0 msgr2=0x7f48540d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 -- 172.21.15.81:0/4250684611 shutdown_connections 2024-09-21T06:45:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.893+0000 7f485c05c640 1 -- 172.21.15.81:0/4250684611 wait complete. 2024-09-21T06:45:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.895+0000 7f485c05c640 1 Processor -- start 2024-09-21T06:45:29.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.895+0000 7f485c05c640 1 -- start start 2024-09-21T06:45:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485c05c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48540d19a0 0x7f48541480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485c05c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f485415d2c0 0x7f48540b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485c05c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48541601c0 0x7f48541440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485c05c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4854072ec0 con 0x7f48541601c0 2024-09-21T06:45:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485c05c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4854072d40 con 0x7f48540d19a0 2024-09-21T06:45:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485c05c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f4854073040 con 0x7f485415d2c0 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48541601c0 0x7f48541440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48541601c0 0x7f48541440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54496/0 (socket says 172.21.15.81:54496) 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 -- 172.21.15.81:0/3682052830 learned_addr learned my addr 172.21.15.81:0/3682052830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 -- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f485415d2c0 msgr2=0x7f48540b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f485415d2c0 0x7f48540b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 -- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48540d19a0 msgr2=0x7f48541480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48540d19a0 0x7f48541480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.896+0000 7f485a5f9640 1 -- 172.21.15.81:0/3682052830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48540c93f0 con 0x7f48541601c0 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.897+0000 7f485a5f9640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48541601c0 0x7f48541440c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f484c033040 tx=0x7f484c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.897+0000 7f484a7fc640 1 -- 172.21.15.81:0/3682052830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c034040 con 0x7f48541601c0 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.897+0000 7f484a7fc640 1 -- 172.21.15.81:0/3682052830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f484c004640 con 0x7f48541601c0 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.897+0000 7f484a7fc640 1 -- 172.21.15.81:0/3682052830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c045480 con 0x7f48541601c0 2024-09-21T06:45:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.897+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48540c96d0 con 0x7f48541601c0 2024-09-21T06:45:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.897+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48540cbd70 con 0x7f48541601c0 2024-09-21T06:45:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.898+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4854073590 con 0x7f48541601c0 2024-09-21T06:45:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.898+0000 7f484a7fc640 1 -- 172.21.15.81:0/3682052830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f484c037020 con 0x7f48541601c0 2024-09-21T06:45:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.899+0000 7f484a7fc640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4838078bc0 0x7f483807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.899+0000 7f484a7fc640 1 -- 172.21.15.81:0/3682052830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f484c0bcab0 con 0x7f48541601c0 2024-09-21T06:45:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.899+0000 7f4859df8640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4838078bc0 0x7f483807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.900+0000 7f4859df8640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4838078bc0 0x7f483807b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485000a8f0 tx=0x7f4850005bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:29.903+0000 7f484a7fc640 1 -- 172.21.15.81:0/3682052830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f484c084b30 con 0x7f48541601c0 2024-09-21T06:45:30.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.075+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4854073590 con 0x7f4838078bc0 2024-09-21T06:45:30.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.082+0000 7f484a7fc640 1 -- 172.21.15.81:0/3682052830 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332579 (secure 0 0 0) 0x7f4854073590 con 0x7f4838078bc0 2024-09-21T06:45:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:30.089 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4838078bc0 msgr2=0x7f483807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4838078bc0 0x7f483807b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485000a8f0 tx=0x7f4850005bd0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48541601c0 msgr2=0x7f48541440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48541601c0 0x7f48541440c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f484c033040 tx=0x7f484c003f10 comp rx=0 tx=0).stop 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 shutdown_connections 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4838078bc0 0x7f483807b0d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f485415d2c0 0x7f48540b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48541601c0 0x7f48541440c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 --2- 172.21.15.81:0/3682052830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48540d19a0 0x7f48541480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 >> 172.21.15.81:0/3682052830 conn(0x7f48540d25e0 msgr2=0x7f48540d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 shutdown_connections 2024-09-21T06:45:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.085+0000 7f485c05c640 1 -- 172.21.15.81:0/3682052830 wait complete. 2024-09-21T06:45:30.099 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-21T06:45:28.654047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":304,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219568,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755152,"statfs":{"total":773094113280,"available":772869275648,"internally_reserved":0,"allocated":3416064,"data_stored":2040010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.176790"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508468+0000","last_change":"2024-09-21T06:45:14.464339+0000","last_active":"2024-09-21T06:45:20.508468+0000","last_peered":"2024-09-21T06:45:20.508468+0000","last_clean":"2024-09-21T06:45:20.508468+0000","last_became_active":"2024-09-21T06:45:14.464012+0000","last_became_peered":"2024-09-21T06:45:14.464012+0000","last_unstale":"2024-09-21T06:45:20.508468+0000","last_undegraded":"2024-09-21T06:45:20.508468+0000","last_fullsized":"2024-09-21T06:45:20.508468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:36.925765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032175+0000","last_change":"2024-09-21T06:45:15.471510+0000","last_active":"2024-09-21T06:45:21.032175+0000","last_peered":"2024-09-21T06:45:21.032175+0000","last_clean":"2024-09-21T06:45:21.032175+0000","last_became_active":"2024-09-21T06:45:15.471143+0000","last_became_peered":"2024-09-21T06:45:15.471143+0000","last_unstale":"2024-09-21T06:45:21.032175+0000","last_undegraded":"2024-09-21T06:45:21.032175+0000","last_fullsized":"2024-09-21T06:45:21.032175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030689+0000","last_change":"2024-09-21T06:45:19.508650+0000","last_active":"2024-09-21T06:45:21.030689+0000","last_peered":"2024-09-21T06:45:21.030689+0000","last_clean":"2024-09-21T06:45:21.030689+0000","last_became_active":"2024-09-21T06:45:19.508068+0000","last_became_peered":"2024-09-21T06:45:19.508068+0000","last_unstale":"2024-09-21T06:45:21.030689+0000","last_undegraded":"2024-09-21T06:45:21.030689+0000","last_fullsized":"2024-09-21T06:45:21.030689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:00.812495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032318+0000","last_change":"2024-09-21T06:45:14.463510+0000","last_active":"2024-09-21T06:45:21.032318+0000","last_peered":"2024-09-21T06:45:21.032318+0000","last_clean":"2024-09-21T06:45:21.032318+0000","last_became_active":"2024-09-21T06:45:14.462560+0000","last_became_peered":"2024-09-21T06:45:14.462560+0000","last_unstale":"2024-09-21T06:45:21.032318+0000","last_undegraded":"2024-09-21T06:45:21.032318+0000","last_fullsized":"2024-09-21T06:45:21.032318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032076+0000","last_change":"2024-09-21T06:45:15.469206+0000","last_active":"2024-09-21T06:45:21.032076+0000","last_peered":"2024-09-21T06:45:21.032076+0000","last_clean":"2024-09-21T06:45:21.032076+0000","last_became_active":"2024-09-21T06:45:15.468852+0000","last_became_peered":"2024-09-21T06:45:15.468852+0000","last_unstale":"2024-09-21T06:45:21.032076+0000","last_undegraded":"2024-09-21T06:45:21.032076+0000","last_fullsized":"2024-09-21T06:45:21.032076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:53.718982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.029911+0000","last_change":"2024-09-21T06:45:19.499958+0000","last_active":"2024-09-21T06:45:21.029911+0000","last_peered":"2024-09-21T06:45:21.029911+0000","last_clean":"2024-09-21T06:45:21.029911+0000","last_became_active":"2024-09-21T06:45:19.498778+0000","last_became_peered":"2024-09-21T06:45:19.498778+0000","last_unstale":"2024-09-21T06:45:21.029911+0000","last_undegraded":"2024-09-21T06:45:21.029911+0000","last_fullsized":"2024-09-21T06:45:21.029911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:30.663232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031112+0000","last_change":"2024-09-21T06:45:14.467815+0000","last_active":"2024-09-21T06:45:21.031112+0000","last_peered":"2024-09-21T06:45:21.031112+0000","last_clean":"2024-09-21T06:45:21.031112+0000","last_became_active":"2024-09-21T06:45:14.467402+0000","last_became_peered":"2024-09-21T06:45:14.467402+0000","last_unstale":"2024-09-21T06:45:21.031112+0000","last_undegraded":"2024-09-21T06:45:21.031112+0000","last_fullsized":"2024-09-21T06:45:21.031112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032375+0000","last_change":"2024-09-21T06:45:15.472639+0000","last_active":"2024-09-21T06:45:21.032375+0000","last_peered":"2024-09-21T06:45:21.032375+0000","last_clean":"2024-09-21T06:45:21.032375+0000","last_became_active":"2024-09-21T06:45:15.472020+0000","last_became_peered":"2024-09-21T06:45:15.472020+0000","last_unstale":"2024-09-21T06:45:21.032375+0000","last_undegraded":"2024-09-21T06:45:21.032375+0000","last_fullsized":"2024-09-21T06:45:21.032375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031061+0000","last_change":"2024-09-21T06:45:19.506108+0000","last_active":"2024-09-21T06:45:21.031061+0000","last_peered":"2024-09-21T06:45:21.031061+0000","last_clean":"2024-09-21T06:45:21.031061+0000","last_became_active":"2024-09-21T06:45:19.505693+0000","last_became_peered":"2024-09-21T06:45:19.505693+0000","last_unstale":"2024-09-21T06:45:21.031061+0000","last_undegraded":"2024-09-21T06:45:21.031061+0000","last_fullsized":"2024-09-21T06:45:21.031061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:04.498857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031623+0000","last_change":"2024-09-21T06:45:14.468290+0000","last_active":"2024-09-21T06:45:21.031623+0000","last_peered":"2024-09-21T06:45:21.031623+0000","last_clean":"2024-09-21T06:45:21.031623+0000","last_became_active":"2024-09-21T06:45:14.466952+0000","last_became_peered":"2024-09-21T06:45:14.466952+0000","last_unstale":"2024-09-21T06:45:21.031623+0000","last_undegraded":"2024-09-21T06:45:21.031623+0000","last_fullsized":"2024-09-21T06:45:21.031623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506797+0000","last_change":"2024-09-21T06:45:15.478969+0000","last_active":"2024-09-21T06:45:20.506797+0000","last_peered":"2024-09-21T06:45:20.506797+0000","last_clean":"2024-09-21T06:45:20.506797+0000","last_became_active":"2024-09-21T06:45:15.478560+0000","last_became_peered":"2024-09-21T06:45:15.478560+0000","last_unstale":"2024-09-21T06:45:20.506797+0000","last_undegraded":"2024-09-21T06:45:20.506797+0000","last_fullsized":"2024-09-21T06:45:20.506797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030140+0000","last_change":"2024-09-21T06:45:19.501225+0000","last_active":"2024-09-21T06:45:21.030140+0000","last_peered":"2024-09-21T06:45:21.030140+0000","last_clean":"2024-09-21T06:45:21.030140+0000","last_became_active":"2024-09-21T06:45:19.500690+0000","last_became_peered":"2024-09-21T06:45:19.500690+0000","last_unstale":"2024-09-21T06:45:21.030140+0000","last_undegraded":"2024-09-21T06:45:21.030140+0000","last_fullsized":"2024-09-21T06:45:21.030140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:19.848228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506286+0000","last_change":"2024-09-21T06:45:15.464877+0000","last_active":"2024-09-21T06:45:20.506286+0000","last_peered":"2024-09-21T06:45:20.506286+0000","last_clean":"2024-09-21T06:45:20.506286+0000","last_became_active":"2024-09-21T06:45:15.464588+0000","last_became_peered":"2024-09-21T06:45:15.464588+0000","last_unstale":"2024-09-21T06:45:20.506286+0000","last_undegraded":"2024-09-21T06:45:20.506286+0000","last_fullsized":"2024-09-21T06:45:20.506286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:42.134939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506529+0000","last_change":"2024-09-21T06:45:14.467476+0000","last_active":"2024-09-21T06:45:20.506529+0000","last_peered":"2024-09-21T06:45:20.506529+0000","last_clean":"2024-09-21T06:45:20.506529+0000","last_became_active":"2024-09-21T06:45:14.466897+0000","last_became_peered":"2024-09-21T06:45:14.466897+0000","last_unstale":"2024-09-21T06:45:20.506529+0000","last_undegraded":"2024-09-21T06:45:20.506529+0000","last_fullsized":"2024-09-21T06:45:20.506529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:10.023372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506859+0000","last_change":"2024-09-21T06:45:19.498544+0000","last_active":"2024-09-21T06:45:20.506859+0000","last_peered":"2024-09-21T06:45:20.506859+0000","last_clean":"2024-09-21T06:45:20.506859+0000","last_became_active":"2024-09-21T06:45:19.497658+0000","last_became_peered":"2024-09-21T06:45:19.497658+0000","last_unstale":"2024-09-21T06:45:20.506859+0000","last_undegraded":"2024-09-21T06:45:20.506859+0000","last_fullsized":"2024-09-21T06:45:20.506859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:52.803324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031062+0000","last_change":"2024-09-21T06:45:15.468182+0000","last_active":"2024-09-21T06:45:21.031062+0000","last_peered":"2024-09-21T06:45:21.031062+0000","last_clean":"2024-09-21T06:45:21.031062+0000","last_became_active":"2024-09-21T06:45:15.467824+0000","last_became_peered":"2024-09-21T06:45:15.467824+0000","last_unstale":"2024-09-21T06:45:21.031062+0000","last_undegraded":"2024-09-21T06:45:21.031062+0000","last_fullsized":"2024-09-21T06:45:21.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508135+0000","last_change":"2024-09-21T06:45:14.466757+0000","last_active":"2024-09-21T06:45:20.508135+0000","last_peered":"2024-09-21T06:45:20.508135+0000","last_clean":"2024-09-21T06:45:20.508135+0000","last_became_active":"2024-09-21T06:45:14.466415+0000","last_became_peered":"2024-09-21T06:45:14.466415+0000","last_unstale":"2024-09-21T06:45:20.508135+0000","last_undegraded":"2024-09-21T06:45:20.508135+0000","last_fullsized":"2024-09-21T06:45:20.508135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:07.383477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031176+0000","last_change":"2024-09-21T06:45:19.499423+0000","last_active":"2024-09-21T06:45:21.031176+0000","last_peered":"2024-09-21T06:45:21.031176+0000","last_clean":"2024-09-21T06:45:21.031176+0000","last_became_active":"2024-09-21T06:45:19.498952+0000","last_became_peered":"2024-09-21T06:45:19.498952+0000","last_unstale":"2024-09-21T06:45:21.031176+0000","last_undegraded":"2024-09-21T06:45:21.031176+0000","last_fullsized":"2024-09-21T06:45:21.031176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508529+0000","last_change":"2024-09-21T06:45:15.466008+0000","last_active":"2024-09-21T06:45:20.508529+0000","last_peered":"2024-09-21T06:45:20.508529+0000","last_clean":"2024-09-21T06:45:20.508529+0000","last_became_active":"2024-09-21T06:45:15.465647+0000","last_became_peered":"2024-09-21T06:45:15.465647+0000","last_unstale":"2024-09-21T06:45:20.508529+0000","last_undegraded":"2024-09-21T06:45:20.508529+0000","last_fullsized":"2024-09-21T06:45:20.508529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:31.085363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507731+0000","last_change":"2024-09-21T06:45:14.469576+0000","last_active":"2024-09-21T06:45:20.507731+0000","last_peered":"2024-09-21T06:45:20.507731+0000","last_clean":"2024-09-21T06:45:20.507731+0000","last_became_active":"2024-09-21T06:45:14.469236+0000","last_became_peered":"2024-09-21T06:45:14.469236+0000","last_unstale":"2024-09-21T06:45:20.507731+0000","last_undegraded":"2024-09-21T06:45:20.507731+0000","last_fullsized":"2024-09-21T06:45:20.507731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:02.696088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032184+0000","last_change":"2024-09-21T06:45:19.510297+0000","last_active":"2024-09-21T06:45:21.032184+0000","last_peered":"2024-09-21T06:45:21.032184+0000","last_clean":"2024-09-21T06:45:21.032184+0000","last_became_active":"2024-09-21T06:45:19.509889+0000","last_became_peered":"2024-09-21T06:45:19.509889+0000","last_unstale":"2024-09-21T06:45:21.032184+0000","last_undegraded":"2024-09-21T06:45:21.032184+0000","last_fullsized":"2024-09-21T06:45:21.032184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:59.748038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506005+0000","last_change":"2024-09-21T06:45:15.464901+0000","last_active":"2024-09-21T06:45:20.506005+0000","last_peered":"2024-09-21T06:45:20.506005+0000","last_clean":"2024-09-21T06:45:20.506005+0000","last_became_active":"2024-09-21T06:45:15.464616+0000","last_became_peered":"2024-09-21T06:45:15.464616+0000","last_unstale":"2024-09-21T06:45:20.506005+0000","last_undegraded":"2024-09-21T06:45:20.506005+0000","last_fullsized":"2024-09-21T06:45:20.506005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030008+0000","last_change":"2024-09-21T06:45:14.469791+0000","last_active":"2024-09-21T06:45:21.030008+0000","last_peered":"2024-09-21T06:45:21.030008+0000","last_clean":"2024-09-21T06:45:21.030008+0000","last_became_active":"2024-09-21T06:45:14.469113+0000","last_became_peered":"2024-09-21T06:45:14.469113+0000","last_unstale":"2024-09-21T06:45:21.030008+0000","last_undegraded":"2024-09-21T06:45:21.030008+0000","last_fullsized":"2024-09-21T06:45:21.030008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030884+0000","last_change":"2024-09-21T06:45:19.503593+0000","last_active":"2024-09-21T06:45:21.030884+0000","last_peered":"2024-09-21T06:45:21.030884+0000","last_clean":"2024-09-21T06:45:21.030884+0000","last_became_active":"2024-09-21T06:45:19.503150+0000","last_became_peered":"2024-09-21T06:45:19.503150+0000","last_unstale":"2024-09-21T06:45:21.030884+0000","last_undegraded":"2024-09-21T06:45:21.030884+0000","last_fullsized":"2024-09-21T06:45:21.030884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.348456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507905+0000","last_change":"2024-09-21T06:45:15.464731+0000","last_active":"2024-09-21T06:45:20.507905+0000","last_peered":"2024-09-21T06:45:20.507905+0000","last_clean":"2024-09-21T06:45:20.507905+0000","last_became_active":"2024-09-21T06:45:15.464397+0000","last_became_peered":"2024-09-21T06:45:15.464397+0000","last_unstale":"2024-09-21T06:45:20.507905+0000","last_undegraded":"2024-09-21T06:45:20.507905+0000","last_fullsized":"2024-09-21T06:45:20.507905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:24.268833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507028+0000","last_change":"2024-09-21T06:45:14.463206+0000","last_active":"2024-09-21T06:45:20.507028+0000","last_peered":"2024-09-21T06:45:20.507028+0000","last_clean":"2024-09-21T06:45:20.507028+0000","last_became_active":"2024-09-21T06:45:14.462858+0000","last_became_peered":"2024-09-21T06:45:14.462858+0000","last_unstale":"2024-09-21T06:45:20.507028+0000","last_undegraded":"2024-09-21T06:45:20.507028+0000","last_fullsized":"2024-09-21T06:45:20.507028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:09.685089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030880+0000","last_change":"2024-09-21T06:45:19.504734+0000","last_active":"2024-09-21T06:45:21.030880+0000","last_peered":"2024-09-21T06:45:21.030880+0000","last_clean":"2024-09-21T06:45:21.030880+0000","last_became_active":"2024-09-21T06:45:19.504280+0000","last_became_peered":"2024-09-21T06:45:19.504280+0000","last_unstale":"2024-09-21T06:45:21.030880+0000","last_undegraded":"2024-09-21T06:45:21.030880+0000","last_fullsized":"2024-09-21T06:45:21.030880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:29.145421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508777+0000","last_change":"2024-09-21T06:45:15.470507+0000","last_active":"2024-09-21T06:45:20.508777+0000","last_peered":"2024-09-21T06:45:20.508777+0000","last_clean":"2024-09-21T06:45:20.508777+0000","last_became_active":"2024-09-21T06:45:15.470151+0000","last_became_peered":"2024-09-21T06:45:15.470151+0000","last_unstale":"2024-09-21T06:45:20.508777+0000","last_undegraded":"2024-09-21T06:45:20.508777+0000","last_fullsized":"2024-09-21T06:45:20.508777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:23.908138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508277+0000","last_change":"2024-09-21T06:45:14.463895+0000","last_active":"2024-09-21T06:45:20.508277+0000","last_peered":"2024-09-21T06:45:20.508277+0000","last_clean":"2024-09-21T06:45:20.508277+0000","last_became_active":"2024-09-21T06:45:14.463553+0000","last_became_peered":"2024-09-21T06:45:14.463553+0000","last_unstale":"2024-09-21T06:45:20.508277+0000","last_undegraded":"2024-09-21T06:45:20.508277+0000","last_fullsized":"2024-09-21T06:45:20.508277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:18.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508458+0000","last_change":"2024-09-21T06:45:19.501027+0000","last_active":"2024-09-21T06:45:20.508458+0000","last_peered":"2024-09-21T06:45:20.508458+0000","last_clean":"2024-09-21T06:45:20.508458+0000","last_became_active":"2024-09-21T06:45:19.500456+0000","last_became_peered":"2024-09-21T06:45:19.500456+0000","last_unstale":"2024-09-21T06:45:20.508458+0000","last_undegraded":"2024-09-21T06:45:20.508458+0000","last_fullsized":"2024-09-21T06:45:20.508458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:24.217258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509016+0000","last_change":"2024-09-21T06:45:15.475607+0000","last_active":"2024-09-21T06:45:20.509016+0000","last_peered":"2024-09-21T06:45:20.509016+0000","last_clean":"2024-09-21T06:45:20.509016+0000","last_became_active":"2024-09-21T06:45:15.475256+0000","last_became_peered":"2024-09-21T06:45:15.475256+0000","last_unstale":"2024-09-21T06:45:20.509016+0000","last_undegraded":"2024-09-21T06:45:20.509016+0000","last_fullsized":"2024-09-21T06:45:20.509016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:18.300400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507126+0000","last_change":"2024-09-21T06:45:14.463043+0000","last_active":"2024-09-21T06:45:20.507126+0000","last_peered":"2024-09-21T06:45:20.507126+0000","last_clean":"2024-09-21T06:45:20.507126+0000","last_became_active":"2024-09-21T06:45:14.462253+0000","last_became_peered":"2024-09-21T06:45:14.462253+0000","last_unstale":"2024-09-21T06:45:20.507126+0000","last_undegraded":"2024-09-21T06:45:20.507126+0000","last_fullsized":"2024-09-21T06:45:20.507126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508325+0000","last_change":"2024-09-21T06:45:19.499431+0000","last_active":"2024-09-21T06:45:20.508325+0000","last_peered":"2024-09-21T06:45:20.508325+0000","last_clean":"2024-09-21T06:45:20.508325+0000","last_became_active":"2024-09-21T06:45:19.498990+0000","last_became_peered":"2024-09-21T06:45:19.498990+0000","last_unstale":"2024-09-21T06:45:20.508325+0000","last_undegraded":"2024-09-21T06:45:20.508325+0000","last_fullsized":"2024-09-21T06:45:20.508325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:22.135690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030357+0000","last_change":"2024-09-21T06:45:15.476862+0000","last_active":"2024-09-21T06:45:21.030357+0000","last_peered":"2024-09-21T06:45:21.030357+0000","last_clean":"2024-09-21T06:45:21.030357+0000","last_became_active":"2024-09-21T06:45:15.476545+0000","last_became_peered":"2024-09-21T06:45:15.476545+0000","last_unstale":"2024-09-21T06:45:21.030357+0000","last_undegraded":"2024-09-21T06:45:21.030357+0000","last_fullsized":"2024-09-21T06:45:21.030357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031479+0000","last_change":"2024-09-21T06:45:14.465001+0000","last_active":"2024-09-21T06:45:21.031479+0000","last_peered":"2024-09-21T06:45:21.031479+0000","last_clean":"2024-09-21T06:45:21.031479+0000","last_became_active":"2024-09-21T06:45:14.463300+0000","last_became_peered":"2024-09-21T06:45:14.463300+0000","last_unstale":"2024-09-21T06:45:21.031479+0000","last_undegraded":"2024-09-21T06:45:21.031479+0000","last_fullsized":"2024-09-21T06:45:21.031479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508546+0000","last_change":"2024-09-21T06:45:19.504273+0000","last_active":"2024-09-21T06:45:20.508546+0000","last_peered":"2024-09-21T06:45:20.508546+0000","last_clean":"2024-09-21T06:45:20.508546+0000","last_became_active":"2024-09-21T06:45:19.503505+0000","last_became_peered":"2024-09-21T06:45:19.503505+0000","last_unstale":"2024-09-21T06:45:20.508546+0000","last_undegraded":"2024-09-21T06:45:20.508546+0000","last_fullsized":"2024-09-21T06:45:20.508546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:17.053992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030362+0000","last_change":"2024-09-21T06:45:15.478404+0000","last_active":"2024-09-21T06:45:21.030362+0000","last_peered":"2024-09-21T06:45:21.030362+0000","last_clean":"2024-09-21T06:45:21.030362+0000","last_became_active":"2024-09-21T06:45:15.478121+0000","last_became_peered":"2024-09-21T06:45:15.478121+0000","last_unstale":"2024-09-21T06:45:21.030362+0000","last_undegraded":"2024-09-21T06:45:21.030362+0000","last_fullsized":"2024-09-21T06:45:21.030362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506726+0000","last_change":"2024-09-21T06:45:14.465807+0000","last_active":"2024-09-21T06:45:20.506726+0000","last_peered":"2024-09-21T06:45:20.506726+0000","last_clean":"2024-09-21T06:45:20.506726+0000","last_became_active":"2024-09-21T06:45:14.464509+0000","last_became_peered":"2024-09-21T06:45:14.464509+0000","last_unstale":"2024-09-21T06:45:20.506726+0000","last_undegraded":"2024-09-21T06:45:20.506726+0000","last_fullsized":"2024-09-21T06:45:20.506726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508935+0000","last_change":"2024-09-21T06:45:19.504015+0000","last_active":"2024-09-21T06:45:20.508935+0000","last_peered":"2024-09-21T06:45:20.508935+0000","last_clean":"2024-09-21T06:45:20.508935+0000","last_became_active":"2024-09-21T06:45:19.503577+0000","last_became_peered":"2024-09-21T06:45:19.503577+0000","last_unstale":"2024-09-21T06:45:20.508935+0000","last_undegraded":"2024-09-21T06:45:20.508935+0000","last_fullsized":"2024-09-21T06:45:20.508935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030571+0000","last_change":"2024-09-21T06:45:15.474182+0000","last_active":"2024-09-21T06:45:21.030571+0000","last_peered":"2024-09-21T06:45:21.030571+0000","last_clean":"2024-09-21T06:45:21.030571+0000","last_became_active":"2024-09-21T06:45:15.473818+0000","last_became_peered":"2024-09-21T06:45:15.473818+0000","last_unstale":"2024-09-21T06:45:21.030571+0000","last_undegraded":"2024-09-21T06:45:21.030571+0000","last_fullsized":"2024-09-21T06:45:21.030571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030836+0000","last_change":"2024-09-21T06:45:14.469718+0000","last_active":"2024-09-21T06:45:21.030836+0000","last_peered":"2024-09-21T06:45:21.030836+0000","last_clean":"2024-09-21T06:45:21.030836+0000","last_became_active":"2024-09-21T06:45:14.469379+0000","last_became_peered":"2024-09-21T06:45:14.469379+0000","last_unstale":"2024-09-21T06:45:21.030836+0000","last_undegraded":"2024-09-21T06:45:21.030836+0000","last_fullsized":"2024-09-21T06:45:21.030836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507427+0000","last_change":"2024-09-21T06:45:19.496958+0000","last_active":"2024-09-21T06:45:20.507427+0000","last_peered":"2024-09-21T06:45:20.507427+0000","last_clean":"2024-09-21T06:45:20.507427+0000","last_became_active":"2024-09-21T06:45:19.496555+0000","last_became_peered":"2024-09-21T06:45:19.496555+0000","last_unstale":"2024-09-21T06:45:20.507427+0000","last_undegraded":"2024-09-21T06:45:20.507427+0000","last_fullsized":"2024-09-21T06:45:20.507427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:44.406905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506844+0000","last_change":"2024-09-21T06:45:15.472140+0000","last_active":"2024-09-21T06:45:20.506844+0000","last_peered":"2024-09-21T06:45:20.506844+0000","last_clean":"2024-09-21T06:45:20.506844+0000","last_became_active":"2024-09-21T06:45:15.471806+0000","last_became_peered":"2024-09-21T06:45:15.471806+0000","last_unstale":"2024-09-21T06:45:20.506844+0000","last_undegraded":"2024-09-21T06:45:20.506844+0000","last_fullsized":"2024-09-21T06:45:20.506844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:23.439120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506380+0000","last_change":"2024-09-21T06:45:14.469896+0000","last_active":"2024-09-21T06:45:20.506380+0000","last_peered":"2024-09-21T06:45:20.506380+0000","last_clean":"2024-09-21T06:45:20.506380+0000","last_became_active":"2024-09-21T06:45:14.469577+0000","last_became_peered":"2024-09-21T06:45:14.469577+0000","last_unstale":"2024-09-21T06:45:20.506380+0000","last_undegraded":"2024-09-21T06:45:20.506380+0000","last_fullsized":"2024-09-21T06:45:20.506380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031840+0000","last_change":"2024-09-21T06:45:19.500636+0000","last_active":"2024-09-21T06:45:21.031840+0000","last_peered":"2024-09-21T06:45:21.031840+0000","last_clean":"2024-09-21T06:45:21.031840+0000","last_became_active":"2024-09-21T06:45:19.500192+0000","last_became_peered":"2024-09-21T06:45:19.500192+0000","last_unstale":"2024-09-21T06:45:21.031840+0000","last_undegraded":"2024-09-21T06:45:21.031840+0000","last_fullsized":"2024-09-21T06:45:21.031840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.980314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507558+0000","last_change":"2024-09-21T06:45:15.472278+0000","last_active":"2024-09-21T06:45:20.507558+0000","last_peered":"2024-09-21T06:45:20.507558+0000","last_clean":"2024-09-21T06:45:20.507558+0000","last_became_active":"2024-09-21T06:45:15.471284+0000","last_became_peered":"2024-09-21T06:45:15.471284+0000","last_unstale":"2024-09-21T06:45:20.507558+0000","last_undegraded":"2024-09-21T06:45:20.507558+0000","last_fullsized":"2024-09-21T06:45:20.507558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:55.552947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506692+0000","last_change":"2024-09-21T06:45:14.467169+0000","last_active":"2024-09-21T06:45:20.506692+0000","last_peered":"2024-09-21T06:45:20.506692+0000","last_clean":"2024-09-21T06:45:20.506692+0000","last_became_active":"2024-09-21T06:45:14.466525+0000","last_became_peered":"2024-09-21T06:45:14.466525+0000","last_unstale":"2024-09-21T06:45:20.506692+0000","last_undegraded":"2024-09-21T06:45:20.506692+0000","last_fullsized":"2024-09-21T06:45:20.506692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:45.167373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032068+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:45:21.032068+0000","last_peered":"2024-09-21T06:45:21.032068+0000","last_clean":"2024-09-21T06:45:21.032068+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:45:21.032068+0000","last_undegraded":"2024-09-21T06:45:21.032068+0000","last_fullsized":"2024-09-21T06:45:21.032068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507129+0000","last_change":"2024-09-21T06:45:19.497733+0000","last_active":"2024-09-21T06:45:20.507129+0000","last_peered":"2024-09-21T06:45:20.507129+0000","last_clean":"2024-09-21T06:45:20.507129+0000","last_became_active":"2024-09-21T06:45:19.496641+0000","last_became_peered":"2024-09-21T06:45:19.496641+0000","last_unstale":"2024-09-21T06:45:20.507129+0000","last_undegraded":"2024-09-21T06:45:20.507129+0000","last_fullsized":"2024-09-21T06:45:20.507129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:51.619714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506921+0000","last_change":"2024-09-21T06:45:15.461030+0000","last_active":"2024-09-21T06:45:20.506921+0000","last_peered":"2024-09-21T06:45:20.506921+0000","last_clean":"2024-09-21T06:45:20.506921+0000","last_became_active":"2024-09-21T06:45:15.460706+0000","last_became_peered":"2024-09-21T06:45:15.460706+0000","last_unstale":"2024-09-21T06:45:20.506921+0000","last_undegraded":"2024-09-21T06:45:20.506921+0000","last_fullsized":"2024-09-21T06:45:20.506921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.152926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509104+0000","last_change":"2024-09-21T06:45:14.461396+0000","last_active":"2024-09-21T06:45:20.509104+0000","last_peered":"2024-09-21T06:45:20.509104+0000","last_clean":"2024-09-21T06:45:20.509104+0000","last_became_active":"2024-09-21T06:45:14.461060+0000","last_became_peered":"2024-09-21T06:45:14.461060+0000","last_unstale":"2024-09-21T06:45:20.509104+0000","last_undegraded":"2024-09-21T06:45:20.509104+0000","last_fullsized":"2024-09-21T06:45:20.509104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:55.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030371+0000","last_change":"2024-09-21T06:45:19.502382+0000","last_active":"2024-09-21T06:45:21.030371+0000","last_peered":"2024-09-21T06:45:21.030371+0000","last_clean":"2024-09-21T06:45:21.030371+0000","last_became_active":"2024-09-21T06:45:19.498046+0000","last_became_peered":"2024-09-21T06:45:19.498046+0000","last_unstale":"2024-09-21T06:45:21.030371+0000","last_undegraded":"2024-09-21T06:45:21.030371+0000","last_fullsized":"2024-09-21T06:45:21.030371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:24.671126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031519+0000","last_change":"2024-09-21T06:45:15.475752+0000","last_active":"2024-09-21T06:45:21.031519+0000","last_peered":"2024-09-21T06:45:21.031519+0000","last_clean":"2024-09-21T06:45:21.031519+0000","last_became_active":"2024-09-21T06:45:15.469527+0000","last_became_peered":"2024-09-21T06:45:15.469527+0000","last_unstale":"2024-09-21T06:45:21.031519+0000","last_undegraded":"2024-09-21T06:45:21.031519+0000","last_fullsized":"2024-09-21T06:45:21.031519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031784+0000","last_change":"2024-09-21T06:45:14.465420+0000","last_active":"2024-09-21T06:45:21.031784+0000","last_peered":"2024-09-21T06:45:21.031784+0000","last_clean":"2024-09-21T06:45:21.031784+0000","last_became_active":"2024-09-21T06:45:14.464543+0000","last_became_peered":"2024-09-21T06:45:14.464543+0000","last_unstale":"2024-09-21T06:45:21.031784+0000","last_undegraded":"2024-09-21T06:45:21.031784+0000","last_fullsized":"2024-09-21T06:45:21.031784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031628+0000","last_change":"2024-09-21T06:45:19.498221+0000","last_active":"2024-09-21T06:45:21.031628+0000","last_peered":"2024-09-21T06:45:21.031628+0000","last_clean":"2024-09-21T06:45:21.031628+0000","last_became_active":"2024-09-21T06:45:19.497811+0000","last_became_peered":"2024-09-21T06:45:19.497811+0000","last_unstale":"2024-09-21T06:45:21.031628+0000","last_undegraded":"2024-09-21T06:45:21.031628+0000","last_fullsized":"2024-09-21T06:45:21.031628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030455+0000","last_change":"2024-09-21T06:45:15.460768+0000","last_active":"2024-09-21T06:45:21.030455+0000","last_peered":"2024-09-21T06:45:21.030455+0000","last_clean":"2024-09-21T06:45:21.030455+0000","last_became_active":"2024-09-21T06:45:15.460450+0000","last_became_peered":"2024-09-21T06:45:15.460450+0000","last_unstale":"2024-09-21T06:45:21.030455+0000","last_undegraded":"2024-09-21T06:45:21.030455+0000","last_fullsized":"2024-09-21T06:45:21.030455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508036+0000","last_change":"2024-09-21T06:45:14.470579+0000","last_active":"2024-09-21T06:45:20.508036+0000","last_peered":"2024-09-21T06:45:20.508036+0000","last_clean":"2024-09-21T06:45:20.508036+0000","last_became_active":"2024-09-21T06:45:14.470201+0000","last_became_peered":"2024-09-21T06:45:14.470201+0000","last_unstale":"2024-09-21T06:45:20.508036+0000","last_undegraded":"2024-09-21T06:45:20.508036+0000","last_fullsized":"2024-09-21T06:45:20.508036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.320663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505901+0000","last_change":"2024-09-21T06:45:19.495223+0000","last_active":"2024-09-21T06:45:20.505901+0000","last_peered":"2024-09-21T06:45:20.505901+0000","last_clean":"2024-09-21T06:45:20.505901+0000","last_became_active":"2024-09-21T06:45:19.494717+0000","last_became_peered":"2024-09-21T06:45:19.494717+0000","last_unstale":"2024-09-21T06:45:20.505901+0000","last_undegraded":"2024-09-21T06:45:20.505901+0000","last_fullsized":"2024-09-21T06:45:20.505901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:24.234212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031148+0000","last_change":"2024-09-21T06:45:15.470009+0000","last_active":"2024-09-21T06:45:21.031148+0000","last_peered":"2024-09-21T06:45:21.031148+0000","last_clean":"2024-09-21T06:45:21.031148+0000","last_became_active":"2024-09-21T06:45:15.469587+0000","last_became_peered":"2024-09-21T06:45:15.469587+0000","last_unstale":"2024-09-21T06:45:21.031148+0000","last_undegraded":"2024-09-21T06:45:21.031148+0000","last_fullsized":"2024-09-21T06:45:21.031148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030553+0000","last_change":"2024-09-21T06:45:14.462600+0000","last_active":"2024-09-21T06:45:21.030553+0000","last_peered":"2024-09-21T06:45:21.030553+0000","last_clean":"2024-09-21T06:45:21.030553+0000","last_became_active":"2024-09-21T06:45:14.461889+0000","last_became_peered":"2024-09-21T06:45:14.461889+0000","last_unstale":"2024-09-21T06:45:21.030553+0000","last_undegraded":"2024-09-21T06:45:21.030553+0000","last_fullsized":"2024-09-21T06:45:21.030553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032139+0000","last_change":"2024-09-21T06:45:19.506001+0000","last_active":"2024-09-21T06:45:21.032139+0000","last_peered":"2024-09-21T06:45:21.032139+0000","last_clean":"2024-09-21T06:45:21.032139+0000","last_became_active":"2024-09-21T06:45:19.505578+0000","last_became_peered":"2024-09-21T06:45:19.505578+0000","last_unstale":"2024-09-21T06:45:21.032139+0000","last_undegraded":"2024-09-21T06:45:21.032139+0000","last_fullsized":"2024-09-21T06:45:21.032139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:57.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505958+0000","last_change":"2024-09-21T06:45:15.471185+0000","last_active":"2024-09-21T06:45:20.505958+0000","last_peered":"2024-09-21T06:45:20.505958+0000","last_clean":"2024-09-21T06:45:20.505958+0000","last_became_active":"2024-09-21T06:45:15.470821+0000","last_became_peered":"2024-09-21T06:45:15.470821+0000","last_unstale":"2024-09-21T06:45:20.505958+0000","last_undegraded":"2024-09-21T06:45:20.505958+0000","last_fullsized":"2024-09-21T06:45:20.505958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508648+0000","last_change":"2024-09-21T06:45:14.463644+0000","last_active":"2024-09-21T06:45:20.508648+0000","last_peered":"2024-09-21T06:45:20.508648+0000","last_clean":"2024-09-21T06:45:20.508648+0000","last_became_active":"2024-09-21T06:45:14.463293+0000","last_became_peered":"2024-09-21T06:45:14.463293+0000","last_unstale":"2024-09-21T06:45:20.508648+0000","last_undegraded":"2024-09-21T06:45:20.508648+0000","last_fullsized":"2024-09-21T06:45:20.508648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:29.580518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032313+0000","last_change":"2024-09-21T06:45:19.499445+0000","last_active":"2024-09-21T06:45:21.032313+0000","last_peered":"2024-09-21T06:45:21.032313+0000","last_clean":"2024-09-21T06:45:21.032313+0000","last_became_active":"2024-09-21T06:45:19.499033+0000","last_became_peered":"2024-09-21T06:45:19.499033+0000","last_unstale":"2024-09-21T06:45:21.032313+0000","last_undegraded":"2024-09-21T06:45:21.032313+0000","last_fullsized":"2024-09-21T06:45:21.032313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:39.968433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031953+0000","last_change":"2024-09-21T06:45:15.462244+0000","last_active":"2024-09-21T06:45:21.031953+0000","last_peered":"2024-09-21T06:45:21.031953+0000","last_clean":"2024-09-21T06:45:21.031953+0000","last_became_active":"2024-09-21T06:45:15.461962+0000","last_became_peered":"2024-09-21T06:45:15.461962+0000","last_unstale":"2024-09-21T06:45:21.031953+0000","last_undegraded":"2024-09-21T06:45:21.031953+0000","last_fullsized":"2024-09-21T06:45:21.031953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030514+0000","last_change":"2024-09-21T06:45:14.458035+0000","last_active":"2024-09-21T06:45:21.030514+0000","last_peered":"2024-09-21T06:45:21.030514+0000","last_clean":"2024-09-21T06:45:21.030514+0000","last_became_active":"2024-09-21T06:45:14.457478+0000","last_became_peered":"2024-09-21T06:45:14.457478+0000","last_unstale":"2024-09-21T06:45:21.030514+0000","last_undegraded":"2024-09-21T06:45:21.030514+0000","last_fullsized":"2024-09-21T06:45:21.030514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:46.341816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032245+0000","last_change":"2024-09-21T06:45:19.496692+0000","last_active":"2024-09-21T06:45:21.032245+0000","last_peered":"2024-09-21T06:45:21.032245+0000","last_clean":"2024-09-21T06:45:21.032245+0000","last_became_active":"2024-09-21T06:45:19.496273+0000","last_became_peered":"2024-09-21T06:45:19.496273+0000","last_unstale":"2024-09-21T06:45:21.032245+0000","last_undegraded":"2024-09-21T06:45:21.032245+0000","last_fullsized":"2024-09-21T06:45:21.032245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:08.738093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506263+0000","last_change":"2024-09-21T06:45:15.474239+0000","last_active":"2024-09-21T06:45:20.506263+0000","last_peered":"2024-09-21T06:45:20.506263+0000","last_clean":"2024-09-21T06:45:20.506263+0000","last_became_active":"2024-09-21T06:45:15.473936+0000","last_became_peered":"2024-09-21T06:45:15.473936+0000","last_unstale":"2024-09-21T06:45:20.506263+0000","last_undegraded":"2024-09-21T06:45:20.506263+0000","last_fullsized":"2024-09-21T06:45:20.506263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:07.138927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506611+0000","last_change":"2024-09-21T06:45:14.465782+0000","last_active":"2024-09-21T06:45:20.506611+0000","last_peered":"2024-09-21T06:45:20.506611+0000","last_clean":"2024-09-21T06:45:20.506611+0000","last_became_active":"2024-09-21T06:45:14.464892+0000","last_became_peered":"2024-09-21T06:45:14.464892+0000","last_unstale":"2024-09-21T06:45:20.506611+0000","last_undegraded":"2024-09-21T06:45:20.506611+0000","last_fullsized":"2024-09-21T06:45:20.506611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508817+0000","last_change":"2024-09-21T06:45:19.496653+0000","last_active":"2024-09-21T06:45:20.508817+0000","last_peered":"2024-09-21T06:45:20.508817+0000","last_clean":"2024-09-21T06:45:20.508817+0000","last_became_active":"2024-09-21T06:45:19.496215+0000","last_became_peered":"2024-09-21T06:45:19.496215+0000","last_unstale":"2024-09-21T06:45:20.508817+0000","last_undegraded":"2024-09-21T06:45:20.508817+0000","last_fullsized":"2024-09-21T06:45:20.508817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507938+0000","last_change":"2024-09-21T06:45:15.468032+0000","last_active":"2024-09-21T06:45:20.507938+0000","last_peered":"2024-09-21T06:45:20.507938+0000","last_clean":"2024-09-21T06:45:20.507938+0000","last_became_active":"2024-09-21T06:45:15.467695+0000","last_became_peered":"2024-09-21T06:45:15.467695+0000","last_unstale":"2024-09-21T06:45:20.507938+0000","last_undegraded":"2024-09-21T06:45:20.507938+0000","last_fullsized":"2024-09-21T06:45:20.507938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:48.275548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031757+0000","last_change":"2024-09-21T06:45:14.472291+0000","last_active":"2024-09-21T06:45:21.031757+0000","last_peered":"2024-09-21T06:45:21.031757+0000","last_clean":"2024-09-21T06:45:21.031757+0000","last_became_active":"2024-09-21T06:45:14.472043+0000","last_became_peered":"2024-09-21T06:45:14.472043+0000","last_unstale":"2024-09-21T06:45:21.031757+0000","last_undegraded":"2024-09-21T06:45:21.031757+0000","last_fullsized":"2024-09-21T06:45:21.031757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506551+0000","last_change":"2024-09-21T06:45:19.499994+0000","last_active":"2024-09-21T06:45:20.506551+0000","last_peered":"2024-09-21T06:45:20.506551+0000","last_clean":"2024-09-21T06:45:20.506551+0000","last_became_active":"2024-09-21T06:45:19.497222+0000","last_became_peered":"2024-09-21T06:45:19.497222+0000","last_unstale":"2024-09-21T06:45:20.506551+0000","last_undegraded":"2024-09-21T06:45:20.506551+0000","last_fullsized":"2024-09-21T06:45:20.506551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:50.997451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030936+0000","last_change":"2024-09-21T06:45:15.477441+0000","last_active":"2024-09-21T06:45:21.030936+0000","last_peered":"2024-09-21T06:45:21.030936+0000","last_clean":"2024-09-21T06:45:21.030936+0000","last_became_active":"2024-09-21T06:45:15.477115+0000","last_became_peered":"2024-09-21T06:45:15.477115+0000","last_unstale":"2024-09-21T06:45:21.030936+0000","last_undegraded":"2024-09-21T06:45:21.030936+0000","last_fullsized":"2024-09-21T06:45:21.030936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031065+0000","last_change":"2024-09-21T06:45:14.469539+0000","last_active":"2024-09-21T06:45:21.031065+0000","last_peered":"2024-09-21T06:45:21.031065+0000","last_clean":"2024-09-21T06:45:21.031065+0000","last_became_active":"2024-09-21T06:45:14.469221+0000","last_became_peered":"2024-09-21T06:45:14.469221+0000","last_unstale":"2024-09-21T06:45:21.031065+0000","last_undegraded":"2024-09-21T06:45:21.031065+0000","last_fullsized":"2024-09-21T06:45:21.031065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:28.598849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507385+0000","last_change":"2024-09-21T06:45:19.506781+0000","last_active":"2024-09-21T06:45:20.507385+0000","last_peered":"2024-09-21T06:45:20.507385+0000","last_clean":"2024-09-21T06:45:20.507385+0000","last_became_active":"2024-09-21T06:45:19.501911+0000","last_became_peered":"2024-09-21T06:45:19.501911+0000","last_unstale":"2024-09-21T06:45:20.507385+0000","last_undegraded":"2024-09-21T06:45:20.507385+0000","last_fullsized":"2024-09-21T06:45:20.507385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506203+0000","last_change":"2024-09-21T06:45:15.468579+0000","last_active":"2024-09-21T06:45:20.506203+0000","last_peered":"2024-09-21T06:45:20.506203+0000","last_clean":"2024-09-21T06:45:20.506203+0000","last_became_active":"2024-09-21T06:45:15.468329+0000","last_became_peered":"2024-09-21T06:45:15.468329+0000","last_unstale":"2024-09-21T06:45:20.506203+0000","last_undegraded":"2024-09-21T06:45:20.506203+0000","last_fullsized":"2024-09-21T06:45:20.506203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:07.302209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032248+0000","last_change":"2024-09-21T06:45:14.469511+0000","last_active":"2024-09-21T06:45:21.032248+0000","last_peered":"2024-09-21T06:45:21.032248+0000","last_clean":"2024-09-21T06:45:21.032248+0000","last_became_active":"2024-09-21T06:45:14.469153+0000","last_became_peered":"2024-09-21T06:45:14.469153+0000","last_unstale":"2024-09-21T06:45:21.032248+0000","last_undegraded":"2024-09-21T06:45:21.032248+0000","last_fullsized":"2024-09-21T06:45:21.032248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:21.542258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030751+0000","last_change":"2024-09-21T06:45:19.506219+0000","last_active":"2024-09-21T06:45:21.030751+0000","last_peered":"2024-09-21T06:45:21.030751+0000","last_clean":"2024-09-21T06:45:21.030751+0000","last_became_active":"2024-09-21T06:45:19.505827+0000","last_became_peered":"2024-09-21T06:45:19.505827+0000","last_unstale":"2024-09-21T06:45:21.030751+0000","last_undegraded":"2024-09-21T06:45:21.030751+0000","last_fullsized":"2024-09-21T06:45:21.030751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:15.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032207+0000","last_change":"2024-09-21T06:45:15.467787+0000","last_active":"2024-09-21T06:45:21.032207+0000","last_peered":"2024-09-21T06:45:21.032207+0000","last_clean":"2024-09-21T06:45:21.032207+0000","last_became_active":"2024-09-21T06:45:15.467470+0000","last_became_peered":"2024-09-21T06:45:15.467470+0000","last_unstale":"2024-09-21T06:45:21.032207+0000","last_undegraded":"2024-09-21T06:45:21.032207+0000","last_fullsized":"2024-09-21T06:45:21.032207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030710+0000","last_change":"2024-09-21T06:45:14.466812+0000","last_active":"2024-09-21T06:45:21.030710+0000","last_peered":"2024-09-21T06:45:21.030710+0000","last_clean":"2024-09-21T06:45:21.030710+0000","last_became_active":"2024-09-21T06:45:14.466356+0000","last_became_peered":"2024-09-21T06:45:14.466356+0000","last_unstale":"2024-09-21T06:45:21.030710+0000","last_undegraded":"2024-09-21T06:45:21.030710+0000","last_fullsized":"2024-09-21T06:45:21.030710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030568+0000","last_change":"2024-09-21T06:45:19.504492+0000","last_active":"2024-09-21T06:45:21.030568+0000","last_peered":"2024-09-21T06:45:21.030568+0000","last_clean":"2024-09-21T06:45:21.030568+0000","last_became_active":"2024-09-21T06:45:19.503845+0000","last_became_peered":"2024-09-21T06:45:19.503845+0000","last_unstale":"2024-09-21T06:45:21.030568+0000","last_undegraded":"2024-09-21T06:45:21.030568+0000","last_fullsized":"2024-09-21T06:45:21.030568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:50.206431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031079+0000","last_change":"2024-09-21T06:45:15.467027+0000","last_active":"2024-09-21T06:45:21.031079+0000","last_peered":"2024-09-21T06:45:21.031079+0000","last_clean":"2024-09-21T06:45:21.031079+0000","last_became_active":"2024-09-21T06:45:15.466419+0000","last_became_peered":"2024-09-21T06:45:15.466419+0000","last_unstale":"2024-09-21T06:45:21.031079+0000","last_undegraded":"2024-09-21T06:45:21.031079+0000","last_fullsized":"2024-09-21T06:45:21.031079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032027+0000","last_change":"2024-09-21T06:45:14.467184+0000","last_active":"2024-09-21T06:45:21.032027+0000","last_peered":"2024-09-21T06:45:21.032027+0000","last_clean":"2024-09-21T06:45:21.032027+0000","last_became_active":"2024-09-21T06:45:14.466888+0000","last_became_peered":"2024-09-21T06:45:14.466888+0000","last_unstale":"2024-09-21T06:45:21.032027+0000","last_undegraded":"2024-09-21T06:45:21.032027+0000","last_fullsized":"2024-09-21T06:45:21.032027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:14.862437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507441+0000","last_change":"2024-09-21T06:45:19.502432+0000","last_active":"2024-09-21T06:45:20.507441+0000","last_peered":"2024-09-21T06:45:20.507441+0000","last_clean":"2024-09-21T06:45:20.507441+0000","last_became_active":"2024-09-21T06:45:19.501859+0000","last_became_peered":"2024-09-21T06:45:19.501859+0000","last_unstale":"2024-09-21T06:45:20.507441+0000","last_undegraded":"2024-09-21T06:45:20.507441+0000","last_fullsized":"2024-09-21T06:45:20.507441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507823+0000","last_change":"2024-09-21T06:45:19.500757+0000","last_active":"2024-09-21T06:45:20.507823+0000","last_peered":"2024-09-21T06:45:20.507823+0000","last_clean":"2024-09-21T06:45:20.507823+0000","last_became_active":"2024-09-21T06:45:19.500330+0000","last_became_peered":"2024-09-21T06:45:19.500330+0000","last_unstale":"2024-09-21T06:45:20.507823+0000","last_undegraded":"2024-09-21T06:45:20.507823+0000","last_fullsized":"2024-09-21T06:45:20.507823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:54.472367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507536+0000","last_change":"2024-09-21T06:45:15.468255+0000","last_active":"2024-09-21T06:45:20.507536+0000","last_peered":"2024-09-21T06:45:20.507536+0000","last_clean":"2024-09-21T06:45:20.507536+0000","last_became_active":"2024-09-21T06:45:15.467926+0000","last_became_peered":"2024-09-21T06:45:15.467926+0000","last_unstale":"2024-09-21T06:45:20.507536+0000","last_undegraded":"2024-09-21T06:45:20.507536+0000","last_fullsized":"2024-09-21T06:45:20.507536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:46.878776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506248+0000","last_change":"2024-09-21T06:45:14.469185+0000","last_active":"2024-09-21T06:45:20.506248+0000","last_peered":"2024-09-21T06:45:20.506248+0000","last_clean":"2024-09-21T06:45:20.506248+0000","last_became_active":"2024-09-21T06:45:14.468890+0000","last_became_peered":"2024-09-21T06:45:14.468890+0000","last_unstale":"2024-09-21T06:45:20.506248+0000","last_undegraded":"2024-09-21T06:45:20.506248+0000","last_fullsized":"2024-09-21T06:45:20.506248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506605+0000","last_change":"2024-09-21T06:45:19.499608+0000","last_active":"2024-09-21T06:45:20.506605+0000","last_peered":"2024-09-21T06:45:20.506605+0000","last_clean":"2024-09-21T06:45:20.506605+0000","last_became_active":"2024-09-21T06:45:19.498220+0000","last_became_peered":"2024-09-21T06:45:19.498220+0000","last_unstale":"2024-09-21T06:45:20.506605+0000","last_undegraded":"2024-09-21T06:45:20.506605+0000","last_fullsized":"2024-09-21T06:45:20.506605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:22.588015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030646+0000","last_change":"2024-09-21T06:45:15.470401+0000","last_active":"2024-09-21T06:45:21.030646+0000","last_peered":"2024-09-21T06:45:21.030646+0000","last_clean":"2024-09-21T06:45:21.030646+0000","last_became_active":"2024-09-21T06:45:15.469676+0000","last_became_peered":"2024-09-21T06:45:15.469676+0000","last_unstale":"2024-09-21T06:45:21.030646+0000","last_undegraded":"2024-09-21T06:45:21.030646+0000","last_fullsized":"2024-09-21T06:45:21.030646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506888+0000","last_change":"2024-09-21T06:45:14.468923+0000","last_active":"2024-09-21T06:45:20.506888+0000","last_peered":"2024-09-21T06:45:20.506888+0000","last_clean":"2024-09-21T06:45:20.506888+0000","last_became_active":"2024-09-21T06:45:14.468591+0000","last_became_peered":"2024-09-21T06:45:14.468591+0000","last_unstale":"2024-09-21T06:45:20.506888+0000","last_undegraded":"2024-09-21T06:45:20.506888+0000","last_fullsized":"2024-09-21T06:45:20.506888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:25.844164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506904+0000","last_change":"2024-09-21T06:45:14.466145+0000","last_active":"2024-09-21T06:45:20.506904+0000","last_peered":"2024-09-21T06:45:20.506904+0000","last_clean":"2024-09-21T06:45:20.506904+0000","last_became_active":"2024-09-21T06:45:14.465260+0000","last_became_peered":"2024-09-21T06:45:14.465260+0000","last_unstale":"2024-09-21T06:45:20.506904+0000","last_undegraded":"2024-09-21T06:45:20.506904+0000","last_fullsized":"2024-09-21T06:45:20.506904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.506269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507474+0000","last_change":"2024-09-21T06:45:15.479102+0000","last_active":"2024-09-21T06:45:20.507474+0000","last_peered":"2024-09-21T06:45:20.507474+0000","last_clean":"2024-09-21T06:45:20.507474+0000","last_became_active":"2024-09-21T06:45:15.477931+0000","last_became_peered":"2024-09-21T06:45:15.477931+0000","last_unstale":"2024-09-21T06:45:20.507474+0000","last_undegraded":"2024-09-21T06:45:20.507474+0000","last_fullsized":"2024-09-21T06:45:20.507474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:15.776123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508961+0000","last_change":"2024-09-21T06:45:19.496596+0000","last_active":"2024-09-21T06:45:20.508961+0000","last_peered":"2024-09-21T06:45:20.508961+0000","last_clean":"2024-09-21T06:45:20.508961+0000","last_became_active":"2024-09-21T06:45:19.496164+0000","last_became_peered":"2024-09-21T06:45:19.496164+0000","last_unstale":"2024-09-21T06:45:20.508961+0000","last_undegraded":"2024-09-21T06:45:20.508961+0000","last_fullsized":"2024-09-21T06:45:20.508961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:50.753263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031547+0000","last_change":"2024-09-21T06:45:14.465515+0000","last_active":"2024-09-21T06:45:21.031547+0000","last_peered":"2024-09-21T06:45:21.031547+0000","last_clean":"2024-09-21T06:45:21.031547+0000","last_became_active":"2024-09-21T06:45:14.464349+0000","last_became_peered":"2024-09-21T06:45:14.464349+0000","last_unstale":"2024-09-21T06:45:21.031547+0000","last_undegraded":"2024-09-21T06:45:21.031547+0000","last_fullsized":"2024-09-21T06:45:21.031547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031752+0000","last_change":"2024-09-21T06:45:15.462226+0000","last_active":"2024-09-21T06:45:21.031752+0000","last_peered":"2024-09-21T06:45:21.031752+0000","last_clean":"2024-09-21T06:45:21.031752+0000","last_became_active":"2024-09-21T06:45:15.461939+0000","last_became_peered":"2024-09-21T06:45:15.461939+0000","last_unstale":"2024-09-21T06:45:21.031752+0000","last_undegraded":"2024-09-21T06:45:21.031752+0000","last_fullsized":"2024-09-21T06:45:21.031752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032165+0000","last_change":"2024-09-21T06:45:19.503463+0000","last_active":"2024-09-21T06:45:21.032165+0000","last_peered":"2024-09-21T06:45:21.032165+0000","last_clean":"2024-09-21T06:45:21.032165+0000","last_became_active":"2024-09-21T06:45:19.502870+0000","last_became_peered":"2024-09-21T06:45:19.502870+0000","last_unstale":"2024-09-21T06:45:21.032165+0000","last_undegraded":"2024-09-21T06:45:21.032165+0000","last_fullsized":"2024-09-21T06:45:21.032165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:41.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030040+0000","last_change":"2024-09-21T06:45:15.469971+0000","last_active":"2024-09-21T06:45:21.030040+0000","last_peered":"2024-09-21T06:45:21.030040+0000","last_clean":"2024-09-21T06:45:21.030040+0000","last_became_active":"2024-09-21T06:45:15.469549+0000","last_became_peered":"2024-09-21T06:45:15.469549+0000","last_unstale":"2024-09-21T06:45:21.030040+0000","last_undegraded":"2024-09-21T06:45:21.030040+0000","last_fullsized":"2024-09-21T06:45:21.030040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030790+0000","last_change":"2024-09-21T06:45:15.467015+0000","last_active":"2024-09-21T06:45:21.030790+0000","last_peered":"2024-09-21T06:45:21.030790+0000","last_clean":"2024-09-21T06:45:21.030790+0000","last_became_active":"2024-09-21T06:45:15.466693+0000","last_became_peered":"2024-09-21T06:45:15.466693+0000","last_unstale":"2024-09-21T06:45:21.030790+0000","last_undegraded":"2024-09-21T06:45:21.030790+0000","last_fullsized":"2024-09-21T06:45:21.030790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506161+0000","last_change":"2024-09-21T06:45:15.464050+0000","last_active":"2024-09-21T06:45:20.506161+0000","last_peered":"2024-09-21T06:45:20.506161+0000","last_clean":"2024-09-21T06:45:20.506161+0000","last_became_active":"2024-09-21T06:45:15.463716+0000","last_became_peered":"2024-09-21T06:45:15.463716+0000","last_unstale":"2024-09-21T06:45:20.506161+0000","last_undegraded":"2024-09-21T06:45:20.506161+0000","last_fullsized":"2024-09-21T06:45:20.506161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:06.081721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031406+0000","last_change":"2024-09-21T06:45:15.462023+0000","last_active":"2024-09-21T06:45:21.031406+0000","last_peered":"2024-09-21T06:45:21.031406+0000","last_clean":"2024-09-21T06:45:21.031406+0000","last_became_active":"2024-09-21T06:45:15.461673+0000","last_became_peered":"2024-09-21T06:45:15.461673+0000","last_unstale":"2024-09-21T06:45:21.031406+0000","last_undegraded":"2024-09-21T06:45:21.031406+0000","last_fullsized":"2024-09-21T06:45:21.031406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:34.273188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508975+0000","last_change":"2024-09-21T06:45:15.476773+0000","last_active":"2024-09-21T06:45:20.508975+0000","last_peered":"2024-09-21T06:45:20.508975+0000","last_clean":"2024-09-21T06:45:20.508975+0000","last_became_active":"2024-09-21T06:45:15.476452+0000","last_became_peered":"2024-09-21T06:45:15.476452+0000","last_unstale":"2024-09-21T06:45:20.508975+0000","last_undegraded":"2024-09-21T06:45:20.508975+0000","last_fullsized":"2024-09-21T06:45:20.508975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507490+0000","last_change":"2024-09-21T06:45:15.476075+0000","last_active":"2024-09-21T06:45:20.507490+0000","last_peered":"2024-09-21T06:45:20.507490+0000","last_clean":"2024-09-21T06:45:20.507490+0000","last_became_active":"2024-09-21T06:45:15.475645+0000","last_became_peered":"2024-09-21T06:45:15.475645+0000","last_unstale":"2024-09-21T06:45:20.507490+0000","last_undegraded":"2024-09-21T06:45:20.507490+0000","last_fullsized":"2024-09-21T06:45:20.507490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:11.856243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031037+0000","last_change":"2024-09-21T06:45:15.467350+0000","last_active":"2024-09-21T06:45:21.031037+0000","last_peered":"2024-09-21T06:45:21.031037+0000","last_clean":"2024-09-21T06:45:21.031037+0000","last_became_active":"2024-09-21T06:45:15.466738+0000","last_became_peered":"2024-09-21T06:45:15.466738+0000","last_unstale":"2024-09-21T06:45:21.031037+0000","last_undegraded":"2024-09-21T06:45:21.031037+0000","last_fullsized":"2024-09-21T06:45:21.031037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031917+0000","last_change":"2024-09-21T06:45:15.474042+0000","last_active":"2024-09-21T06:45:21.031917+0000","last_peered":"2024-09-21T06:45:21.031917+0000","last_clean":"2024-09-21T06:45:21.031917+0000","last_became_active":"2024-09-21T06:45:15.472921+0000","last_became_peered":"2024-09-21T06:45:15.472921+0000","last_unstale":"2024-09-21T06:45:21.031917+0000","last_undegraded":"2024-09-21T06:45:21.031917+0000","last_fullsized":"2024-09-21T06:45:21.031917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:55.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506242+0000","last_change":"2024-09-21T06:45:15.465615+0000","last_active":"2024-09-21T06:45:20.506242+0000","last_peered":"2024-09-21T06:45:20.506242+0000","last_clean":"2024-09-21T06:45:20.506242+0000","last_became_active":"2024-09-21T06:45:15.465295+0000","last_became_peered":"2024-09-21T06:45:15.465295+0000","last_unstale":"2024-09-21T06:45:20.506242+0000","last_undegraded":"2024-09-21T06:45:20.506242+0000","last_fullsized":"2024-09-21T06:45:20.506242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:49.579027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030830+0000","last_change":"2024-09-21T06:45:15.471829+0000","last_active":"2024-09-21T06:45:21.030830+0000","last_peered":"2024-09-21T06:45:21.030830+0000","last_clean":"2024-09-21T06:45:21.030830+0000","last_became_active":"2024-09-21T06:45:15.470063+0000","last_became_peered":"2024-09-21T06:45:15.470063+0000","last_unstale":"2024-09-21T06:45:21.030830+0000","last_undegraded":"2024-09-21T06:45:21.030830+0000","last_fullsized":"2024-09-21T06:45:21.030830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031632+0000","last_change":"2024-09-21T06:45:15.460833+0000","last_active":"2024-09-21T06:45:21.031632+0000","last_peered":"2024-09-21T06:45:21.031632+0000","last_clean":"2024-09-21T06:45:21.031632+0000","last_became_active":"2024-09-21T06:45:15.460524+0000","last_became_peered":"2024-09-21T06:45:15.460524+0000","last_unstale":"2024-09-21T06:45:21.031632+0000","last_undegraded":"2024-09-21T06:45:21.031632+0000","last_fullsized":"2024-09-21T06:45:21.031632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507357+0000","last_change":"2024-09-21T06:45:15.468655+0000","last_active":"2024-09-21T06:45:20.507357+0000","last_peered":"2024-09-21T06:45:20.507357+0000","last_clean":"2024-09-21T06:45:20.507357+0000","last_became_active":"2024-09-21T06:45:15.468310+0000","last_became_peered":"2024-09-21T06:45:15.468310+0000","last_unstale":"2024-09-21T06:45:20.507357+0000","last_undegraded":"2024-09-21T06:45:20.507357+0000","last_fullsized":"2024-09-21T06:45:20.507357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031414+0000","last_change":"2024-09-21T06:45:15.470151+0000","last_active":"2024-09-21T06:45:21.031414+0000","last_peered":"2024-09-21T06:45:21.031414+0000","last_clean":"2024-09-21T06:45:21.031414+0000","last_became_active":"2024-09-21T06:45:15.469649+0000","last_became_peered":"2024-09-21T06:45:15.469649+0000","last_unstale":"2024-09-21T06:45:21.031414+0000","last_undegraded":"2024-09-21T06:45:21.031414+0000","last_fullsized":"2024-09-21T06:45:21.031414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:37.996645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507052+0000","last_change":"2024-09-21T06:45:15.461412+0000","last_active":"2024-09-21T06:45:20.507052+0000","last_peered":"2024-09-21T06:45:20.507052+0000","last_clean":"2024-09-21T06:45:20.507052+0000","last_became_active":"2024-09-21T06:45:15.461063+0000","last_became_peered":"2024-09-21T06:45:15.461063+0000","last_unstale":"2024-09-21T06:45:20.507052+0000","last_undegraded":"2024-09-21T06:45:20.507052+0000","last_fullsized":"2024-09-21T06:45:20.507052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:15.663968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031669+0000","last_change":"2024-09-21T06:45:15.471096+0000","last_active":"2024-09-21T06:45:21.031669+0000","last_peered":"2024-09-21T06:45:21.031669+0000","last_clean":"2024-09-21T06:45:21.031669+0000","last_became_active":"2024-09-21T06:45:15.470745+0000","last_became_peered":"2024-09-21T06:45:15.470745+0000","last_unstale":"2024-09-21T06:45:21.031669+0000","last_undegraded":"2024-09-21T06:45:21.031669+0000","last_fullsized":"2024-09-21T06:45:21.031669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506933+0000","last_change":"2024-09-21T06:45:15.471359+0000","last_active":"2024-09-21T06:45:20.506933+0000","last_peered":"2024-09-21T06:45:20.506933+0000","last_clean":"2024-09-21T06:45:20.506933+0000","last_became_active":"2024-09-21T06:45:15.471058+0000","last_became_peered":"2024-09-21T06:45:15.471058+0000","last_unstale":"2024-09-21T06:45:20.506933+0000","last_undegraded":"2024-09-21T06:45:20.506933+0000","last_fullsized":"2024-09-21T06:45:20.506933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:16.265829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505982+0000","last_change":"2024-09-21T06:45:15.468454+0000","last_active":"2024-09-21T06:45:20.505982+0000","last_peered":"2024-09-21T06:45:20.505982+0000","last_clean":"2024-09-21T06:45:20.505982+0000","last_became_active":"2024-09-21T06:45:15.468156+0000","last_became_peered":"2024-09-21T06:45:15.468156+0000","last_unstale":"2024-09-21T06:45:20.505982+0000","last_undegraded":"2024-09-21T06:45:20.505982+0000","last_fullsized":"2024-09-21T06:45:20.505982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030537+0000","last_change":"2024-09-21T06:45:15.473222+0000","last_active":"2024-09-21T06:45:21.030537+0000","last_peered":"2024-09-21T06:45:21.030537+0000","last_clean":"2024-09-21T06:45:21.030537+0000","last_became_active":"2024-09-21T06:45:15.470238+0000","last_became_peered":"2024-09-21T06:45:15.470238+0000","last_unstale":"2024-09-21T06:45:21.030537+0000","last_undegraded":"2024-09-21T06:45:21.030537+0000","last_fullsized":"2024-09-21T06:45:21.030537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:15.814240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507835+0000","last_change":"2024-09-21T06:45:15.469249+0000","last_active":"2024-09-21T06:45:20.507835+0000","last_peered":"2024-09-21T06:45:20.507835+0000","last_clean":"2024-09-21T06:45:20.507835+0000","last_became_active":"2024-09-21T06:45:15.468891+0000","last_became_peered":"2024-09-21T06:45:15.468891+0000","last_unstale":"2024-09-21T06:45:20.507835+0000","last_undegraded":"2024-09-21T06:45:20.507835+0000","last_fullsized":"2024-09-21T06:45:20.507835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:30.588823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508365+0000","last_change":"2024-09-21T06:45:15.474819+0000","last_active":"2024-09-21T06:45:20.508365+0000","last_peered":"2024-09-21T06:45:20.508365+0000","last_clean":"2024-09-21T06:45:20.508365+0000","last_became_active":"2024-09-21T06:45:15.474480+0000","last_became_peered":"2024-09-21T06:45:15.474480+0000","last_unstale":"2024-09-21T06:45:20.508365+0000","last_undegraded":"2024-09-21T06:45:20.508365+0000","last_fullsized":"2024-09-21T06:45:20.508365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:33.846712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031351+0000","last_change":"2024-09-21T06:45:15.470503+0000","last_active":"2024-09-21T06:45:21.031351+0000","last_peered":"2024-09-21T06:45:21.031351+0000","last_clean":"2024-09-21T06:45:21.031351+0000","last_became_active":"2024-09-21T06:45:15.469857+0000","last_became_peered":"2024-09-21T06:45:15.469857+0000","last_unstale":"2024-09-21T06:45:21.031351+0000","last_undegraded":"2024-09-21T06:45:21.031351+0000","last_fullsized":"2024-09-21T06:45:21.031351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030846+0000","last_change":"2024-09-21T06:45:15.476713+0000","last_active":"2024-09-21T06:45:21.030846+0000","last_peered":"2024-09-21T06:45:21.030846+0000","last_clean":"2024-09-21T06:45:21.030846+0000","last_became_active":"2024-09-21T06:45:15.476116+0000","last_became_peered":"2024-09-21T06:45:15.476116+0000","last_unstale":"2024-09-21T06:45:21.030846+0000","last_undegraded":"2024-09-21T06:45:21.030846+0000","last_fullsized":"2024-09-21T06:45:21.030846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:38.613487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030607+0000","last_change":"2024-09-21T06:45:15.477443+0000","last_active":"2024-09-21T06:45:21.030607+0000","last_peered":"2024-09-21T06:45:21.030607+0000","last_clean":"2024-09-21T06:45:21.030607+0000","last_became_active":"2024-09-21T06:45:15.476960+0000","last_became_peered":"2024-09-21T06:45:15.476960+0000","last_unstale":"2024-09-21T06:45:21.030607+0000","last_undegraded":"2024-09-21T06:45:21.030607+0000","last_fullsized":"2024-09-21T06:45:21.030607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:43.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031952+0000","last_change":"2024-09-21T06:45:15.463639+0000","last_active":"2024-09-21T06:45:21.031952+0000","last_peered":"2024-09-21T06:45:21.031952+0000","last_clean":"2024-09-21T06:45:21.031952+0000","last_became_active":"2024-09-21T06:45:15.463208+0000","last_became_peered":"2024-09-21T06:45:15.463208+0000","last_unstale":"2024-09-21T06:45:21.031952+0000","last_undegraded":"2024-09-21T06:45:21.031952+0000","last_fullsized":"2024-09-21T06:45:21.031952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030528+0000","last_change":"2024-09-21T06:45:15.473790+0000","last_active":"2024-09-21T06:45:21.030528+0000","last_peered":"2024-09-21T06:45:21.030528+0000","last_clean":"2024-09-21T06:45:21.030528+0000","last_became_active":"2024-09-21T06:45:15.472962+0000","last_became_peered":"2024-09-21T06:45:15.472962+0000","last_unstale":"2024-09-21T06:45:21.030528+0000","last_undegraded":"2024-09-21T06:45:21.030528+0000","last_fullsized":"2024-09-21T06:45:21.030528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:47.239754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030418+0000","last_change":"2024-09-21T06:45:15.469545+0000","last_active":"2024-09-21T06:45:21.030418+0000","last_peered":"2024-09-21T06:45:21.030418+0000","last_clean":"2024-09-21T06:45:21.030418+0000","last_became_active":"2024-09-21T06:45:15.469169+0000","last_became_peered":"2024-09-21T06:45:15.469169+0000","last_unstale":"2024-09-21T06:45:21.030418+0000","last_undegraded":"2024-09-21T06:45:21.030418+0000","last_fullsized":"2024-09-21T06:45:21.030418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030577+0000","last_change":"2024-09-21T06:45:15.466759+0000","last_active":"2024-09-21T06:45:21.030577+0000","last_peered":"2024-09-21T06:45:21.030577+0000","last_clean":"2024-09-21T06:45:21.030577+0000","last_became_active":"2024-09-21T06:45:15.466478+0000","last_became_peered":"2024-09-21T06:45:15.466478+0000","last_unstale":"2024-09-21T06:45:21.030577+0000","last_undegraded":"2024-09-21T06:45:21.030577+0000","last_fullsized":"2024-09-21T06:45:21.030577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030244+0000","last_change":"2024-09-21T06:45:15.472637+0000","last_active":"2024-09-21T06:45:21.030244+0000","last_peered":"2024-09-21T06:45:21.030244+0000","last_clean":"2024-09-21T06:45:21.030244+0000","last_became_active":"2024-09-21T06:45:15.470326+0000","last_became_peered":"2024-09-21T06:45:15.470326+0000","last_unstale":"2024-09-21T06:45:21.030244+0000","last_undegraded":"2024-09-21T06:45:21.030244+0000","last_fullsized":"2024-09-21T06:45:21.030244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:20.637139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030961+0000","last_change":"2024-09-21T06:45:15.461625+0000","last_active":"2024-09-21T06:45:21.030961+0000","last_peered":"2024-09-21T06:45:21.030961+0000","last_clean":"2024-09-21T06:45:21.030961+0000","last_became_active":"2024-09-21T06:45:15.461296+0000","last_became_peered":"2024-09-21T06:45:15.461296+0000","last_unstale":"2024-09-21T06:45:21.030961+0000","last_undegraded":"2024-09-21T06:45:21.030961+0000","last_fullsized":"2024-09-21T06:45:21.030961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031625+0000","last_change":"2024-09-21T06:45:15.474538+0000","last_active":"2024-09-21T06:45:21.031625+0000","last_peered":"2024-09-21T06:45:21.031625+0000","last_clean":"2024-09-21T06:45:21.031625+0000","last_became_active":"2024-09-21T06:45:15.474164+0000","last_became_peered":"2024-09-21T06:45:15.474164+0000","last_unstale":"2024-09-21T06:45:21.031625+0000","last_undegraded":"2024-09-21T06:45:21.031625+0000","last_fullsized":"2024-09-21T06:45:21.031625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:08.489330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031957+0000","last_change":"2024-09-21T06:45:15.475008+0000","last_active":"2024-09-21T06:45:21.031957+0000","last_peered":"2024-09-21T06:45:21.031957+0000","last_clean":"2024-09-21T06:45:21.031957+0000","last_became_active":"2024-09-21T06:45:15.474621+0000","last_became_peered":"2024-09-21T06:45:15.474621+0000","last_unstale":"2024-09-21T06:45:21.031957+0000","last_undegraded":"2024-09-21T06:45:21.031957+0000","last_fullsized":"2024-09-21T06:45:21.031957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030146+0000","last_change":"2024-09-21T06:45:15.463461+0000","last_active":"2024-09-21T06:45:21.030146+0000","last_peered":"2024-09-21T06:45:21.030146+0000","last_clean":"2024-09-21T06:45:21.030146+0000","last_became_active":"2024-09-21T06:45:15.463156+0000","last_became_peered":"2024-09-21T06:45:15.463156+0000","last_unstale":"2024-09-21T06:45:21.030146+0000","last_undegraded":"2024-09-21T06:45:21.030146+0000","last_fullsized":"2024-09-21T06:45:21.030146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.464870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":108140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:45:30.103 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:45:30.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T06:45:30.104 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T06:45:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 -- 172.21.15.81:0/3123467366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815c450 msgr2=0x7fe2380d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 --2- 172.21.15.81:0/3123467366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815c450 0x7fe2380d3220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2380ceac0 tx=0x7fe22802a560 comp rx=0 tx=0).stop 2024-09-21T06:45:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 -- 172.21.15.81:0/3123467366 shutdown_connections 2024-09-21T06:45:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 --2- 172.21.15.81:0/3123467366 >> v2:172.21.15.89:3300/0 conn(0x7fe2380d41a0 0x7fe2380d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 --2- 172.21.15.81:0/3123467366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815c450 0x7fe2380d3220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 -- 172.21.15.81:0/3123467366 >> 172.21.15.81:0/3123467366 conn(0x7fe2380b7330 msgr2=0x7fe2380b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 -- 172.21.15.81:0/3123467366 shutdown_connections 2024-09-21T06:45:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.250+0000 7fe23e412640 1 -- 172.21.15.81:0/3123467366 wait complete. 2024-09-21T06:45:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.252+0000 7fe23e412640 1 Processor -- start 2024-09-21T06:45:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.252+0000 7fe23e412640 1 -- start start 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.253+0000 7fe23e412640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2380d41a0 0x7fe2381f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.253+0000 7fe23e412640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23815c450 0x7fe23814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.253+0000 7fe23e412640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815eda0 0x7fe2380b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.253+0000 7fe23e412640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2380b35c0 con 0x7fe23815eda0 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.253+0000 7fe23e412640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe2380b3440 con 0x7fe23815c450 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.253+0000 7fe23e412640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fe2380b3740 con 0x7fe2380d41a0 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.253+0000 7fe23c9af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815eda0 0x7fe2380b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe237fff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2380d41a0 0x7fe2381f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815eda0 0x7fe2380b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54520/0 (socket says 172.21.15.81:54520) 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 -- 172.21.15.81:0/253450198 learned_addr learned my addr 172.21.15.81:0/253450198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe2377fe640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23815c450 0x7fe23814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 -- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2380d41a0 msgr2=0x7fe2381f94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2380d41a0 0x7fe2381f94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 -- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23815c450 msgr2=0x7fe23814f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23815c450 0x7fe23814f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 -- 172.21.15.81:0/253450198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2381f9a20 con 0x7fe23815eda0 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23c9af640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815eda0 0x7fe2380b5d20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe23000cae0 tx=0x7fe230007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe234ff9640 1 -- 172.21.15.81:0/253450198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230007da0 con 0x7fe23815eda0 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe234ff9640 1 -- 172.21.15.81:0/253450198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe230004c30 con 0x7fe23815eda0 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23806ebe0 con 0x7fe23815eda0 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe234ff9640 1 -- 172.21.15.81:0/253450198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230005280 con 0x7fe23815eda0 2024-09-21T06:45:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.254+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23806f1a0 con 0x7fe23815eda0 2024-09-21T06:45:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.255+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23806e950 con 0x7fe23815eda0 2024-09-21T06:45:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.256+0000 7fe234ff9640 1 -- 172.21.15.81:0/253450198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe230005420 con 0x7fe23815eda0 2024-09-21T06:45:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.256+0000 7fe234ff9640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe224078b90 0x7fe22407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.256+0000 7fe234ff9640 1 -- 172.21.15.81:0/253450198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe23009ba40 con 0x7fe23815eda0 2024-09-21T06:45:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.256+0000 7fe237fff640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe224078b90 0x7fe22407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.257+0000 7fe237fff640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe224078b90 0x7fe22407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe228033000 tx=0x7fe228004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.261+0000 7fe234ff9640 1 -- 172.21.15.81:0/253450198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe2381f9a20 con 0x7fe23815eda0 2024-09-21T06:45:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.438+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fe2380d45b0 con 0x7fe23815eda0 2024-09-21T06:45:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.438+0000 7fe234ff9640 1 -- 172.21.15.81:0/253450198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7fe230014070 con 0x7fe23815eda0 2024-09-21T06:45:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe224078b90 msgr2=0x7fe22407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe224078b90 0x7fe22407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe228033000 tx=0x7fe228004730 comp rx=0 tx=0).stop 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815eda0 msgr2=0x7fe2380b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815eda0 0x7fe2380b5d20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe23000cae0 tx=0x7fe230007220 comp rx=0 tx=0).stop 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 shutdown_connections 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe224078b90 0x7fe22407b0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe23815eda0 0x7fe2380b5d20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23815c450 0x7fe23814f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 --2- 172.21.15.81:0/253450198 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2380d41a0 0x7fe2381f94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.440+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 >> 172.21.15.81:0/253450198 conn(0x7fe2380b7330 msgr2=0x7fe2380d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.441+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 shutdown_connections 2024-09-21T06:45:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.441+0000 7fe23e412640 1 -- 172.21.15.81:0/253450198 wait complete. 2024-09-21T06:45:30.454 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":31,"timestamp":"2024-09-21T06:45:03.414428+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"4044.560836"}]}] 2024-09-21T06:45:30.454 INFO:tasks.ceph_manager:config epoch is 31 2024-09-21T06:45:30.454 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T06:45:30.454 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T06:45:30.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T06:45:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 -- 172.21.15.81:0/1510412123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 msgr2=0x7f147006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 --2- 172.21.15.81:0/1510412123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f147006faf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1468005fd0 tx=0x7f146802aa00 comp rx=0 tx=0).stop 2024-09-21T06:45:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 -- 172.21.15.81:0/1510412123 shutdown_connections 2024-09-21T06:45:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 --2- 172.21.15.81:0/1510412123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f147006faf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 --2- 172.21.15.81:0/1510412123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f147015f100 0x7f147015f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 -- 172.21.15.81:0/1510412123 >> 172.21.15.81:0/1510412123 conn(0x7f14700cd370 msgr2=0x7f14700cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 -- 172.21.15.81:0/1510412123 shutdown_connections 2024-09-21T06:45:30.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.565+0000 7f147508c640 1 -- 172.21.15.81:0/1510412123 wait complete. 2024-09-21T06:45:30.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.567+0000 7f147508c640 1 Processor -- start 2024-09-21T06:45:30.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.567+0000 7f147508c640 1 -- start start 2024-09-21T06:45:30.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f147508c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f1470155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f147508c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f147015f100 0x7f1470148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f147508c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14701f9b20 0x7f14700c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f147508c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14700701b0 con 0x7f147006f6e0 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f147508c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1470070030 con 0x7f14701f9b20 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f147508c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f1470070330 con 0x7f147015f100 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f1470155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f1470155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54542/0 (socket says 172.21.15.81:54542) 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 -- 172.21.15.81:0/2198658129 learned_addr learned my addr 172.21.15.81:0/2198658129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146e59c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f147015f100 0x7f1470148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146f59e640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14701f9b20 0x7f14700c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 -- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f147015f100 msgr2=0x7f1470148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f147015f100 0x7f1470148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 -- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14701f9b20 msgr2=0x7f14700c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14701f9b20 0x7f14700c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146ed9d640 1 -- 172.21.15.81:0/2198658129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1470153670 con 0x7f147006f6e0 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.568+0000 7f146e59c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f147015f100 0x7f1470148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.569+0000 7f146ed9d640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f1470155830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f146000b3f0 tx=0x7f146000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.569+0000 7f14577fe640 1 -- 172.21.15.81:0/2198658129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460015020 con 0x7f147006f6e0 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.569+0000 7f14577fe640 1 -- 172.21.15.81:0/2198658129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1460011920 con 0x7f147006f6e0 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.569+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14701f9040 con 0x7f147006f6e0 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.569+0000 7f14577fe640 1 -- 172.21.15.81:0/2198658129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460011d70 con 0x7f147006f6e0 2024-09-21T06:45:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.569+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14701f9600 con 0x7f147006f6e0 2024-09-21T06:45:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.570+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14700707e0 con 0x7f147006f6e0 2024-09-21T06:45:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.570+0000 7f14577fe640 1 -- 172.21.15.81:0/2198658129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1460018020 con 0x7f147006f6e0 2024-09-21T06:45:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.571+0000 7f14577fe640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f145c078bc0 0x7f145c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.571+0000 7f14577fe640 1 -- 172.21.15.81:0/2198658129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f146009ab60 con 0x7f147006f6e0 2024-09-21T06:45:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.571+0000 7f146e59c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f145c078bc0 0x7f145c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.572+0000 7f146e59c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f145c078bc0 0x7f145c07b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1464005fd0 tx=0x7f1464005ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.576+0000 7f14577fe640 1 -- 172.21.15.81:0/2198658129 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f146001f030 con 0x7f147006f6e0 2024-09-21T06:45:30.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.800+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f14700cda60 con 0x7f147006f6e0 2024-09-21T06:45:30.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.803+0000 7f14577fe640 1 -- 172.21.15.81:0/2198658129 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194715 (secure 0 0 0) 0x7f1460062d80 con 0x7f147006f6e0 2024-09-21T06:45:30.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f145c078bc0 msgr2=0x7f145c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f145c078bc0 0x7f145c07b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1464005fd0 tx=0x7f1464005ea0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 msgr2=0x7f1470155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f1470155830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f146000b3f0 tx=0x7f146000b8b0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 shutdown_connections 2024-09-21T06:45:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f145c078bc0 0x7f145c07b0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f147015f100 0x7f1470148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14701f9b20 0x7f14700c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 --2- 172.21.15.81:0/2198658129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f147006f6e0 0x7f1470155830 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 >> 172.21.15.81:0/2198658129 conn(0x7f14700cd370 msgr2=0x7f147014ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 shutdown_connections 2024-09-21T06:45:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.806+0000 7f147508c640 1 -- 172.21.15.81:0/2198658129 wait complete. 2024-09-21T06:45:30.820 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1544192706},{"type":"v1","addr":"172.21.15.89:6801","nonce":1544192706}]},"active_addr":"172.21.15.89:6801/1544192706","active_change":"2024-09-21T06:44:54.643197+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4145,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2310335011}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3846323301}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1800423582}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1063427998}]}]} 2024-09-21T06:45:30.824 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T06:45:30.824 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T06:45:30.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:30.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.935+0000 7f288e24d640 1 -- 172.21.15.81:0/2252667134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880d3220 msgr2=0x7f28880b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.935+0000 7f288e24d640 1 --2- 172.21.15.81:0/2252667134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880d3220 0x7f28880b96c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28880b93b0 tx=0x7f287c02a480 comp rx=0 tx=0).stop 2024-09-21T06:45:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.935+0000 7f288e24d640 1 -- 172.21.15.81:0/2252667134 shutdown_connections 2024-09-21T06:45:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.935+0000 7f288e24d640 1 --2- 172.21.15.81:0/2252667134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880d3220 0x7f28880b96c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.935+0000 7f288e24d640 1 -- 172.21.15.81:0/2252667134 >> 172.21.15.81:0/2252667134 conn(0x7f28880b7330 msgr2=0x7f28880b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.935+0000 7f288e24d640 1 -- 172.21.15.81:0/2252667134 shutdown_connections 2024-09-21T06:45:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.935+0000 7f288e24d640 1 -- 172.21.15.81:0/2252667134 wait complete. 2024-09-21T06:45:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.937+0000 7f288e24d640 1 Processor -- start 2024-09-21T06:45:30.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.937+0000 7f288e24d640 1 -- start start 2024-09-21T06:45:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f288e24d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880b9c00 0x7f28880caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f288e24d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28880d3220 0x7f28881565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f288e24d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f288815c450 0x7f28880b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f288e24d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28880b36a0 con 0x7f28880b9c00 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f288e24d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f28880b3520 con 0x7f288815c450 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f288e24d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f28880b3820 con 0x7f28880d3220 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880b9c00 0x7f28880caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880b9c00 0x7f28880caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54554/0 (socket says 172.21.15.81:54554) 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 -- 172.21.15.81:0/2829129590 learned_addr learned my addr 172.21.15.81:0/2829129590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f2887fff640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f288815c450 0x7f28880b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f2886ffd640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28880d3220 0x7f28881565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 -- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28880d3220 msgr2=0x7f28881565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28880d3220 0x7f28881565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 -- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f288815c450 msgr2=0x7f28880b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f288815c450 0x7f28880b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.938+0000 7f28877fe640 1 -- 172.21.15.81:0/2829129590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28880caff0 con 0x7f28880b9c00 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.939+0000 7f2887fff640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f288815c450 0x7f28880b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.939+0000 7f28877fe640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880b9c00 0x7f28880caab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f287800b3c0 tx=0x7f287800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.939+0000 7f286ffff640 1 -- 172.21.15.81:0/2829129590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878011830 con 0x7f28880b9c00 2024-09-21T06:45:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.939+0000 7f286ffff640 1 -- 172.21.15.81:0/2829129590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2878016070 con 0x7f28880b9c00 2024-09-21T06:45:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.939+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28881f92c0 con 0x7f28880b9c00 2024-09-21T06:45:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.939+0000 7f286ffff640 1 -- 172.21.15.81:0/2829129590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878011da0 con 0x7f28880b9c00 2024-09-21T06:45:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.939+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28881f9880 con 0x7f28880b9c00 2024-09-21T06:45:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.940+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f288808d110 con 0x7f28880b9c00 2024-09-21T06:45:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.941+0000 7f286ffff640 1 -- 172.21.15.81:0/2829129590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f287801b460 con 0x7f28880b9c00 2024-09-21T06:45:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.941+0000 7f286ffff640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2874078b90 0x7f287407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.941+0000 7f286ffff640 1 -- 172.21.15.81:0/2829129590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f287809ad80 con 0x7f28880b9c00 2024-09-21T06:45:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.942+0000 7f2886ffd640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2874078b90 0x7f287407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.942+0000 7f2886ffd640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2874078b90 0x7f287407b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f287c034000 tx=0x7f287c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:30.946+0000 7f286ffff640 1 -- 172.21.15.81:0/2829129590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f288808d110 con 0x7f28880b9c00 2024-09-21T06:45:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.125+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28880b96c0 con 0x7f28880b9c00 2024-09-21T06:45:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.126+0000 7f286ffff640 1 -- 172.21.15.81:0/2829129590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f2878062e80 con 0x7f28880b9c00 2024-09-21T06:45:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:31.129 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2874078b90 msgr2=0x7f287407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2874078b90 0x7f287407b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f287c034000 tx=0x7f287c004730 comp rx=0 tx=0).stop 2024-09-21T06:45:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880b9c00 msgr2=0x7f28880caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880b9c00 0x7f28880caab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f287800b3c0 tx=0x7f287800b880 comp rx=0 tx=0).stop 2024-09-21T06:45:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 shutdown_connections 2024-09-21T06:45:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2874078b90 0x7f287407b0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28880d3220 0x7f28881565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f288815c450 0x7f28880b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 --2- 172.21.15.81:0/2829129590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28880b9c00 0x7f28880caab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 >> 172.21.15.81:0/2829129590 conn(0x7f28880b7330 msgr2=0x7f288815d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 shutdown_connections 2024-09-21T06:45:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.129+0000 7f288e24d640 1 -- 172.21.15.81:0/2829129590 wait complete. 2024-09-21T06:45:31.142 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T06:45:31.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:31.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 -- 172.21.15.81:0/2519185678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f541815c450 msgr2=0x7f54180d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 --2- 172.21.15.81:0/2519185678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f541815c450 0x7f54180d3220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5408009830 tx=0x7f540802a510 comp rx=0 tx=0).stop 2024-09-21T06:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 -- 172.21.15.81:0/2519185678 shutdown_connections 2024-09-21T06:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 --2- 172.21.15.81:0/2519185678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54180d41a0 0x7f54180d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 --2- 172.21.15.81:0/2519185678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f541815c450 0x7f54180d3220 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 -- 172.21.15.81:0/2519185678 >> 172.21.15.81:0/2519185678 conn(0x7f54180b7330 msgr2=0x7f54180b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 -- 172.21.15.81:0/2519185678 shutdown_connections 2024-09-21T06:45:31.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.255+0000 7f541d713640 1 -- 172.21.15.81:0/2519185678 wait complete. 2024-09-21T06:45:31.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.257+0000 7f541d713640 1 Processor -- start 2024-09-21T06:45:31.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.257+0000 7f541d713640 1 -- start start 2024-09-21T06:45:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f541d713640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54180d41a0 0x7f54180cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f541d713640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f541815c450 0x7f541814bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f541d713640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f541815eda0 0x7f541814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f541d713640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f54180b35c0 con 0x7f54180d41a0 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f541d713640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f54180b3440 con 0x7f541815eda0 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f541d713640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f54180b3740 con 0x7f541815c450 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54180d41a0 0x7f54180cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54180d41a0 0x7f54180cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54576/0 (socket says 172.21.15.81:54576) 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f5416ffd640 1 -- 172.21.15.81:0/3446852942 learned_addr learned my addr 172.21.15.81:0/3446852942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f540ffff640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f541815c450 0x7f541814bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.258+0000 7f54177fe640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f541815eda0 0x7f541814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f5416ffd640 1 -- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f541815c450 msgr2=0x7f541814bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f5416ffd640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f541815c450 0x7f541814bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f5416ffd640 1 -- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f541815eda0 msgr2=0x7f541814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f5416ffd640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f541815eda0 0x7f541814c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f5416ffd640 1 -- 172.21.15.81:0/3446852942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54180cdef0 con 0x7f54180d41a0 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f540ffff640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f541815c450 0x7f541814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f5416ffd640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54180d41a0 0x7f54180cc4e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f540802ab00 tx=0x7f5408033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f540f7fe640 1 -- 172.21.15.81:0/3446852942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408005c90 con 0x7f54180d41a0 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f540f7fe640 1 -- 172.21.15.81:0/3446852942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5408031e50 con 0x7f54180d41a0 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54180cce50 con 0x7f54180d41a0 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f540f7fe640 1 -- 172.21.15.81:0/3446852942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408005260 con 0x7f54180d41a0 2024-09-21T06:45:31.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.259+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54180cd410 con 0x7f54180d41a0 2024-09-21T06:45:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.260+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f541808d110 con 0x7f54180d41a0 2024-09-21T06:45:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.261+0000 7f540f7fe640 1 -- 172.21.15.81:0/3446852942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5408005400 con 0x7f54180d41a0 2024-09-21T06:45:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.261+0000 7f540f7fe640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f53f8078b90 0x7f53f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.261+0000 7f540f7fe640 1 -- 172.21.15.81:0/3446852942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f54080bc220 con 0x7f54180d41a0 2024-09-21T06:45:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.262+0000 7f540ffff640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f53f8078b90 0x7f53f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.262+0000 7f540ffff640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f53f8078b90 0x7f53f807b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5418160700 tx=0x7f5400009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.266+0000 7f540f7fe640 1 -- 172.21.15.81:0/3446852942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f541808d110 con 0x7f54180d41a0 2024-09-21T06:45:31.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:45:31.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:45:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.453+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54180d3220 con 0x7f54180d41a0 2024-09-21T06:45:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.454+0000 7f540f7fe640 1 -- 172.21.15.81:0/3446852942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f540803f030 con 0x7f54180d41a0 2024-09-21T06:45:31.456 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:31.456 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f53f8078b90 msgr2=0x7f53f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f53f8078b90 0x7f53f807b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5418160700 tx=0x7f5400009040 comp rx=0 tx=0).stop 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54180d41a0 msgr2=0x7f54180cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54180d41a0 0x7f54180cc4e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f540802ab00 tx=0x7f5408033c20 comp rx=0 tx=0).stop 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 shutdown_connections 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f53f8078b90 0x7f53f807b0a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f541815c450 0x7f541814bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f541815eda0 0x7f541814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 --2- 172.21.15.81:0/3446852942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54180d41a0 0x7f54180cc4e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 >> 172.21.15.81:0/3446852942 conn(0x7f54180b7330 msgr2=0x7f54180d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 shutdown_connections 2024-09-21T06:45:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.456+0000 7f541d713640 1 -- 172.21.15.81:0/3446852942 wait complete. 2024-09-21T06:45:31.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T06:45:31.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T06:45:31.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T06:45:31.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T06:45:31.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T06:45:31.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T06:45:31.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T06:45:31.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T06:45:31.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.721+0000 7f47c64bf640 1 -- 172.21.15.81:0/4247298162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac0037a0 msgr2=0x7f47ac003bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.721+0000 7f47c64bf640 1 --2- 172.21.15.81:0/4247298162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac0037a0 0x7f47ac003bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f47c006b7c0 tx=0x7f47ac005830 comp rx=0 tx=0).stop 2024-09-21T06:45:31.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.721+0000 7f47c5cbe640 1 -- 172.21.15.81:0/4247298162 reap_dead start 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc669d9b640 1 -- 172.21.15.81:0/1866739555 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0047a0 con 0x7fc66c15f7c0 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc6709b5640 1 -- 172.21.15.81:0/1866739555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc66c15f7c0 msgr2=0x7fc66c1556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc6709b5640 1 --2- 172.21.15.81:0/1866739555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc66c15f7c0 0x7fc66c1556d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc65c005fd0 tx=0x7fc65c02a4b0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc6709b5640 1 -- 172.21.15.81:0/1866739555 shutdown_connections 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc6709b5640 1 --2- 172.21.15.81:0/1866739555 >> v2:172.21.15.81:3300/0 conn(0x7fc66c073fa0 0x7fc66c0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc6709b5640 1 --2- 172.21.15.81:0/1866739555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc66c15f7c0 0x7fc66c1556d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc6709b5640 1 -- 172.21.15.81:0/1866739555 >> 172.21.15.81:0/1866739555 conn(0x7fc66c070000 msgr2=0x7fc66c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7f47c64bf640 1 -- 172.21.15.81:0/4247298162 shutdown_connections 2024-09-21T06:45:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7f47c64bf640 1 -- 172.21.15.81:0/4247298162 >> 172.21.15.81:0/4247298162 conn(0x7f47b801ddf0 msgr2=0x7f47b8039ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7fc6709b5640 1 -- 172.21.15.81:0/1866739555 shutdown_connections 2024-09-21T06:45:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.722+0000 7f47c64bf640 1 -- 172.21.15.81:0/4247298162 shutdown_connections 2024-09-21T06:45:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.723+0000 7fc6709b5640 1 -- 172.21.15.81:0/1866739555 wait complete. 2024-09-21T06:45:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.723+0000 7f47c64bf640 1 -- 172.21.15.81:0/4247298162 wait complete. 2024-09-21T06:45:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.725+0000 7f8a553eb640 1 -- 172.21.15.81:0/122280105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a501665b0 msgr2=0x7f8a500d1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.725+0000 7f8a553eb640 1 --2- 172.21.15.81:0/122280105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a501665b0 0x7f8a500d1f50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8a5008c800 tx=0x7f8a4402a440 comp rx=0 tx=0).stop 2024-09-21T06:45:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.725+0000 7f8a553eb640 1 -- 172.21.15.81:0/122280105 shutdown_connections 2024-09-21T06:45:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.726+0000 7f47c64bf640 1 Processor -- start 2024-09-21T06:45:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.727+0000 7f768d458640 1 -- 172.21.15.81:0/3927001590 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880ad600 con 0x7f76800e8580 2024-09-21T06:45:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.727+0000 7f768f45c640 1 -- 172.21.15.81:0/3927001590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76800e8580 msgr2=0x7f76800eaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.727+0000 7f768f45c640 1 --2- 172.21.15.81:0/3927001590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76800e8580 0x7f76800eaf70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7688077470 tx=0x7f76880a6480 comp rx=0 tx=0).stop 2024-09-21T06:45:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.726+0000 7f47c64bf640 1 -- start start 2024-09-21T06:45:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.725+0000 7f8a553eb640 1 --2- 172.21.15.81:0/122280105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a501665b0 0x7f8a500d1f50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.725+0000 7f8a553eb640 1 --2- 172.21.15.81:0/122280105 >> v2:172.21.15.89:3300/0 conn(0x7f8a500d3970 0x7f8a500b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.725+0000 7f8a553eb640 1 -- 172.21.15.81:0/122280105 >> 172.21.15.81:0/122280105 conn(0x7f8a500d4cf0 msgr2=0x7f8a500d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.726+0000 7fc6709b5640 1 Processor -- start 2024-09-21T06:45:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.726+0000 7fc6709b5640 1 -- start start 2024-09-21T06:45:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.727+0000 7f768f45c640 1 -- 172.21.15.81:0/3927001590 shutdown_connections 2024-09-21T06:45:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.727+0000 7f768f45c640 1 --2- 172.21.15.81:0/3927001590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76800e8580 0x7f76800eaf70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.727+0000 7f768f45c640 1 -- 172.21.15.81:0/3927001590 >> 172.21.15.81:0/3927001590 conn(0x7f768000e3f0 msgr2=0x7f768000e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f768f45c640 1 -- 172.21.15.81:0/3927001590 shutdown_connections 2024-09-21T06:45:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f768f45c640 1 -- 172.21.15.81:0/3927001590 wait complete. 2024-09-21T06:45:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f47c64bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac0037a0 0x7f47b80dd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc6709b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66c070b20 0x7fc66c1fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc6709b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc66c073fa0 0x7fc66c1fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f8a553eb640 1 -- 172.21.15.81:0/122280105 shutdown_connections 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc66a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc66c073fa0 0x7fc66c1fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc66a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc66c073fa0 0x7fc66c1fd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58334/0 (socket says 172.21.15.81:58334) 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc66a59c640 1 -- 172.21.15.81:0/4200481162 learned_addr learned my addr 172.21.15.81:0/4200481162 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc6709b5640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc66c15f7c0 0x7fc66c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c0b3530 con 0x7fc66c070b20 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c0b33b0 con 0x7fc66c073fa0 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c0b36b0 con 0x7fc66c15f7c0 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7fc66b59e640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc66c15f7c0 0x7fc66c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7fc66a59c640 1 -- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc66c15f7c0 msgr2=0x7fc66c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7fc66a59c640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc66c15f7c0 0x7fc66c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7fc66a59c640 1 -- 172.21.15.81:0/4200481162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66c070b20 msgr2=0x7fc66c1fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7fc66a59c640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66c070b20 0x7fc66c1fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7fc66a59c640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c152260 con 0x7fc66c073fa0 2024-09-21T06:45:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7fc66a59c640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc66c073fa0 0x7fc66c1fd8e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc66000b440 tx=0x7fc66000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f8a553eb640 1 -- 172.21.15.81:0/122280105 wait complete. 2024-09-21T06:45:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f47c64bf640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47b80e1de0 0x7f47b8175660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f47c64bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8031850 0x7f47b8031c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f47c64bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47b803a340 con 0x7f47ac0037a0 2024-09-21T06:45:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f47c64bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f47b803a1c0 con 0x7f47b8031850 2024-09-21T06:45:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.728+0000 7f47c64bf640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f47b8007680 con 0x7f47b80e1de0 2024-09-21T06:45:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47b80e1de0 0x7f47b8175660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47b80e1de0 0x7f47b8175660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39372/0 (socket says 172.21.15.81:39372) 2024-09-21T06:45:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 -- 172.21.15.81:0/2435163017 learned_addr learned my addr 172.21.15.81:0/2435163017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c54bd640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac0037a0 0x7f47b80dd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 -- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8031850 msgr2=0x7f47b8031c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:45:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47b8031850 0x7f47b8031c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.730+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660015020 con 0x7fc66c073fa0 2024-09-21T06:45:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 -- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac0037a0 msgr2=0x7f47b80dd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac0037a0 0x7f47b80dd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.729+0000 7f47c4cbc640 1 -- 172.21.15.81:0/2435163017 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80321a0 con 0x7f47b80e1de0 2024-09-21T06:45:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.730+0000 7f47c4cbc640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47b80e1de0 0x7f47b8175660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47c0075650 tx=0x7f47c00a7180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.730+0000 7f47b5ffb640 1 -- 172.21.15.81:0/2435163017 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c00b4050 con 0x7f47b80e1de0 2024-09-21T06:45:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.730+0000 7f47b5ffb640 1 -- 172.21.15.81:0/2435163017 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47c00b5040 con 0x7f47b80e1de0 2024-09-21T06:45:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.730+0000 7f47b5ffb640 1 -- 172.21.15.81:0/2435163017 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c00bb450 con 0x7f47b80e1de0 2024-09-21T06:45:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.730+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c1faa00 con 0x7fc66c073fa0 2024-09-21T06:45:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.730+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c158d90 con 0x7fc66c073fa0 2024-09-21T06:45:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.731+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc660011980 con 0x7fc66c073fa0 2024-09-21T06:45:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.731+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660011dd0 con 0x7fc66c073fa0 2024-09-21T06:45:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.731+0000 7f768f45c640 1 Processor -- start 2024-09-21T06:45:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.731+0000 7f768f45c640 1 -- start start 2024-09-21T06:45:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.731+0000 7f8a553eb640 1 Processor -- start 2024-09-21T06:45:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.732+0000 7f8a553eb640 1 -- start start 2024-09-21T06:45:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.733+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc660018020 con 0x7fc66c073fa0 2024-09-21T06:45:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768f45c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7680005f60 0x7f76800e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768f45c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7680006370 0x7f76800e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.733+0000 7f47c64bf640 1 -- 172.21.15.81:0/2435163017 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b8176170 con 0x7f47b80e1de0 2024-09-21T06:45:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.733+0000 7f47c64bf640 1 -- 172.21.15.81:0/2435163017 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b80dcb40 con 0x7f47b80e1de0 2024-09-21T06:45:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768e45a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7680005f60 0x7f76800e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768e45a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7680005f60 0x7f76800e11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54652/0 (socket says 172.21.15.81:54652) 2024-09-21T06:45:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768e45a640 1 -- 172.21.15.81:0/333629022 learned_addr learned my addr 172.21.15.81:0/333629022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768f45c640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76800e8580 0x7f76800e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7fccbcb62640 1 -- 172.21.15.81:0/3750754033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 msgr2=0x7fccb80b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768dc59640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7680006370 0x7f76800e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7fccb559a640 1 -- 172.21.15.81:0/3750754033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac035020 con 0x7fccb80d3220 2024-09-21T06:45:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc64c001030 con 0x7fc66c073fa0 2024-09-21T06:45:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76800eb4b0 con 0x7f7680005f60 2024-09-21T06:45:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7fccbcb62640 1 --2- 172.21.15.81:0/3750754033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 0x7fccb80b96c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fccac005fd0 tx=0x7fccac02a530 comp rx=0 tx=0).stop 2024-09-21T06:45:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7fc6537fe640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc658078c60 0x7fc65807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7680058820 con 0x7f76800e8580 2024-09-21T06:45:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768ec5b640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76800e8580 0x7f76800e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.734+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f76800eb630 con 0x7f7680006370 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fc66ad9d640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc658078c60 0x7fc65807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc66009af00 con 0x7fc66c073fa0 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fc6537fe640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7fc6580823b0 0x7fc658084840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc660018ec0 con 0x7fc6580823b0 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc66005f030 con 0x7fc66c073fa0 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fccbcb62640 1 -- 172.21.15.81:0/3750754033 shutdown_connections 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fccbcb62640 1 --2- 172.21.15.81:0/3750754033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 0x7fccb80b96c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fccbcb62640 1 --2- 172.21.15.81:0/3750754033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccb80b9c00 0x7fccb80d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fccbcb62640 1 -- 172.21.15.81:0/3750754033 >> 172.21.15.81:0/3750754033 conn(0x7fccb80b7330 msgr2=0x7fccb80b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7f8a553eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a500d2490 0x7f8a50156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7fc66b59e640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7fc6580823b0 0x7fc658084840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7f768e45a640 1 -- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7680006370 msgr2=0x7f76800e45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7f768e45a640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7680006370 0x7f76800e45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7f768e45a640 1 -- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76800e8580 msgr2=0x7f76800e4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7f768e45a640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76800e8580 0x7f76800e4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.735+0000 7f768e45a640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76800e1bb0 con 0x7f7680005f60 2024-09-21T06:45:31.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7fccbcb62640 1 -- 172.21.15.81:0/3750754033 shutdown_connections 2024-09-21T06:45:31.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f768e45a640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7680005f60 0x7f76800e11d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f768400c410 tx=0x7f768400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f768dc59640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7680006370 0x7f76800e45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:31.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f768ec5b640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76800e8580 0x7f76800e4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7fc66b59e640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7fc6580823b0 0x7fc658084840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7684011790 con 0x7f7680005f60 2024-09-21T06:45:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7684017070 con 0x7f7680005f60 2024-09-21T06:45:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a553eb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a500d3970 0x7f8a5015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a553eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a501665b0 0x7f8a5015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a553eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500b4f90 con 0x7f8a500d2490 2024-09-21T06:45:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.737+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== osd.2 v2:172.21.15.81:6800/1250280053 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc660018ec0 con 0x7fc6580823b0 2024-09-21T06:45:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a553eb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500b4e10 con 0x7f8a501665b0 2024-09-21T06:45:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a553eb640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8a500b5110 con 0x7f8a500d3970 2024-09-21T06:45:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a500d2490 0x7f8a50156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a500d2490 0x7f8a50156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54666/0 (socket says 172.21.15.81:54666) 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a4ffff640 1 -- 172.21.15.81:0/1198495564 learned_addr learned my addr 172.21.15.81:0/1198495564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7f8a4f7fe640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a500d3970 0x7f8a5015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.737+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a501665b0 msgr2=0x7f8a5015dca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.737+0000 7f8a4f7fe640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a501665b0 0x7f8a5015dca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.737+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/1198495564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a500d2490 msgr2=0x7f8a50156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76800e1e90 con 0x7f7680005f60 2024-09-21T06:45:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76800e2450 con 0x7f7680005f60 2024-09-21T06:45:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.737+0000 7f8a4f7fe640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a500d2490 0x7f8a50156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.737+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/1198495564 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a501fd7a0 con 0x7f8a500d3970 2024-09-21T06:45:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7684011c40 con 0x7f7680005f60 2024-09-21T06:45:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f5e037c3640 1 -- 172.21.15.81:0/3246596922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5dfc15e360 msgr2=0x7f5dfc0ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f5e037c3640 1 --2- 172.21.15.81:0/3246596922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5dfc15e360 0x7f5dfc0ad290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06e910 tx=0x7f5dec02e670 comp rx=0 tx=0).stop 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f5e037c3640 1 -- 172.21.15.81:0/3246596922 shutdown_connections 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f5e037c3640 1 --2- 172.21.15.81:0/3246596922 >> v2:172.21.15.89:3300/0 conn(0x7f5dfc15e770 0x7f5dfc0ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f5e037c3640 1 --2- 172.21.15.81:0/3246596922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5dfc15e360 0x7f5dfc0ad290 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc06e910 tx=0x7f5dec02e670 comp rx=0 tx=0).stop 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f5e037c3640 1 -- 172.21.15.81:0/3246596922 >> 172.21.15.81:0/3246596922 conn(0x7f5dfc0b2030 msgr2=0x7f5dfc0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f47b5ffb640 1 -- 172.21.15.81:0/2435163017 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47c00c2020 con 0x7f47b80e1de0 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.739+0000 7f47b5ffb640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f47a4078bc0 0x7f47a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.739+0000 7f47b5ffb640 1 -- 172.21.15.81:0/2435163017 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f47c01372d0 con 0x7f47b80e1de0 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.740+0000 7f47c64bf640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7f47b80dcd10 0x7f47b80dad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.740+0000 7f47c5cbe640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7f47b80dcd10 0x7f47b80dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.736+0000 7fccbcb62640 1 -- 172.21.15.81:0/3750754033 wait complete. 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.740+0000 7fccbcb62640 1 Processor -- start 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.740+0000 7fccbcb62640 1 -- start start 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f8a4ffff640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a500d2490 0x7f8a50156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f8a4f7fe640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a500d3970 0x7f8a5015d760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a44031000 tx=0x7f8a44030570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.738+0000 7f8a4cff9640 1 -- 172.21.15.81:0/1198495564 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44040030 con 0x7f8a500d3970 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.739+0000 7f8a4cff9640 1 -- 172.21.15.81:0/1198495564 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a44030b40 con 0x7f8a500d3970 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.739+0000 7f8a4cff9640 1 -- 172.21.15.81:0/1198495564 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44037040 con 0x7f8a500d3970 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.740+0000 7f8a553eb640 1 -- 172.21.15.81:0/1198495564 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a501fda80 con 0x7f8a500d3970 2024-09-21T06:45:31.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.740+0000 7f8a553eb640 1 -- 172.21.15.81:0/1198495564 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a50157d30 con 0x7f8a500d3970 2024-09-21T06:45:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.739+0000 7f5e037c3640 1 -- 172.21.15.81:0/3246596922 shutdown_connections 2024-09-21T06:45:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.740+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76800eaf70 con 0x7f7680005f60 2024-09-21T06:45:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.741+0000 7f47c5cbe640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7f47b80dcd10 0x7f47b80dad40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.741+0000 7f47c64bf640 1 -- 172.21.15.81:0/2435163017 --> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47b80dc930 con 0x7f47b80dcd10 2024-09-21T06:45:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.739+0000 7f5e037c3640 1 -- 172.21.15.81:0/3246596922 wait complete. 2024-09-21T06:45:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.742+0000 7f47c54bd640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f47a4078bc0 0x7f47a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.742+0000 7f47b5ffb640 1 -- 172.21.15.81:0/2435163017 <== osd.1 v2:172.21.15.81:6824/3679651054 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47b80dc930 con 0x7f47b80dcd10 2024-09-21T06:45:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.742+0000 7f8a4cff9640 1 -- 172.21.15.81:0/1198495564 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a44043070 con 0x7f8a500d3970 2024-09-21T06:45:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.742+0000 7fccbcb62640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccb80b9c00 0x7fccb8201aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.742+0000 7fccbcb62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 0x7fccb806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7f5e037c3640 1 Processor -- start 2024-09-21T06:45:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7f5e037c3640 1 -- start start 2024-09-21T06:45:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccbcb62640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccb815c450 0x7fccb806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccbcb62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80b35c0 con 0x7fccb80d3220 2024-09-21T06:45:31.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccbcb62640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80b3440 con 0x7fccb815c450 2024-09-21T06:45:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccbcb62640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80b3740 con 0x7fccb80b9c00 2024-09-21T06:45:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 0x7fccb806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7f47c54bd640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f47a4078bc0 0x7f47a407b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47b0005860 tx=0x7f47b0005bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 0x7fccb806ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54670/0 (socket says 172.21.15.81:54670) 2024-09-21T06:45:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 -- 172.21.15.81:0/1737835180 learned_addr learned my addr 172.21.15.81:0/1737835180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 -- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccb80b9c00 msgr2=0x7fccb8201aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fccb80b9c00 0x7fccb8201aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 -- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccb815c450 msgr2=0x7fccb806f4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fccb815c450 0x7fccb806f4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7fccb5d9b640 1 -- 172.21.15.81:0/1737835180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb80cd5e0 con 0x7fccb80d3220 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.744+0000 7fccb5d9b640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 0x7fccb806ef60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fccac034040 tx=0x7fccac0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7f8a4cff9640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a3c078c60 0x7f8a3c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.743+0000 7f8a4cff9640 1 -- 172.21.15.81:0/1198495564 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8a440bb260 con 0x7f8a500d3970 2024-09-21T06:45:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.739+0000 7fc66ad9d640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc658078c60 0x7fc65807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc65c033000 tx=0x7fc65c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f5e037c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5dfc070e50 0x7f5dfc2060a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f5e037c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dfc15e770 0x7f5dfc156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f5e037c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dfc1e71b0 0x7f5dfc201f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f5e037c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc0b2f40 con 0x7f5dfc070e50 2024-09-21T06:45:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f5e037c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc0b4b30 con 0x7f5dfc15e770 2024-09-21T06:45:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f5e037c3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc0b30c0 con 0x7f5dfc1e71b0 2024-09-21T06:45:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.744+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f768401c460 con 0x7f7680005f60 2024-09-21T06:45:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f767effd640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f766c078c60 0x7f766c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f768409ad80 con 0x7f7680005f60 2024-09-21T06:45:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f767effd640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f766c082320 0x7f766c0847b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.745+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7684009e50 con 0x7f766c082320 2024-09-21T06:45:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f768405eed0 con 0x7f7680005f60 2024-09-21T06:45:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f8a4ffff640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a3c078c60 0x7f8a3c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dfc15e770 0x7f5dfc156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e01d60640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dfc1e71b0 0x7f5dfc201f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dfc15e770 0x7f5dfc156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58386/0 (socket says 172.21.15.81:58386) 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 -- 172.21.15.81:0/2433707304 learned_addr learned my addr 172.21.15.81:0/2433707304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 -- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dfc1e71b0 msgr2=0x7f5dfc201f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dfc1e71b0 0x7f5dfc201f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 -- 172.21.15.81:0/2433707304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5dfc070e50 msgr2=0x7f5dfc2060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5dfc070e50 0x7f5dfc2060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.746+0000 7f5e00d5e640 1 -- 172.21.15.81:0/2433707304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc1eb3d0 con 0x7f5dfc15e770 2024-09-21T06:45:31.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7f768ec5b640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f766c082320 0x7f766c0847b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac03e030 con 0x7fccb80d3220 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7fccbcb62640 1 -- 172.21.15.81:0/1737835180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb80cd8c0 con 0x7fccb80d3220 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7fccbcb62640 1 -- 172.21.15.81:0/1737835180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb80ce3a0 con 0x7fccb80d3220 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7f8a4ffff640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a3c078c60 0x7f8a3c07b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000bbe0 tx=0x7f8a4000b5c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7f8a553eb640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8a501fd030 0x7f8a50158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7f8a553eb640 1 -- 172.21.15.81:0/1198495564 --> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a501fdfa0 con 0x7f8a501fd030 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7f768dc59640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f766c078c60 0x7f766c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7f5e00d5e640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dfc15e770 0x7f5dfc156c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5dec010a60 tx=0x7f5dec0356a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.747+0000 7f8a54bea640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8a501fd030 0x7f8a50158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.748+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec036c70 con 0x7f5dfc15e770 2024-09-21T06:45:31.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.748+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc1e7d00 con 0x7f5dfc15e770 2024-09-21T06:45:31.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.748+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc2058a0 con 0x7f5dfc15e770 2024-09-21T06:45:31.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.748+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dec005020 con 0x7f5dfc15e770 2024-09-21T06:45:31.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.748+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec005450 con 0x7f5dfc15e770 2024-09-21T06:45:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.749+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccac005310 con 0x7fccb80d3220 2024-09-21T06:45:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.749+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccb80cdf80 con 0x7fccb80d3220 2024-09-21T06:45:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.749+0000 7f8a54bea640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8a501fd030 0x7f8a50158250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.750+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac048060 con 0x7fccb80d3220 2024-09-21T06:45:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.750+0000 7f8a4cff9640 1 -- 172.21.15.81:0/1198495564 <== osd.5 v2:172.21.15.89:6810/2407243866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a48001fd0 con 0x7f8a501fd030 2024-09-21T06:45:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.751+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccac041030 con 0x7fccb80d3220 2024-09-21T06:45:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.751+0000 7f768dc59640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f766c078c60 0x7f766c07b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7680056700 tx=0x7f76880af040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7fcca6ffd640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc98078b90 0x7fcc9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fccac0bbef0 con 0x7fccb80d3220 2024-09-21T06:45:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7fcca6ffd640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fcc980822d0 0x7fcc98084760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 --> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccac032e50 con 0x7fcc980822d0 2024-09-21T06:45:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.753+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fccac0bc380 con 0x7fccb80d3220 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.751+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ddc001030 con 0x7f5dfc15e770 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.751+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5dec046030 con 0x7f5dfc15e770 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7f5df1ffb640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5de0078b90 0x7f5de007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5dec0bb150 con 0x7f5dfc15e770 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7f5df1ffb640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7f5de00822e0 0x7f5de0084770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 --> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5dec008020 con 0x7f5de00822e0 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5dec0c2050 con 0x7f5dfc15e770 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.754+0000 7f5e0155f640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5de0078b90 0x7f5de007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.752+0000 7f768ec5b640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f766c082320 0x7f766c0847b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.754+0000 7fccb659c640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc98078b90 0x7fcc9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.754+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== osd.7 v2:172.21.15.89:6826/2470132384 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7684009e50 con 0x7f766c082320 2024-09-21T06:45:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.755+0000 7fccb6d9d640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fcc980822d0 0x7fcc98084760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.754+0000 7f5e01d60640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7f5de00822e0 0x7f5de0084770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.755+0000 7f5e01d60640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7f5de00822e0 0x7f5de0084770 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.755+0000 7fccb6d9d640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fcc980822d0 0x7fcc98084760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.755+0000 7f5e0155f640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5de0078b90 0x7f5de007b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5df80014b0 tx=0x7f5df80079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.757+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== osd.3 v2:172.21.15.81:6808/1925632354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccac032e50 con 0x7fcc980822d0 2024-09-21T06:45:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.756+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== osd.6 v2:172.21.15.89:6818/990103659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5dec008020 con 0x7f5de00822e0 2024-09-21T06:45:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.759+0000 7fccb659c640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc98078b90 0x7fcc9807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fccb808c9c0 tx=0x7fcca8006b30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.760+0000 7fb94909b640 1 -- 172.21.15.81:0/3110294259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 msgr2=0x7fb9440b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.760+0000 7fb94909b640 1 --2- 172.21.15.81:0/3110294259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 0x7fb9440b30f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb9440d11d0 tx=0x7fb93802a4b0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.761+0000 7fb94909b640 1 -- 172.21.15.81:0/3110294259 shutdown_connections 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.761+0000 7fb94909b640 1 --2- 172.21.15.81:0/3110294259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 0x7fb9440b30f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.761+0000 7fb94909b640 1 --2- 172.21.15.81:0/3110294259 >> v2:172.21.15.89:3300/0 conn(0x7fb9440ad630 0x7fb944070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.761+0000 7fb94909b640 1 -- 172.21.15.81:0/3110294259 >> 172.21.15.81:0/3110294259 conn(0x7fb9440b1c40 msgr2=0x7fb9440b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.765+0000 7fb94909b640 1 -- 172.21.15.81:0/3110294259 shutdown_connections 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.765+0000 7fb94909b640 1 -- 172.21.15.81:0/3110294259 wait complete. 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.768+0000 7fb94909b640 1 Processor -- start 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.768+0000 7fb94909b640 1 -- start start 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.771+0000 7fb94909b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 0x7fb9441612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.771+0000 7fb94909b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9440cfcc0 0x7fb94409c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.771+0000 7fb94909b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94415f950 0x7fb94409c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.771+0000 7fb94909b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440b3c30 con 0x7fb9440adb70 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.771+0000 7fb94909b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440b3ab0 con 0x7fb9440cfcc0 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.771+0000 7fb94909b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fb9440b3db0 con 0x7fb94415f950 2024-09-21T06:45:31.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.772+0000 7fb942d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 0x7fb9441612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.772+0000 7fb94359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94415f950 0x7fb94409c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.772+0000 7fb94359e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94415f950 0x7fb94409c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39406/0 (socket says 172.21.15.81:39406) 2024-09-21T06:45:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.772+0000 7fb94359e640 1 -- 172.21.15.81:0/915345928 learned_addr learned my addr 172.21.15.81:0/915345928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.773+0000 7fb94359e640 1 -- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9440cfcc0 msgr2=0x7fb94409c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.773+0000 7fb94359e640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9440cfcc0 0x7fb94409c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.773+0000 7fb94359e640 1 -- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 msgr2=0x7fb9441612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.773+0000 7fb94359e640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 0x7fb9441612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.773+0000 7f47c64bf640 1 -- 172.21.15.81:0/2435163017 --> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47b8054b70 con 0x7f47b80dcd10 2024-09-21T06:45:31.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.773+0000 7fb94359e640 1 -- 172.21.15.81:0/915345928 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94415a490 con 0x7fb94415f950 2024-09-21T06:45:31.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.773+0000 7fb942d9d640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9440adb70 0x7fb9441612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.774+0000 7f47b5ffb640 1 -- 172.21.15.81:0/2435163017 <== osd.1 v2:172.21.15.81:6824/3679651054 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f47b8054b70 con 0x7f47b80dcd10 2024-09-21T06:45:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.774+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 --> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc64c002dd0 con 0x7fc6580823b0 2024-09-21T06:45:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.774+0000 7fc6537fe640 1 -- 172.21.15.81:0/4200481162 <== osd.2 v2:172.21.15.81:6800/1250280053 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc64c002dd0 con 0x7fc6580823b0 2024-09-21T06:45:31.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.775+0000 7fb94359e640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94415f950 0x7fb94409c5f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb938009920 tx=0x7fb938003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.775+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938003da0 con 0x7fb94415f950 2024-09-21T06:45:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.775+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94415ee70 con 0x7fb94415f950 2024-09-21T06:45:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.775+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb944160a40 con 0x7fb94415f950 2024-09-21T06:45:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.775+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb938031e50 con 0x7fb94415f950 2024-09-21T06:45:31.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.775+0000 7f47a37fe640 1 -- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7f47b80dcd10 msgr2=0x7f47b80dad40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.775+0000 7f47a37fe640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7f47b80dcd10 0x7f47b80dad40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938003da0 con 0x7fb94415f950 2024-09-21T06:45:31.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7fc6580823b0 msgr2=0x7fc658084840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7fc6709b5640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7fc6580823b0 0x7fc658084840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7f47a37fe640 1 -- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f47a4078bc0 msgr2=0x7f47a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7f47a37fe640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f47a4078bc0 0x7f47a407b0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47b0005860 tx=0x7f47b0005bf0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7f47a37fe640 1 -- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47b80e1de0 msgr2=0x7f47b8175660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7f47a37fe640 1 --2- 172.21.15.81:0/2435163017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47b80e1de0 0x7f47b8175660 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47c0075650 tx=0x7f47c00a7180 comp rx=0 tx=0).stop 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7f47c5cbe640 1 -- 172.21.15.81:0/2435163017 reap_dead start 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7f47a37fe640 1 -- 172.21.15.81:0/2435163017 shutdown_connections 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.776+0000 7f47a37fe640 1 -- 172.21.15.81:0/2435163017 >> 172.21.15.81:0/2435163017 conn(0x7f47b801ddf0 msgr2=0x7f47b8050df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb924001030 con 0x7fb94415f950 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc658078c60 msgr2=0x7fc65807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fc6709b5640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc658078c60 0x7fc65807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc65c033000 tx=0x7fc65c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc66c073fa0 msgr2=0x7fc66c1fd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fc6709b5640 1 --2- 172.21.15.81:0/4200481162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc66c073fa0 0x7fc66c1fd8e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc66000b440 tx=0x7fc66000b900 comp rx=0 tx=0).stop 2024-09-21T06:45:31.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fc66b59e640 1 -- 172.21.15.81:0/4200481162 reap_dead start 2024-09-21T06:45:31.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 shutdown_connections 2024-09-21T06:45:31.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 >> 172.21.15.81:0/4200481162 conn(0x7fc66c070000 msgr2=0x7fc66c0adf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.777+0000 7f47a37fe640 1 -- 172.21.15.81:0/2435163017 shutdown_connections 2024-09-21T06:45:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.778+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 shutdown_connections 2024-09-21T06:45:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.778+0000 7fc6709b5640 1 -- 172.21.15.81:0/4200481162 wait complete. 2024-09-21T06:45:31.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.778+0000 7f47a37fe640 1 -- 172.21.15.81:0/2435163017 wait complete. 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.778+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb93804c420 con 0x7fb94415f950 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.779+0000 7fb92b7fe640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb930078f90 0x7fb93007b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.779+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb938003ba0 con 0x7fb94415f950 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.780+0000 7fb942d9d640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb930078f90 0x7fb93007b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.780+0000 7fb92b7fe640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fb9300825d0 0x7fb930084a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.780+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 --> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb930085130 con 0x7fb9300825d0 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.780+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb93807fcd0 con 0x7fb94415f950 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.780+0000 7fb94259c640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fb9300825d0 0x7fb930084a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.781+0000 7fb94259c640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fb9300825d0 0x7fb930084a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.781+0000 7f18752c5640 1 -- 172.21.15.81:0/1190937649 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18680019e0 con 0x7f185c003a20 2024-09-21T06:45:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.781+0000 7f18772c9640 1 -- 172.21.15.81:0/1190937649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f185c003a20 msgr2=0x7f185c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.781+0000 7f18772c9640 1 --2- 172.21.15.81:0/1190937649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f185c003a20 0x7f185c003eb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1868001dc0 tx=0x7f185c005830 comp rx=0 tx=0).stop 2024-09-21T06:45:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.782+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== osd.0 v2:172.21.15.81:6816/3316093224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb930085130 con 0x7fb9300825d0 2024-09-21T06:45:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.782+0000 7f18772c9640 1 -- 172.21.15.81:0/1190937649 shutdown_connections 2024-09-21T06:45:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.782+0000 7f18772c9640 1 --2- 172.21.15.81:0/1190937649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f185c003a20 0x7f185c003eb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.782+0000 7f18772c9640 1 -- 172.21.15.81:0/1190937649 >> 172.21.15.81:0/1190937649 conn(0x7f18700b1d00 msgr2=0x7f18700b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.784+0000 7f18772c9640 1 -- 172.21.15.81:0/1190937649 shutdown_connections 2024-09-21T06:45:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.783+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 --> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7680053240 con 0x7f766c082320 2024-09-21T06:45:31.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.784+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 --> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccb808d110 con 0x7fcc980822d0 2024-09-21T06:45:31.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.785+0000 7fcca6ffd640 1 -- 172.21.15.81:0/1737835180 <== osd.3 v2:172.21.15.81:6808/1925632354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fccb808d110 con 0x7fcc980822d0 2024-09-21T06:45:31.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.787+0000 7f18772c9640 1 -- 172.21.15.81:0/1190937649 wait complete. 2024-09-21T06:45:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.787+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 --> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ddc002dd0 con 0x7f5de00822e0 2024-09-21T06:45:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.788+0000 7f5df1ffb640 1 -- 172.21.15.81:0/2433707304 <== osd.6 v2:172.21.15.89:6818/990103659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ddc002dd0 con 0x7f5de00822e0 2024-09-21T06:45:31.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.788+0000 7f767effd640 1 -- 172.21.15.81:0/333629022 <== osd.7 v2:172.21.15.89:6826/2470132384 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7680053240 con 0x7f766c082320 2024-09-21T06:45:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.788+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fcc980822d0 msgr2=0x7fcc98084760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.788+0000 7fcca4ff9640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fcc980822d0 0x7fcc98084760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc98078b90 msgr2=0x7fcc9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fcca4ff9640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc98078b90 0x7fcc9807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fccb808c9c0 tx=0x7fcca8006b30 comp rx=0 tx=0).stop 2024-09-21T06:45:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 msgr2=0x7fccb806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fcca4ff9640 1 --2- 172.21.15.81:0/1737835180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccb80d3220 0x7fccb806ef60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fccac034040 tx=0x7fccac0038a0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fccb6d9d640 1 -- 172.21.15.81:0/1737835180 reap_dead start 2024-09-21T06:45:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fb942d9d640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb930078f90 0x7fb93007b4a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0012e0 tx=0x7fb93c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.788+0000 7f8a553eb640 1 -- 172.21.15.81:0/1198495564 --> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8a50074f70 con 0x7f8a501fd030 2024-09-21T06:45:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 shutdown_connections 2024-09-21T06:45:31.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 >> 172.21.15.81:0/1737835180 conn(0x7fccb80b7330 msgr2=0x7fccb80d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f766c082320 msgr2=0x7f766c0847b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7f768f45c640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f766c082320 0x7f766c0847b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f766c078c60 msgr2=0x7f766c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7f5de00822e0 msgr2=0x7f5de0084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7f5e037c3640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7f5de00822e0 0x7f5de0084770 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7f768f45c640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f766c078c60 0x7f766c07b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7680056700 tx=0x7f76880af040 comp rx=0 tx=0).stop 2024-09-21T06:45:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.789+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 shutdown_connections 2024-09-21T06:45:31.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5de0078b90 msgr2=0x7f5de007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e037c3640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5de0078b90 0x7f5de007b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5df80014b0 tx=0x7f5df80079b0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dfc15e770 msgr2=0x7f5dfc156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e037c3640 1 --2- 172.21.15.81:0/2433707304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dfc15e770 0x7f5dfc156c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5dec010a60 tx=0x7f5dec0356a0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7680005f60 msgr2=0x7f76800e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f768f45c640 1 --2- 172.21.15.81:0/333629022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7680005f60 0x7f76800e11d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f768400c410 tx=0x7f768400c8d0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f768ec5b640 1 -- 172.21.15.81:0/333629022 reap_dead start 2024-09-21T06:45:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e01d60640 1 -- 172.21.15.81:0/2433707304 reap_dead start 2024-09-21T06:45:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 shutdown_connections 2024-09-21T06:45:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 >> 172.21.15.81:0/2433707304 conn(0x7f5dfc0b2030 msgr2=0x7f5dfc0ad290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7fcca4ff9640 1 -- 172.21.15.81:0/1737835180 wait complete. 2024-09-21T06:45:31.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 shutdown_connections 2024-09-21T06:45:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 shutdown_connections 2024-09-21T06:45:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.790+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 >> 172.21.15.81:0/333629022 conn(0x7f768000e3f0 msgr2=0x7f768004f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.791+0000 7f5e037c3640 1 -- 172.21.15.81:0/2433707304 wait complete. 2024-09-21T06:45:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.791+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 shutdown_connections 2024-09-21T06:45:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.791+0000 7f8a4cff9640 1 -- 172.21.15.81:0/1198495564 <== osd.5 v2:172.21.15.89:6810/2407243866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8a50074f70 con 0x7f8a501fd030 2024-09-21T06:45:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.791+0000 7f768f45c640 1 -- 172.21.15.81:0/333629022 wait complete. 2024-09-21T06:45:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.791+0000 7f18772c9640 1 Processor -- start 2024-09-21T06:45:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.792+0000 7f18772c9640 1 -- start start 2024-09-21T06:45:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.792+0000 7f8a367fc640 1 -- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8a501fd030 msgr2=0x7f8a50158250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.792+0000 7f8a367fc640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8a501fd030 0x7f8a50158250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.793+0000 7f8a367fc640 1 -- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a3c078c60 msgr2=0x7f8a3c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.793+0000 7f8a367fc640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a3c078c60 0x7f8a3c07b170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000bbe0 tx=0x7f8a4000b5c0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.793+0000 7f8a367fc640 1 -- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a500d3970 msgr2=0x7f8a5015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.793+0000 7f8a367fc640 1 --2- 172.21.15.81:0/1198495564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a500d3970 0x7f8a5015d760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a44031000 tx=0x7f8a44030570 comp rx=0 tx=0).stop 2024-09-21T06:45:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.793+0000 7f8a54bea640 1 -- 172.21.15.81:0/1198495564 reap_dead start 2024-09-21T06:45:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.793+0000 7f8a367fc640 1 -- 172.21.15.81:0/1198495564 shutdown_connections 2024-09-21T06:45:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.793+0000 7f8a367fc640 1 -- 172.21.15.81:0/1198495564 >> 172.21.15.81:0/1198495564 conn(0x7f8a500d4cf0 msgr2=0x7f8a50068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.794+0000 7f18772c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c003a20 0x7f187013ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.794+0000 7f18762c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c003a20 0x7f187013ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.794+0000 7f18762c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c003a20 0x7f187013ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54712/0 (socket says 172.21.15.81:54712) 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.794+0000 7f18762c7640 1 -- 172.21.15.81:0/925108404 learned_addr learned my addr 172.21.15.81:0/925108404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.794+0000 7f18772c9640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18700aac90 0x7f1870140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.794+0000 7f18772c9640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870140940 0x7f18701f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.795+0000 7f18772c9640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f187006e180 con 0x7f185c003a20 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.795+0000 7f18772c9640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f187006e000 con 0x7f18700aac90 2024-09-21T06:45:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.795+0000 7f18772c9640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f187006e300 con 0x7f1870140940 2024-09-21T06:45:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.795+0000 7f8a367fc640 1 -- 172.21.15.81:0/1198495564 shutdown_connections 2024-09-21T06:45:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.795+0000 7f1876ac8640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870140940 0x7f18701f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.796+0000 7f1875ac6640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18700aac90 0x7f1870140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.796+0000 7f1876ac8640 1 -- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18700aac90 msgr2=0x7f1870140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.796+0000 7f1876ac8640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18700aac90 0x7f1870140400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.796+0000 7f1876ac8640 1 -- 172.21.15.81:0/925108404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c003a20 msgr2=0x7f187013ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.796+0000 7f1876ac8640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c003a20 0x7f187013ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.796+0000 7f1876ac8640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1870140d50 con 0x7f1870140940 2024-09-21T06:45:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.797+0000 7f1876ac8640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870140940 0x7f18701f8520 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18700cdac0 tx=0x7f186000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.797+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860018070 con 0x7f1870140940 2024-09-21T06:45:31.803 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-21T06:45:31.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T06:45:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.798+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1860010800 con 0x7f1870140940 2024-09-21T06:45:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.798+0000 7f18772c9640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18700ab9c0 con 0x7f1870140940 2024-09-21T06:45:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.798+0000 7f18772c9640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1870159d30 con 0x7f1870140940 2024-09-21T06:45:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.798+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860010c50 con 0x7f1870140940 2024-09-21T06:45:31.805 INFO:teuthology.orchestra.run.smithi081.stdout:64424509449 2024-09-21T06:45:31.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T06:45:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.799+0000 7f8a367fc640 1 -- 172.21.15.81:0/1198495564 wait complete. 2024-09-21T06:45:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.799+0000 7f18772c9640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1858001030 con 0x7f1870140940 2024-09-21T06:45:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.800+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f186001b070 con 0x7f1870140940 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.801+0000 7f1866ffd640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1854078c40 0x7f185407b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.802+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f186009a590 con 0x7f1870140940 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.802+0000 7f1866ffd640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f1854082410 0x7f18540848a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.802+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1860012e50 con 0x7f1854082410 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.802+0000 7f18762c7640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1854078c40 0x7f185407b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.802+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f18600a1050 con 0x7f1870140940 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.803+0000 7f1875ac6640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f1854082410 0x7f18540848a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.804+0000 7f18762c7640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1854078c40 0x7f185407b150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1868001370 tx=0x7f1868001510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.804+0000 7f1875ac6640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f1854082410 0x7f18540848a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:31.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.804+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== osd.4 v2:172.21.15.89:6802/1367095570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1860012e50 con 0x7f1854082410 2024-09-21T06:45:31.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.809+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 --> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb924002d50 con 0x7fb9300825d0 2024-09-21T06:45:31.813 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-21T06:45:31.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.810+0000 7fb92b7fe640 1 -- 172.21.15.81:0/915345928 <== osd.0 v2:172.21.15.81:6816/3316093224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb924002d50 con 0x7fb9300825d0 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.811+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fb9300825d0 msgr2=0x7fb930084a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.811+0000 7fb94909b640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fb9300825d0 0x7fb930084a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.811+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb930078f90 msgr2=0x7fb93007b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.811+0000 7fb94909b640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb930078f90 0x7fb93007b4a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0012e0 tx=0x7fb93c009040 comp rx=0 tx=0).stop 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.811+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94415f950 msgr2=0x7fb94409c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.811+0000 7fb94909b640 1 --2- 172.21.15.81:0/915345928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94415f950 0x7fb94409c5f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb938009920 tx=0x7fb938003820 comp rx=0 tx=0).stop 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.811+0000 7fb94359e640 1 -- 172.21.15.81:0/915345928 reap_dead start 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.812+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 shutdown_connections 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.812+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 >> 172.21.15.81:0/915345928 conn(0x7fb9440b1c40 msgr2=0x7fb94406cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.812+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 shutdown_connections 2024-09-21T06:45:31.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.812+0000 7fb94909b640 1 -- 172.21.15.81:0/915345928 wait complete. 2024-09-21T06:45:31.817 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2024-09-21T06:45:31.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T06:45:31.819 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2024-09-21T06:45:31.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T06:45:31.822 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2024-09-21T06:45:31.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T06:45:31.834 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-21T06:45:31.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T06:45:31.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.834+0000 7f18772c9640 1 -- 172.21.15.81:0/925108404 --> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1858002dd0 con 0x7f1854082410 2024-09-21T06:45:31.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.834+0000 7f1866ffd640 1 -- 172.21.15.81:0/925108404 <== osd.4 v2:172.21.15.89:6802/1367095570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1858002dd0 con 0x7f1854082410 2024-09-21T06:45:31.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.835+0000 7f1864ff9640 1 -- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f1854082410 msgr2=0x7f18540848a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.835+0000 7f1864ff9640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f1854082410 0x7f18540848a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.835+0000 7f1864ff9640 1 -- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1854078c40 msgr2=0x7f185407b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.835+0000 7f1864ff9640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1854078c40 0x7f185407b150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1868001370 tx=0x7f1868001510 comp rx=0 tx=0).stop 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.835+0000 7f1864ff9640 1 -- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870140940 msgr2=0x7f18701f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.835+0000 7f1864ff9640 1 --2- 172.21.15.81:0/925108404 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1870140940 0x7f18701f8520 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f18700cdac0 tx=0x7f186000c8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.836+0000 7f1876ac8640 1 -- 172.21.15.81:0/925108404 reap_dead start 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.836+0000 7f1864ff9640 1 -- 172.21.15.81:0/925108404 shutdown_connections 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.836+0000 7f1864ff9640 1 -- 172.21.15.81:0/925108404 >> 172.21.15.81:0/925108404 conn(0x7f18700b1d00 msgr2=0x7f18700b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.836+0000 7f1864ff9640 1 -- 172.21.15.81:0/925108404 shutdown_connections 2024-09-21T06:45:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:31.836+0000 7f1864ff9640 1 -- 172.21.15.81:0/925108404 wait complete. 2024-09-21T06:45:31.859 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2024-09-21T06:45:31.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T06:45:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.022+0000 7f63d359e640 1 -- 172.21.15.81:0/2992895051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 msgr2=0x7f63bc00ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.022+0000 7f63d359e640 1 --2- 172.21.15.81:0/2992895051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 0x7f63bc00ba20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63c800c310 tx=0x7f63bc005830 comp rx=0 tx=0).stop 2024-09-21T06:45:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.022+0000 7f63d359e640 1 -- 172.21.15.81:0/2992895051 shutdown_connections 2024-09-21T06:45:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.022+0000 7f63d359e640 1 --2- 172.21.15.81:0/2992895051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 0x7f63bc00ba20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.022+0000 7f63d359e640 1 -- 172.21.15.81:0/2992895051 >> 172.21.15.81:0/2992895051 conn(0x7f63cc01d9a0 msgr2=0x7f63cc039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.024+0000 7feaac4f2640 1 -- 172.21.15.81:0/2371832257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa40b3910 msgr2=0x7feaa4162280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.024+0000 7f93a147e640 1 -- 172.21.15.81:0/2218185873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9384003cd0 msgr2=0x7f9384004120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.024+0000 7feaac4f2640 1 --2- 172.21.15.81:0/2371832257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa40b3910 0x7feaa4162280 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feaa0005fd0 tx=0x7feaa002a4e0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.024+0000 7f93a147e640 1 --2- 172.21.15.81:0/2218185873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9384003cd0 0x7f9384004120 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f938c006d10 tx=0x7f9384005830 comp rx=0 tx=0).stop 2024-09-21T06:45:32.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7f63d359e640 1 -- 172.21.15.81:0/2992895051 shutdown_connections 2024-09-21T06:45:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7feaac4f2640 1 -- 172.21.15.81:0/2371832257 shutdown_connections 2024-09-21T06:45:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7feaac4f2640 1 --2- 172.21.15.81:0/2371832257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa40b3910 0x7feaa4162280 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7feaac4f2640 1 --2- 172.21.15.81:0/2371832257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaa406d1a0 0x7feaa40b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7feaac4f2640 1 -- 172.21.15.81:0/2371832257 >> 172.21.15.81:0/2371832257 conn(0x7feaa40d0840 msgr2=0x7feaa40d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7f93a147e640 1 -- 172.21.15.81:0/2218185873 shutdown_connections 2024-09-21T06:45:32.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7f63d359e640 1 -- 172.21.15.81:0/2992895051 wait complete. 2024-09-21T06:45:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7f93a147e640 1 --2- 172.21.15.81:0/2218185873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9384003cd0 0x7f9384004120 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7feaac4f2640 1 -- 172.21.15.81:0/2371832257 shutdown_connections 2024-09-21T06:45:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7f93a147e640 1 -- 172.21.15.81:0/2218185873 >> 172.21.15.81:0/2218185873 conn(0x7f939c0d02e0 msgr2=0x7f939c0d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7f93a147e640 1 -- 172.21.15.81:0/2218185873 shutdown_connections 2024-09-21T06:45:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7feaac4f2640 1 -- 172.21.15.81:0/2371832257 wait complete. 2024-09-21T06:45:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.028+0000 7f63d359e640 1 Processor -- start 2024-09-21T06:45:32.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.028+0000 7feaac4f2640 1 Processor -- start 2024-09-21T06:45:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.025+0000 7f93a147e640 1 -- 172.21.15.81:0/2218185873 wait complete. 2024-09-21T06:45:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.028+0000 7f93a147e640 1 Processor -- start 2024-09-21T06:45:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.029+0000 7f93a147e640 1 -- start start 2024-09-21T06:45:32.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.028+0000 7f63d359e640 1 -- start start 2024-09-21T06:45:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.030+0000 7f63d359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 0x7f63cc04a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.028+0000 7feaac4f2640 1 -- start start 2024-09-21T06:45:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.030+0000 7feaac4f2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaa406d1a0 0x7feaa414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f63d259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 0x7f63cc04a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaac4f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaa40b3910 0x7feaa40af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaac4f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa41627c0 0x7feaa40af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f63d259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 0x7f63cc04a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54742/0 (socket says 172.21.15.81:54742) 2024-09-21T06:45:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f63d259c640 1 -- 172.21.15.81:0/417287741 learned_addr learned my addr 172.21.15.81:0/417287741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63cc033330 0x7f63cc04fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f93a147e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9384003cd0 0x7f939c0ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaaa28e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaa406d1a0 0x7feaa414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaaa28e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaa406d1a0 0x7feaa414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39446/0 (socket says 172.21.15.81:39446) 2024-09-21T06:45:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaa9a8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaa40b3910 0x7feaa40af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaa9a8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaa40b3910 0x7feaa40af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58458/0 (socket says 172.21.15.81:58458) 2024-09-21T06:45:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63cc033740 0x7f63cc050060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f939affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9384003cd0 0x7f939c0ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f939affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9384003cd0 0x7f939c0ac060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54760/0 (socket says 172.21.15.81:54760) 2024-09-21T06:45:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaaaa8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa41627c0 0x7feaa40af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaaaa8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa41627c0 0x7feaa40af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54752/0 (socket says 172.21.15.81:54752) 2024-09-21T06:45:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaaa28e640 1 -- 172.21.15.81:0/939716297 learned_addr learned my addr 172.21.15.81:0/939716297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f939affd640 1 -- 172.21.15.81:0/3700123192 learned_addr learned my addr 172.21.15.81:0/3700123192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc033ec0 con 0x7f63bc0053a0 2024-09-21T06:45:32.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feaa40b4840 con 0x7feaa41627c0 2024-09-21T06:45:32.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f93a147e640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f939c0ac5a0 0x7f939c153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7feaa406e600 con 0x7feaa40b3910 2024-09-21T06:45:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7feaa415f3b0 con 0x7feaa406d1a0 2024-09-21T06:45:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0e3620 con 0x7f63cc033330 2024-09-21T06:45:32.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.031+0000 7f93a147e640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939c1539c0 0x7f939c203cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f93a147e640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f939c159b40 con 0x7f9384003cd0 2024-09-21T06:45:32.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f93a147e640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f939c15a8c0 con 0x7f939c1539c0 2024-09-21T06:45:32.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f93a147e640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f939c159cc0 con 0x7f939c0ac5a0 2024-09-21T06:45:32.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f939a7fc640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f939c0ac5a0 0x7f939c153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f939b7fe640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939c1539c0 0x7f939c203cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f939affd640 1 -- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f939c0ac5a0 msgr2=0x7f939c153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f939affd640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f939c0ac5a0 0x7f939c153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f939affd640 1 -- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939c1539c0 msgr2=0x7f939c203cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f939affd640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939c1539c0 0x7f939c203cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f939affd640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c158a10 con 0x7f9384003cd0 2024-09-21T06:45:32.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7feaaaa8f640 1 -- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaa406d1a0 msgr2=0x7feaa414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7feaaaa8f640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaa406d1a0 0x7feaa414f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7feaaaa8f640 1 -- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaa40b3910 msgr2=0x7feaa40af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f939affd640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9384003cd0 0x7f939c0ac060 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f938c006e30 tx=0x7f938c0060d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f93837fe640 1 -- 172.21.15.81:0/3700123192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c041030 con 0x7f9384003cd0 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f93a147e640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c158cf0 con 0x7f9384003cd0 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f93a147e640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c204d40 con 0x7f9384003cd0 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.035+0000 7f93837fe640 1 -- 172.21.15.81:0/3700123192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f938c003670 con 0x7f9384003cd0 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.035+0000 7f93837fe640 1 -- 172.21.15.81:0/3700123192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c038040 con 0x7f9384003cd0 2024-09-21T06:45:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.035+0000 7f93a147e640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939c203900 con 0x7f9384003cd0 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f0b88e1c640 1 -- 172.21.15.81:0/2521626020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b7c057560 msgr2=0x7f0b7c0e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f0b88e1c640 1 --2- 172.21.15.81:0/2521626020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b7c057560 0x7f0b7c0e3650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0b8407a950 tx=0x7f0b840a65c0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f0b88e1c640 1 -- 172.21.15.81:0/2521626020 shutdown_connections 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f0b88e1c640 1 --2- 172.21.15.81:0/2521626020 >> v2:172.21.15.81:3300/0 conn(0x7f0b7c053fd0 0x7f0b7c037490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f0b88e1c640 1 --2- 172.21.15.81:0/2521626020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b7c057560 0x7f0b7c0e3650 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f0b88e1c640 1 -- 172.21.15.81:0/2521626020 >> 172.21.15.81:0/2521626020 conn(0x7f0b7c055e70 msgr2=0x7f0b7c00e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7f63d1d9b640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63cc033330 0x7f63cc04fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f63d2d9d640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63cc033740 0x7f63cc050060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f63cc006780 con 0x7f63cc033740 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f63d2d9d640 1 -- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63cc033330 msgr2=0x7f63cc04fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f63d2d9d640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63cc033330 0x7f63cc04fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f63d2d9d640 1 -- 172.21.15.81:0/417287741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 msgr2=0x7f63cc04a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f63d2d9d640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 0x7f63cc04a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7f63d2d9d640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc181da0 con 0x7f63cc033740 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f63d2d9d640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63cc033740 0x7f63cc050060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00d030 tx=0x7f63c80064e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f63c2ffd640 1 -- 172.21.15.81:0/417287741 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8006cb0 con 0x7f63cc033740 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f63c2ffd640 1 -- 172.21.15.81:0/417287741 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63c8003820 con 0x7f63cc033740 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc182080 con 0x7f63cc033740 2024-09-21T06:45:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc182640 con 0x7f63cc033740 2024-09-21T06:45:32.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f33171ff640 1 -- 172.21.15.81:0/4289393588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 msgr2=0x7f33100735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f33171ff640 1 --2- 172.21.15.81:0/4289393588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100735f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3310071a70 tx=0x7f330402c730 comp rx=0 tx=0).stop 2024-09-21T06:45:32.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f33171ff640 1 -- 172.21.15.81:0/4289393588 shutdown_connections 2024-09-21T06:45:32.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f33171ff640 1 --2- 172.21.15.81:0/4289393588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100735f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f33171ff640 1 --2- 172.21.15.81:0/4289393588 >> v2:172.21.15.89:3300/0 conn(0x7f331008b980 0x7f33100b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f33171ff640 1 -- 172.21.15.81:0/4289393588 >> 172.21.15.81:0/4289393588 conn(0x7f33100d02e0 msgr2=0x7f33100d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.034+0000 7f0b88e1c640 1 -- 172.21.15.81:0/2521626020 shutdown_connections 2024-09-21T06:45:32.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.035+0000 7f0b88e1c640 1 -- 172.21.15.81:0/2521626020 wait complete. 2024-09-21T06:45:32.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f0b88e1c640 1 Processor -- start 2024-09-21T06:45:32.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.038+0000 7f0b88e1c640 1 -- start start 2024-09-21T06:45:32.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.037+0000 7f63c2ffd640 1 -- 172.21.15.81:0/417287741 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8003a50 con 0x7f63cc033740 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f93837fe640 1 -- 172.21.15.81:0/3700123192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f938c044070 con 0x7f9384003cd0 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f93837fe640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9388078b90 0x7f938807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f939a7fc640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9388078b90 0x7f938807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f93837fe640 1 -- 172.21.15.81:0/3700123192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f938c0bb660 con 0x7f9384003cd0 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b88e1c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b7c057560 0x7f0b7c0d7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b88e1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b7c0e0c10 0x7f0b7c0d8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b88e1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c04af70 0x7f0b7c0d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b88e1c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c037db0 con 0x7f0b7c04af70 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b88e1c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c037c30 con 0x7f0b7c0e0c10 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b88e1c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c037f30 con 0x7f0b7c057560 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b837fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b7c057560 0x7f0b7c0d7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c04af70 0x7f0b7c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c04af70 0x7f0b7c0d5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54776/0 (socket says 172.21.15.81:54776) 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.040+0000 7f0b83fff640 1 -- 172.21.15.81:0/1640349745 learned_addr learned my addr 172.21.15.81:0/1640349745 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f0b83fff640 1 -- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b7c057560 msgr2=0x7f0b7c0d7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f0b83fff640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b7c057560 0x7f0b7c0d7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f0b83fff640 1 -- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b7c0e0c10 msgr2=0x7f0b7c0d8200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f0b83fff640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b7c0e0c10 0x7f0b7c0d8200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f0b83fff640 1 -- 172.21.15.81:0/1640349745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c0d5600 con 0x7f0b7c04af70 2024-09-21T06:45:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f0b83fff640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c04af70 0x7f0b7c0d5b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800e940 tx=0x7f0b7800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.038+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc181af0 con 0x7f63cc033740 2024-09-21T06:45:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7feaaaa8f640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaa40b3910 0x7feaa40af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7feaaaa8f640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa414ff60 con 0x7feaa41627c0 2024-09-21T06:45:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.032+0000 7feaaaa8f640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa41627c0 0x7feaa40af7c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c730 tx=0x7fea9400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7fea9affd640 1 -- 172.21.15.81:0/939716297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94017070 con 0x7feaa41627c0 2024-09-21T06:45:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7fea9affd640 1 -- 172.21.15.81:0/939716297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea94005360 con 0x7feaa41627c0 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7fea9affd640 1 -- 172.21.15.81:0/939716297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9400a8a0 con 0x7feaa41627c0 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa41fd500 con 0x7feaa41627c0 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.033+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa415be50 con 0x7feaa41627c0 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.038+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa415f960 con 0x7feaa41627c0 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f939a7fc640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9388078b90 0x7f938807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9394006fd0 tx=0x7f9394006e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.038+0000 7f33171ff640 1 -- 172.21.15.81:0/4289393588 shutdown_connections 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.038+0000 7f33171ff640 1 -- 172.21.15.81:0/4289393588 wait complete. 2024-09-21T06:45:32.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.041+0000 7f33171ff640 1 Processor -- start 2024-09-21T06:45:32.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.042+0000 7f33171ff640 1 -- start start 2024-09-21T06:45:32.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.043+0000 7f63c2ffd640 1 -- 172.21.15.81:0/417287741 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63c8003bf0 con 0x7f63cc033740 2024-09-21T06:45:32.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.043+0000 7fea9affd640 1 -- 172.21.15.81:0/939716297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea9401a070 con 0x7feaa41627c0 2024-09-21T06:45:32.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.043+0000 7fea9affd640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fea88078c60 0x7fea8807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f63c2ffd640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63b4078c90 0x7f63b407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.043+0000 7fea9affd640 1 -- 172.21.15.81:0/939716297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fea9409a4f0 con 0x7feaa41627c0 2024-09-21T06:45:32.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7feaaa28e640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fea88078c60 0x7fea8807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f63d259c640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63b4078c90 0x7f63b407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f63c2ffd640 1 -- 172.21.15.81:0/417287741 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f63c80ba840 con 0x7f63cc033740 2024-09-21T06:45:32.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7feaaa28e640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fea88078c60 0x7fea8807b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009f90 tx=0x7fea9c0095b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f63d259c640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63b4078c90 0x7f63b407b1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f63d406bb00 tx=0x7f63d4070040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f93837fe640 1 -- 172.21.15.81:0/3700123192 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f938c006240 con 0x7f9384003cd0 2024-09-21T06:45:32.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f466a07a640 1 -- 172.21.15.81:0/3495464713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 msgr2=0x7f46640b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f466a07a640 1 --2- 172.21.15.81:0/3495464713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46640b38a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4654007380 tx=0x7f465402b1d0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f33171ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f33171ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331008b980 0x7f3310216130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f33171ff640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331016ed60 0x7f33102169e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f33171ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3310073ec0 con 0x7f33100731e0 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f33171ff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3310073d40 con 0x7f331008b980 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f33171ff640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3310074040 con 0x7f331016ed60 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f3314f9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f3314f9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54792/0 (socket says 172.21.15.81:54792) 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f3314f9b640 1 -- 172.21.15.81:0/3281261752 learned_addr learned my addr 172.21.15.81:0/3281261752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f330ffff640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331008b980 0x7f3310216130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.044+0000 7f331579c640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331016ed60 0x7f33102169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f3314f9b640 1 -- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331016ed60 msgr2=0x7f33102169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f3314f9b640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331016ed60 0x7f33102169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f3314f9b640 1 -- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331008b980 msgr2=0x7f3310216130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f3314f9b640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331008b980 0x7f3310216130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f3314f9b640 1 -- 172.21.15.81:0/3281261752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3310215090 con 0x7f33100731e0 2024-09-21T06:45:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f331579c640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331016ed60 0x7f33102169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f330ffff640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331008b980 0x7f3310216130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f3314f9b640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100a9490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f330000e740 tx=0x7f330000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f466a07a640 1 -- 172.21.15.81:0/3495464713 shutdown_connections 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f466a07a640 1 --2- 172.21.15.81:0/3495464713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46640b38a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f466a07a640 1 -- 172.21.15.81:0/3495464713 >> 172.21.15.81:0/3495464713 conn(0x7f46640b1d00 msgr2=0x7f46640b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f466a07a640 1 -- 172.21.15.81:0/3495464713 shutdown_connections 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.045+0000 7f466a07a640 1 -- 172.21.15.81:0/3495464713 wait complete. 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.047+0000 7f466a07a640 1 Processor -- start 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.047+0000 7f466a07a640 1 -- start start 2024-09-21T06:45:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f466a07a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466406dda0 0x7f466414aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f63c2ffd640 1 -- 172.21.15.81:0/417287741 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f63c8082360 con 0x7f63cc033740 2024-09-21T06:45:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f466a07a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46640744d0 0x7f466414a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f466a07a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46641471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f466a07a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4664072cc0 con 0x7f466406dda0 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f466a07a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4664072b40 con 0x7f46641582b0 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f466a07a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f4664072e40 con 0x7f46640744d0 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f4669879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46641471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f4668877640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46640744d0 0x7f466414a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f4669879640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46641471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58490/0 (socket says 172.21.15.81:58490) 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.049+0000 7f4669879640 1 -- 172.21.15.81:0/903915359 learned_addr learned my addr 172.21.15.81:0/903915359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669879640 1 -- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46640744d0 msgr2=0x7f466414a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669078640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466406dda0 0x7f466414aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669879640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46640744d0 0x7f466414a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669879640 1 -- 172.21.15.81:0/903915359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466406dda0 msgr2=0x7f466414aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669879640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466406dda0 0x7f466414aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669879640 1 -- 172.21.15.81:0/903915359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46641476e0 con 0x7f46641582b0 2024-09-21T06:45:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669078640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466406dda0 0x7f466414aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 -- 172.21.15.81:0/2837836348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f745015b780 msgr2=0x7f745015e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 --2- 172.21.15.81:0/2837836348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f745015b780 0x7f745015e360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7448005fd0 tx=0x7f744802a8d0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f4669879640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46641471a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f466000c390 tx=0x7f466000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 -- 172.21.15.81:0/2837836348 shutdown_connections 2024-09-21T06:45:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 --2- 172.21.15.81:0/2837836348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f745015b780 0x7f745015e360 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7448005fd0 tx=0x7f744802a8d0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 --2- 172.21.15.81:0/2837836348 >> v2:172.21.15.89:3300/0 conn(0x7f7450070e50 0x7f7450158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 -- 172.21.15.81:0/2837836348 >> 172.21.15.81:0/2837836348 conn(0x7f74500b2030 msgr2=0x7f74500b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 -- 172.21.15.81:0/2837836348 shutdown_connections 2024-09-21T06:45:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.050+0000 7f7455827640 1 -- 172.21.15.81:0/2837836348 wait complete. 2024-09-21T06:45:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.051+0000 7f4659ffb640 1 -- 172.21.15.81:0/903915359 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660017070 con 0x7f46641582b0 2024-09-21T06:45:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.051+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4664147b90 con 0x7f46641582b0 2024-09-21T06:45:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.051+0000 7f4659ffb640 1 -- 172.21.15.81:0/903915359 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46600053c0 con 0x7f46641582b0 2024-09-21T06:45:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.051+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4664148150 con 0x7f46641582b0 2024-09-21T06:45:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.052+0000 7f4659ffb640 1 -- 172.21.15.81:0/903915359 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660017070 con 0x7f46641582b0 2024-09-21T06:45:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.053+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46640cd420 con 0x7f46641582b0 2024-09-21T06:45:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.053+0000 7f7455827640 1 Processor -- start 2024-09-21T06:45:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.054+0000 7f7455827640 1 -- start start 2024-09-21T06:45:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.054+0000 7f0b6ffff640 1 -- 172.21.15.81:0/1640349745 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7800cd80 con 0x7f0b7c04af70 2024-09-21T06:45:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.054+0000 7f0b6ffff640 1 -- 172.21.15.81:0/1640349745 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b78004020 con 0x7f0b7c04af70 2024-09-21T06:45:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f0b6ffff640 1 -- 172.21.15.81:0/1640349745 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78004450 con 0x7f0b7c04af70 2024-09-21T06:45:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.055+0000 7f4659ffb640 1 -- 172.21.15.81:0/903915359 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f466001a070 con 0x7f46641582b0 2024-09-21T06:45:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f4659ffb640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4648078d90 0x7f464807b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f4659ffb640 1 -- 172.21.15.81:0/903915359 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4660098590 con 0x7f46641582b0 2024-09-21T06:45:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f330d7fa640 1 -- 172.21.15.81:0/3281261752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330000ccc0 con 0x7f33100731e0 2024-09-21T06:45:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f330d7fa640 1 -- 172.21.15.81:0/3281261752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f330000ee50 con 0x7f33100731e0 2024-09-21T06:45:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f33171ff640 1 -- 172.21.15.81:0/3281261752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3310215370 con 0x7f33100731e0 2024-09-21T06:45:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f33171ff640 1 -- 172.21.15.81:0/3281261752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3310215930 con 0x7f33100731e0 2024-09-21T06:45:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.056+0000 7f7455827640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7450070e50 0x7f7450155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.054+0000 7fea9affd640 1 -- 172.21.15.81:0/939716297 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feaa4162bd0 con 0x7feaa41627c0 2024-09-21T06:45:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f7455827640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74500ad290 0x7f7450153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f4669078640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4648078d90 0x7f464807b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f7455827640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74500cdab0 0x7f74501f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f744effd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7450070e50 0x7f7450155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f744effd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7450070e50 0x7f7450155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39518/0 (socket says 172.21.15.81:39518) 2024-09-21T06:45:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f744e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74500ad290 0x7f7450153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f744e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74500ad290 0x7f7450153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58506/0 (socket says 172.21.15.81:58506) 2024-09-21T06:45:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f4669078640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4648078d90 0x7f464807b2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f465c004a30 tx=0x7f465c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f744effd640 1 -- 172.21.15.81:0/3245413044 learned_addr learned my addr 172.21.15.81:0/3245413044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.057+0000 7f7455827640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74500b30c0 con 0x7f74500cdab0 2024-09-21T06:45:32.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f7455827640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f74500b2f40 con 0x7f74500ad290 2024-09-21T06:45:32.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f7455827640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f74500b3240 con 0x7f7450070e50 2024-09-21T06:45:32.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f0b88e1c640 1 -- 172.21.15.81:0/1640349745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c0cbe00 con 0x7f0b7c04af70 2024-09-21T06:45:32.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f0b88e1c640 1 -- 172.21.15.81:0/1640349745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c0cc3c0 con 0x7f0b7c04af70 2024-09-21T06:45:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f744effd640 1 -- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74500ad290 msgr2=0x7f7450153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f744effd640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74500ad290 0x7f7450153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f744effd640 1 -- 172.21.15.81:0/3245413044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74500cdab0 msgr2=0x7f74501f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f744effd640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74500cdab0 0x7f74501f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.058+0000 7f744effd640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74501f6f50 con 0x7f7450070e50 2024-09-21T06:45:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.059+0000 7f330d7fa640 1 -- 172.21.15.81:0/3281261752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300010670 con 0x7f33100731e0 2024-09-21T06:45:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.059+0000 7f4659ffb640 1 -- 172.21.15.81:0/903915359 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f46640cd420 con 0x7f46641582b0 2024-09-21T06:45:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.059+0000 7f0b88e1c640 1 -- 172.21.15.81:0/1640349745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c037490 con 0x7f0b7c04af70 2024-09-21T06:45:32.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.060+0000 7f744effd640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7450070e50 0x7f7450155a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f744000e7c0 tx=0x7f744000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.060+0000 7f7437fff640 1 -- 172.21.15.81:0/3245413044 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440020070 con 0x7f7450070e50 2024-09-21T06:45:32.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.061+0000 7f7437fff640 1 -- 172.21.15.81:0/3245413044 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f744000cdb0 con 0x7f7450070e50 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.061+0000 7f7437fff640 1 -- 172.21.15.81:0/3245413044 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440013a30 con 0x7f7450070e50 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.062+0000 7f7455827640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74501f7230 con 0x7f7450070e50 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.063+0000 7f7455827640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74501f77f0 con 0x7f7450070e50 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.066+0000 7f7437fff640 1 -- 172.21.15.81:0/3245413044 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7440023070 con 0x7f7450070e50 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.066+0000 7f7437fff640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f743c078c90 0x7f743c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.067+0000 7f7437fff640 1 -- 172.21.15.81:0/3245413044 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f744009f760 con 0x7f7450070e50 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.067+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745015e360 con 0x7f7450070e50 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.060+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f0005290 con 0x7f33100731e0 2024-09-21T06:45:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.067+0000 7f330d7fa640 1 -- 172.21.15.81:0/3281261752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3300010810 con 0x7f33100731e0 2024-09-21T06:45:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.068+0000 7f744e7fc640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f743c078c90 0x7f743c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.069+0000 7f330d7fa640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f32fc078c60 0x7f32fc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.069+0000 7f330ffff640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f32fc078c60 0x7f32fc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.070+0000 7f330d7fa640 1 -- 172.21.15.81:0/3281261752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f330009b960 con 0x7f33100731e0 2024-09-21T06:45:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.070+0000 7f744e7fc640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f743c078c90 0x7f743c07b1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7448034000 tx=0x7f7448004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.070+0000 7f330ffff640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f32fc078c60 0x7f32fc07b170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f331016ed30 tx=0x7f3308009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.071+0000 7f0b6ffff640 1 -- 172.21.15.81:0/1640349745 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b780035f0 con 0x7f0b7c04af70 2024-09-21T06:45:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.072+0000 7f0b6ffff640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b74078d30 0x7f0b7407b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.072+0000 7f0b837fe640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b74078d30 0x7f0b7407b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.073+0000 7f0b6ffff640 1 -- 172.21.15.81:0/1640349745 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0b78009410 con 0x7f0b7c04af70 2024-09-21T06:45:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.073+0000 7f7437fff640 1 -- 172.21.15.81:0/3245413044 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f74400671f0 con 0x7f7450070e50 2024-09-21T06:45:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.073+0000 7f0b837fe640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b74078d30 0x7f0b7407b240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0588b0 tx=0x7f0b840aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.074+0000 7f0b6ffff640 1 -- 172.21.15.81:0/1640349745 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b78099e20 con 0x7f0b7c04af70 2024-09-21T06:45:32.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.082+0000 7f330d7fa640 1 -- 172.21.15.81:0/3281261752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3300063480 con 0x7f33100731e0 2024-09-21T06:45:32.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.150+0000 7ff8c9a0a640 1 -- 172.21.15.81:0/3562236507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 msgr2=0x7ff8c4071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.150+0000 7ff8c9a0a640 1 --2- 172.21.15.81:0/3562236507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c4071720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009830 tx=0x7ff8b402a530 comp rx=0 tx=0).stop 2024-09-21T06:45:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.155+0000 7ff8c9a0a640 1 -- 172.21.15.81:0/3562236507 shutdown_connections 2024-09-21T06:45:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.155+0000 7ff8c9a0a640 1 --2- 172.21.15.81:0/3562236507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c40d1150 0x7ff8c40d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.155+0000 7ff8c9a0a640 1 --2- 172.21.15.81:0/3562236507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c4071720 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.155+0000 7ff8c9a0a640 1 -- 172.21.15.81:0/3562236507 >> 172.21.15.81:0/3562236507 conn(0x7ff8c409aa30 msgr2=0x7ff8c40b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.163+0000 7ff8c9a0a640 1 -- 172.21.15.81:0/3562236507 shutdown_connections 2024-09-21T06:45:32.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.167+0000 7ff8c9a0a640 1 -- 172.21.15.81:0/3562236507 wait complete. 2024-09-21T06:45:32.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.170+0000 7ff8c9a0a640 1 Processor -- start 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.170+0000 7ff8c9a0a640 1 -- start start 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c9a0a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c40cdb90 0x7ff8c40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c9a0a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40d1150 0x7ff8c40af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c9a0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c9a0a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c40ce6b0 con 0x7ff8c415b6a0 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c9a0a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c40d2120 con 0x7ff8c40d1150 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c9a0a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40ce830 con 0x7ff8c40cdb90 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c40cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54818/0 (socket says 172.21.15.81:54818) 2024-09-21T06:45:32.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.172+0000 7ff8c37fe640 1 -- 172.21.15.81:0/585328686 learned_addr learned my addr 172.21.15.81:0/585328686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.177+0000 7ff8c27fc640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40d1150 0x7ff8c40af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.180+0000 7ff8c37fe640 1 -- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c40cdb90 msgr2=0x7ff8c40ae030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:45:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.180+0000 7ff8c37fe640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c40cdb90 0x7ff8c40ae030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.180+0000 7ff8c37fe640 1 -- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40d1150 msgr2=0x7ff8c40af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.180+0000 7ff8c37fe640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40d1150 0x7ff8c40af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.180+0000 7ff8c37fe640 1 -- 172.21.15.81:0/585328686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c40b23e0 con 0x7ff8c415b6a0 2024-09-21T06:45:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.180+0000 7ff8c37fe640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c40cad60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00ca70 tx=0x7ff8bc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.185+0000 7ff8abfff640 1 -- 172.21.15.81:0/585328686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc016020 con 0x7ff8c415b6a0 2024-09-21T06:45:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.185+0000 7ff8c9a0a640 1 -- 172.21.15.81:0/585328686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c40b26c0 con 0x7ff8c415b6a0 2024-09-21T06:45:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.185+0000 7ff8c9a0a640 1 -- 172.21.15.81:0/585328686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c40b0e60 con 0x7ff8c415b6a0 2024-09-21T06:45:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.186+0000 7ff8abfff640 1 -- 172.21.15.81:0/585328686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8bc00acc0 con 0x7ff8c415b6a0 2024-09-21T06:45:32.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.186+0000 7ff8abfff640 1 -- 172.21.15.81:0/585328686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc012680 con 0x7ff8c415b6a0 2024-09-21T06:45:32.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.189+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a4005290 con 0x7ff8c415b6a0 2024-09-21T06:45:32.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.202+0000 7ff8abfff640 1 -- 172.21.15.81:0/585328686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8bc019020 con 0x7ff8c415b6a0 2024-09-21T06:45:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.203+0000 7ff8abfff640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff8b0078c60 0x7ff8b007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.203+0000 7ff8abfff640 1 -- 172.21.15.81:0/585328686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff8bc09adc0 con 0x7ff8c415b6a0 2024-09-21T06:45:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.203+0000 7ff8abfff640 1 -- 172.21.15.81:0/585328686 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8bc020070 con 0x7ff8c415b6a0 2024-09-21T06:45:32.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.207+0000 7ff8c2ffd640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff8b0078c60 0x7ff8b007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.234+0000 7ff8c2ffd640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff8b0078c60 0x7ff8b007b170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4034000 tx=0x7ff8b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.450+0000 7f0b88e1c640 1 -- 172.21.15.81:0/1640349745 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0b7c0cbb90 con 0x7f0b7c04af70 2024-09-21T06:45:32.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.451+0000 7f0b6ffff640 1 -- 172.21.15.81:0/1640349745 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b78099e20 con 0x7f0b7c04af70 2024-09-21T06:45:32.453 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-21T06:45:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 -- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b74078d30 msgr2=0x7f0b7407b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b74078d30 0x7f0b7407b240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0588b0 tx=0x7f0b840aa000 comp rx=0 tx=0).stop 2024-09-21T06:45:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 -- 172.21.15.81:0/1640349745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c04af70 msgr2=0x7f0b7c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c04af70 0x7f0b7c0d5b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800e940 tx=0x7f0b7800ee00 comp rx=0 tx=0).stop 2024-09-21T06:45:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 -- 172.21.15.81:0/1640349745 shutdown_connections 2024-09-21T06:45:32.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b74078d30 0x7f0b7407b240 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0588b0 tx=0x7f0b840aa000 comp rx=0 tx=0).stop 2024-09-21T06:45:32.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b7c04af70 0x7f0b7c0d5b00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b7c0e0c10 0x7f0b7c0d8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 --2- 172.21.15.81:0/1640349745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b7c057560 0x7f0b7c0d7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.461+0000 7f0b6dffb640 1 -- 172.21.15.81:0/1640349745 >> 172.21.15.81:0/1640349745 conn(0x7f0b7c055e70 msgr2=0x7f0b7c0dfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.467+0000 7f0b6dffb640 1 -- 172.21.15.81:0/1640349745 shutdown_connections 2024-09-21T06:45:32.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.467+0000 7f0b6dffb640 1 -- 172.21.15.81:0/1640349745 wait complete. 2024-09-21T06:45:32.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.476+0000 7f93a147e640 1 -- 172.21.15.81:0/3700123192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f939c204fc0 con 0x7f9384003cd0 2024-09-21T06:45:32.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.477+0000 7f93837fe640 1 -- 172.21.15.81:0/3700123192 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f938c083740 con 0x7f9384003cd0 2024-09-21T06:45:32.479 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.482+0000 7f93817fa640 1 -- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9388078b90 msgr2=0x7f938807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.482+0000 7f93817fa640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9388078b90 0x7f938807b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9394006fd0 tx=0x7f9394006e80 comp rx=0 tx=0).stop 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 -- 172.21.15.81:0/3700123192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9384003cd0 msgr2=0x7f939c0ac060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9384003cd0 0x7f939c0ac060 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f938c006e30 tx=0x7f938c0060d0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 -- 172.21.15.81:0/3700123192 shutdown_connections 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9388078b90 0x7f938807b0a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f939c0ac5a0 0x7f939c153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f939c1539c0 0x7f939c203cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 --2- 172.21.15.81:0/3700123192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9384003cd0 0x7f939c0ac060 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f93817fa640 1 -- 172.21.15.81:0/3700123192 >> 172.21.15.81:0/3700123192 conn(0x7f939c0d02e0 msgr2=0x7f939c0afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.487 INFO:teuthology.orchestra.run.smithi081.stdout:64424509446 2024-09-21T06:45:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.482+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f63cc005e30 con 0x7f63cc033740 2024-09-21T06:45:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.483+0000 7f63c2ffd640 1 -- 172.21.15.81:0/417287741 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63c8086d90 con 0x7f63cc033740 2024-09-21T06:45:32.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.485+0000 7f93817fa640 1 -- 172.21.15.81:0/3700123192 shutdown_connections 2024-09-21T06:45:32.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.485+0000 7f93817fa640 1 -- 172.21.15.81:0/3700123192 wait complete. 2024-09-21T06:45:32.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.485+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feaa415ded0 con 0x7feaa41627c0 2024-09-21T06:45:32.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.487+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63b4078c90 msgr2=0x7f63b407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.487+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63b4078c90 0x7f63b407b1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f63d406bb00 tx=0x7f63d4070040 comp rx=0 tx=0).stop 2024-09-21T06:45:32.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.487+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63cc033740 msgr2=0x7f63cc050060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.487+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63cc033740 0x7f63cc050060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00d030 tx=0x7f63c80064e0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.488+0000 7fea9affd640 1 -- 172.21.15.81:0/939716297 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea940627b0 con 0x7feaa41627c0 2024-09-21T06:45:32.492 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2024-09-21T06:45:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.491+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 shutdown_connections 2024-09-21T06:45:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.491+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63b4078c90 0x7f63b407b1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.491+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63cc033740 0x7f63cc050060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.491+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63cc033330 0x7f63cc04fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.491+0000 7f63d359e640 1 --2- 172.21.15.81:0/417287741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63bc0053a0 0x7f63cc04a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.491+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 >> 172.21.15.81:0/417287741 conn(0x7f63cc01d9a0 msgr2=0x7f63cc00b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fea88078c60 msgr2=0x7fea8807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fea88078c60 0x7fea8807b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009f90 tx=0x7fea9c0095b0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa41627c0 msgr2=0x7feaa40af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa41627c0 0x7feaa40af7c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fea9400c730 tx=0x7fea9400cbf0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 shutdown_connections 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7f63d359e640 1 -- 172.21.15.81:0/417287741 wait complete. 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 shutdown_connections 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fea88078c60 0x7fea8807b170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaa41627c0 0x7feaa40af7c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaa40b3910 0x7feaa40af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 --2- 172.21.15.81:0/939716297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaa406d1a0 0x7feaa414f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.492+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 >> 172.21.15.81:0/939716297 conn(0x7feaa40d0840 msgr2=0x7feaa415cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.493+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 shutdown_connections 2024-09-21T06:45:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.493+0000 7feaac4f2640 1 -- 172.21.15.81:0/939716297 wait complete. 2024-09-21T06:45:32.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-09-21T06:45:32.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2024-09-21T06:45:32.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-21T06:45:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.511+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f745015c450 con 0x7f7450070e50 2024-09-21T06:45:32.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.512+0000 7f7437fff640 1 -- 172.21.15.81:0/3245413044 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f744006bc20 con 0x7f7450070e50 2024-09-21T06:45:32.515 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f743c078c90 msgr2=0x7f743c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f743c078c90 0x7f743c07b1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7448034000 tx=0x7f7448004ab0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7450070e50 msgr2=0x7f7450155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7450070e50 0x7f7450155a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f744000e7c0 tx=0x7f744000ec80 comp rx=0 tx=0).stop 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 shutdown_connections 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f743c078c90 0x7f743c07b1a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74500cdab0 0x7f74501f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f74500ad290 0x7f7450153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 --2- 172.21.15.81:0/3245413044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7450070e50 0x7f7450155a20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 >> 172.21.15.81:0/3245413044 conn(0x7f74500b2030 msgr2=0x7f74500b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 shutdown_connections 2024-09-21T06:45:32.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.514+0000 7f7435ffb640 1 -- 172.21.15.81:0/3245413044 wait complete. 2024-09-21T06:45:32.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2024-09-21T06:45:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.538+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f32f0005580 con 0x7f33100731e0 2024-09-21T06:45:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.538+0000 7f330d7fa640 1 -- 172.21.15.81:0/3281261752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3300067eb0 con 0x7f33100731e0 2024-09-21T06:45:32.541 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2024-09-21T06:45:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f32fc078c60 msgr2=0x7f32fc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f32fc078c60 0x7f32fc07b170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f331016ed30 tx=0x7f3308009040 comp rx=0 tx=0).stop 2024-09-21T06:45:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 msgr2=0x7f33100a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100a9490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f330000e740 tx=0x7f330000ec00 comp rx=0 tx=0).stop 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 shutdown_connections 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f32fc078c60 0x7f32fc07b170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f331016ed60 0x7f33102169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f331008b980 0x7f3310216130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 --2- 172.21.15.81:0/3281261752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33100731e0 0x7f33100a9490 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 >> 172.21.15.81:0/3281261752 conn(0x7f33100d02e0 msgr2=0x7f33100cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 shutdown_connections 2024-09-21T06:45:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.542+0000 7f32f6ffd640 1 -- 172.21.15.81:0/3281261752 wait complete. 2024-09-21T06:45:32.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2024-09-21T06:45:32.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.565+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f46640732f0 con 0x7f46641582b0 2024-09-21T06:45:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.566+0000 7f4659ffb640 1 -- 172.21.15.81:0/903915359 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46640cd420 con 0x7f46641582b0 2024-09-21T06:45:32.568 INFO:teuthology.orchestra.run.smithi081.stdout:64424509446 2024-09-21T06:45:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4648078d90 msgr2=0x7f464807b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4648078d90 0x7f464807b2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f465c004a30 tx=0x7f465c009040 comp rx=0 tx=0).stop 2024-09-21T06:45:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 msgr2=0x7f46641471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46641471a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f466000c390 tx=0x7f466000c850 comp rx=0 tx=0).stop 2024-09-21T06:45:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 shutdown_connections 2024-09-21T06:45:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4648078d90 0x7f464807b2a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46640744d0 0x7f466414a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46641582b0 0x7f46641471a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 --2- 172.21.15.81:0/903915359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466406dda0 0x7f466414aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 >> 172.21.15.81:0/903915359 conn(0x7f46640b1d00 msgr2=0x7f46640b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 shutdown_connections 2024-09-21T06:45:32.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.569+0000 7f466a07a640 1 -- 172.21.15.81:0/903915359 wait complete. 2024-09-21T06:45:32.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-21T06:45:32.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.637+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff8a4005580 con 0x7ff8c415b6a0 2024-09-21T06:45:32.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.638+0000 7ff8abfff640 1 -- 172.21.15.81:0/585328686 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8c40d1aa0 con 0x7ff8c415b6a0 2024-09-21T06:45:32.640 INFO:teuthology.orchestra.run.smithi081.stdout:60129542151 2024-09-21T06:45:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff8b0078c60 msgr2=0x7ff8b007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff8b0078c60 0x7ff8b007b170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4034000 tx=0x7ff8b4004730 comp rx=0 tx=0).stop 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 msgr2=0x7ff8c40cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c40cad60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00ca70 tx=0x7ff8bc00cf30 comp rx=0 tx=0).stop 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 shutdown_connections 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff8b0078c60 0x7ff8b007b170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8c415b6a0 0x7ff8c40cad60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8c40d1150 0x7ff8c40af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 --2- 172.21.15.81:0/585328686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8c40cdb90 0x7ff8c40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 >> 172.21.15.81:0/585328686 conn(0x7ff8c409aa30 msgr2=0x7ff8c40cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 shutdown_connections 2024-09-21T06:45:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:32.640+0000 7ff8a9ffb640 1 -- 172.21.15.81:0/585328686 wait complete. 2024-09-21T06:45:32.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2024-09-21T06:45:33.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T06:45:33.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T06:45:33.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T06:45:33.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T06:45:33.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T06:45:33.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T06:45:33.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T06:45:33.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T06:45:33.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.665+0000 7fa5689e6640 1 -- 172.21.15.81:0/4119460023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5640ce340 msgr2=0x7fa5640d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.665+0000 7fa5689e6640 1 --2- 172.21.15.81:0/4119460023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5640ce340 0x7fa5640d0230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5640c5960 tx=0x7fa55c02ac40 comp rx=0 tx=0).stop 2024-09-21T06:45:33.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.666+0000 7fa5689e6640 1 -- 172.21.15.81:0/4119460023 shutdown_connections 2024-09-21T06:45:33.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.666+0000 7fa5689e6640 1 --2- 172.21.15.81:0/4119460023 >> v2:172.21.15.89:3300/0 conn(0x7fa564072e70 0x7fa564073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.666+0000 7fa5689e6640 1 --2- 172.21.15.81:0/4119460023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5640ce340 0x7fa5640d0230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.666+0000 7fa5689e6640 1 -- 172.21.15.81:0/4119460023 >> 172.21.15.81:0/4119460023 conn(0x7fa5640d25e0 msgr2=0x7fa5640d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.666+0000 7fa5689e6640 1 -- 172.21.15.81:0/4119460023 shutdown_connections 2024-09-21T06:45:33.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.666+0000 7fa5689e6640 1 -- 172.21.15.81:0/4119460023 wait complete. 2024-09-21T06:45:33.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.669+0000 7fa5689e6640 1 Processor -- start 2024-09-21T06:45:33.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.670+0000 7fa5689e6640 1 -- start start 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa5689e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa564072e70 0x7fa5641f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa5689e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5640ce340 0x7fa5641495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa5689e6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5641622a0 0x7fa564160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa5689e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5640cc810 con 0x7fa564072e70 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa5689e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa5641630e0 con 0x7fa5640ce340 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa5689e6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa5640cc990 con 0x7fa5641622a0 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa562d9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5641622a0 0x7fa564160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.672+0000 7fa561d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5640ce340 0x7fa5641495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa561d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5640ce340 0x7fa5641495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58538/0 (socket says 172.21.15.81:58538) 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa561d9b640 1 -- 172.21.15.81:0/1940533681 learned_addr learned my addr 172.21.15.81:0/1940533681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa56259c640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa564072e70 0x7fa5641f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa56259c640 1 -- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5641622a0 msgr2=0x7fa564160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa56259c640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5641622a0 0x7fa564160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa56259c640 1 -- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5640ce340 msgr2=0x7fa5641495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa56259c640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5640ce340 0x7fa5641495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.673+0000 7fa56259c640 1 -- 172.21.15.81:0/1940533681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa564157050 con 0x7fa564072e70 2024-09-21T06:45:33.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.674+0000 7fa56259c640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa564072e70 0x7fa5641f9cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa564070000 tx=0x7fa55c004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.675+0000 7fa552ffd640 1 -- 172.21.15.81:0/1940533681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c038050 con 0x7fa564072e70 2024-09-21T06:45:33.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.675+0000 7fa552ffd640 1 -- 172.21.15.81:0/1940533681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa55c044070 con 0x7fa564072e70 2024-09-21T06:45:33.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.675+0000 7fa552ffd640 1 -- 172.21.15.81:0/1940533681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c03f6b0 con 0x7fa564072e70 2024-09-21T06:45:33.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.675+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5641575e0 con 0x7fa564072e70 2024-09-21T06:45:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.675+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa564157ba0 con 0x7fa564072e70 2024-09-21T06:45:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.678+0000 7fa550ff9640 1 -- 172.21.15.81:0/1940533681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa548005290 con 0x7fa564072e70 2024-09-21T06:45:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.688+0000 7fa552ffd640 1 -- 172.21.15.81:0/1940533681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa55c03f850 con 0x7fa564072e70 2024-09-21T06:45:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.689+0000 7fa552ffd640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa544078c90 0x7fa54407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.689+0000 7fa552ffd640 1 -- 172.21.15.81:0/1940533681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa55c0bcdb0 con 0x7fa564072e70 2024-09-21T06:45:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.690+0000 7fa561d9b640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa544078c90 0x7fa54407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.690+0000 7fa552ffd640 1 -- 172.21.15.81:0/1940533681 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa564157050 con 0x7fa564072e70 2024-09-21T06:45:33.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.695+0000 7fa561d9b640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa544078c90 0x7fa54407b1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa564161de0 tx=0x7fa5540090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.707+0000 7f634a0ce640 1 -- 172.21.15.81:0/1171643171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 msgr2=0x7f632c004cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.707+0000 7f634a0ce640 1 --2- 172.21.15.81:0/1171643171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f632c004cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6334001890 tx=0x7f632c005830 comp rx=0 tx=0).stop 2024-09-21T06:45:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7f634a0ce640 1 -- 172.21.15.81:0/1171643171 shutdown_connections 2024-09-21T06:45:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7f634a0ce640 1 --2- 172.21.15.81:0/1171643171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f632c004cb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7f634a0ce640 1 -- 172.21.15.81:0/1171643171 >> 172.21.15.81:0/1171643171 conn(0x7f63440b1c40 msgr2=0x7f63440b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7fd6f3fff640 1 -- 172.21.15.81:0/1042499995 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f802be60 con 0x7fd6e8003bc0 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7fd7024fc640 1 -- 172.21.15.81:0/1042499995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8003bc0 msgr2=0x7fd6e8003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7fd7024fc640 1 --2- 172.21.15.81:0/1042499995 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6e8003bc0 0x7fd6e8003ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8003fa0 tx=0x7fd6e8005830 comp rx=0 tx=0).stop 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7fd701cfb640 1 -- 172.21.15.81:0/1042499995 reap_dead start 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7fd7024fc640 1 -- 172.21.15.81:0/1042499995 shutdown_connections 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7fd7024fc640 1 -- 172.21.15.81:0/1042499995 >> 172.21.15.81:0/1042499995 conn(0x7fd6f401e230 msgr2=0x7fd6f4039ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7f634a0ce640 1 -- 172.21.15.81:0/1171643171 shutdown_connections 2024-09-21T06:45:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.709+0000 7f634a0ce640 1 -- 172.21.15.81:0/1171643171 wait complete. 2024-09-21T06:45:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.708+0000 7fd7024fc640 1 -- 172.21.15.81:0/1042499995 shutdown_connections 2024-09-21T06:45:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.709+0000 7fd7024fc640 1 -- 172.21.15.81:0/1042499995 wait complete. 2024-09-21T06:45:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.712+0000 7f634a0ce640 1 Processor -- start 2024-09-21T06:45:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.713+0000 7fd7024fc640 1 Processor -- start 2024-09-21T06:45:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.713+0000 7f634a0ce640 1 -- start start 2024-09-21T06:45:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.714+0000 7fd7024fc640 1 -- start start 2024-09-21T06:45:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7fd7024fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6e8003bc0 0x7fd6f404cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7fd7024fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f417e610 0x7fd6f40d3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7fd7024fc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6f4034650 0x7fd6f4034a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd7024fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4053c70 con 0x7fd6e8003bc0 2024-09-21T06:45:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd7024fc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f40e35b0 con 0x7fd6f417e610 2024-09-21T06:45:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd7024fc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f4053df0 con 0x7fd6f4034650 2024-09-21T06:45:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.715+0000 7f634a0ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f63440b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.715+0000 7f634a0ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63440c5890 0x7f6344143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.715+0000 7f63437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f63440b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.715+0000 7f63437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f63440b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58580/0 (socket says 172.21.15.81:58580) 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.715+0000 7f6342ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63440c5890 0x7f6344143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f6342ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63440c5890 0x7f6344143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54912/0 (socket says 172.21.15.81:54912) 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f63437fe640 1 -- 172.21.15.81:0/1928861702 learned_addr learned my addr 172.21.15.81:0/1928861702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f634a0ce640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441fa1a0 0x7f63441fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f634a0ce640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63440acf20 con 0x7f63440c5890 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f634a0ce640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6344070a90 con 0x7f632c004800 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f634a0ce640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f63440ad0a0 con 0x7f63441fa1a0 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f63437fe640 1 -- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441fa1a0 msgr2=0x7f63441fa5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f63437fe640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441fa1a0 0x7f63441fa5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f63437fe640 1 -- 172.21.15.81:0/1928861702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63440c5890 msgr2=0x7f6344143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f63437fe640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63440c5890 0x7f6344143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7f63437fe640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6344144280 con 0x7f632c004800 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f63437fe640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f63440b14c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f633c01ca70 tx=0x7f633c01cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/208853946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406e6a0 msgr2=0x7f6a0406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/208853946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406e6a0 0x7f6a0406eab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009830 tx=0x7f69f402a480 comp rx=0 tx=0).stop 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.715+0000 7ff58f7fe640 1 -- 172.21.15.81:0/304131500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588031c40 con 0x7ff5900b3910 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7ff596e84640 1 -- 172.21.15.81:0/304131500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 msgr2=0x7ff59006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.716+0000 7ff596e84640 1 --2- 172.21.15.81:0/304131500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 0x7ff59006faf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff5900ad870 tx=0x7ff58802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7ff596e84640 1 -- 172.21.15.81:0/304131500 shutdown_connections 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7ff596e84640 1 --2- 172.21.15.81:0/304131500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 0x7ff59006faf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7ff596e84640 1 --2- 172.21.15.81:0/304131500 >> v2:172.21.15.89:3300/0 conn(0x7ff590162990 0x7ff5900b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7ff596e84640 1 -- 172.21.15.81:0/304131500 >> 172.21.15.81:0/304131500 conn(0x7ff5900d0840 msgr2=0x7ff5900d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd700cf9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f417e610 0x7fd6f40d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd701cfb640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6f4034650 0x7fd6f4034a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd7014fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6e8003bc0 0x7fd6f404cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd700cf9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f417e610 0x7fd6f40d3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58594/0 (socket says 172.21.15.81:58594) 2024-09-21T06:45:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd700cf9640 1 -- 172.21.15.81:0/2312117470 learned_addr learned my addr 172.21.15.81:0/2312117470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/208853946 shutdown_connections 2024-09-21T06:45:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/208853946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a0406f400 0x7f6a040af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/208853946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406e6a0 0x7f6a0406eab0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009830 tx=0x7f69f402a480 comp rx=0 tx=0).stop 2024-09-21T06:45:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/208853946 >> 172.21.15.81:0/208853946 conn(0x7f6a040740a0 msgr2=0x7f6a040b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd700cf9640 1 -- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6f4034650 msgr2=0x7fd6f4034a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7fd700cf9640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6f4034650 0x7fd6f4034a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd700cf9640 1 -- 172.21.15.81:0/2312117470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6e8003bc0 msgr2=0x7fd6f404cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd700cf9640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6e8003bc0 0x7fd6f404cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f632bfff640 1 -- 172.21.15.81:0/1928861702 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c02a070 con 0x7f632c004800 2024-09-21T06:45:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f632bfff640 1 -- 172.21.15.81:0/1928861702 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f633c01dc90 con 0x7f632c004800 2024-09-21T06:45:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.717+0000 7f634a0ce640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63440b0a00 con 0x7f632c004800 2024-09-21T06:45:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7f634a0ce640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63440c5520 con 0x7f632c004800 2024-09-21T06:45:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd700cf9640 1 -- 172.21.15.81:0/2312117470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f404ee50 con 0x7fd6f417e610 2024-09-21T06:45:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7f632bfff640 1 -- 172.21.15.81:0/1928861702 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c0256a0 con 0x7f632c004800 2024-09-21T06:45:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.719+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/208853946 shutdown_connections 2024-09-21T06:45:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7ff596e84640 1 -- 172.21.15.81:0/304131500 shutdown_connections 2024-09-21T06:45:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd700cf9640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f417e610 0x7fd6f40d3530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec003f50 tx=0x7fd6ec0018c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd6f1ffb640 1 -- 172.21.15.81:0/2312117470 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec011700 con 0x7fd6f417e610 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd6f1ffb640 1 -- 172.21.15.81:0/2312117470 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6ec016020 con 0x7fd6f417e610 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f404c2b0 con 0x7fd6f417e610 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd6f1ffb640 1 -- 172.21.15.81:0/2312117470 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec011b60 con 0x7fd6f417e610 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f4035120 con 0x7fd6f417e610 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.720+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f40d3a70 con 0x7fd6f417e610 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.718+0000 7ff596e84640 1 -- 172.21.15.81:0/304131500 wait complete. 2024-09-21T06:45:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.720+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/208853946 wait complete. 2024-09-21T06:45:33.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.721+0000 7ff596e84640 1 Processor -- start 2024-09-21T06:45:33.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.721+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63440ad5b0 con 0x7f632c004800 2024-09-21T06:45:33.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.721+0000 7ff596e84640 1 -- start start 2024-09-21T06:45:33.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.721+0000 7f632bfff640 1 -- 172.21.15.81:0/1928861702 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f633c02d070 con 0x7f632c004800 2024-09-21T06:45:33.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.722+0000 7f632bfff640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6330078be0 0x7f633007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.723+0000 7fd6f1ffb640 1 -- 172.21.15.81:0/2312117470 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd6ec011d00 con 0x7fd6f417e610 2024-09-21T06:45:33.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.722+0000 7f632bfff640 1 -- 172.21.15.81:0/1928861702 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f633c0abd10 con 0x7f632c004800 2024-09-21T06:45:33.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.723+0000 7f6a0a1a8640 1 Processor -- start 2024-09-21T06:45:33.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7f6a0a1a8640 1 -- start start 2024-09-21T06:45:33.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7fd6f1ffb640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd6e0078bc0 0x7fd6e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7ff596e84640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff59006d1a0 0x7ff5901f9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7fd6f1ffb640 1 -- 172.21.15.81:0/2312117470 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd6ec09c340 con 0x7fd6f417e610 2024-09-21T06:45:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7ff596e84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 0x7ff590157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7fd7014fa640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd6e0078bc0 0x7fd6e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7ff594c20640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff59006d1a0 0x7ff5901f9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7ff594c20640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff59006d1a0 0x7ff5901f9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39594/0 (socket says 172.21.15.81:39594) 2024-09-21T06:45:33.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7ff58ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 0x7ff590157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff58ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 0x7ff590157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54936/0 (socket says 172.21.15.81:54936) 2024-09-21T06:45:33.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff594c20640 1 -- 172.21.15.81:0/3202124749 learned_addr learned my addr 172.21.15.81:0/3202124749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.723+0000 7f6342ffd640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6330078be0 0x7f633007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.724+0000 7f6342ffd640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6330078be0 0x7f633007b0f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6334032000 tx=0x7f63340012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff596e84640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff59015ea10 0x7ff59015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7fd7014fa640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd6e0078bc0 0x7fd6e007b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001b70 tx=0x7fd6f802d070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff590070030 con 0x7ff5900b3910 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff5900b4840 con 0x7ff59015ea10 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff5900701b0 con 0x7ff59006d1a0 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff595421640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff59015ea10 0x7ff59015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff595421640 1 -- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff59006d1a0 msgr2=0x7ff5901f9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff595421640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff59006d1a0 0x7ff5901f9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff595421640 1 -- 172.21.15.81:0/3202124749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 msgr2=0x7ff590157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff595421640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 0x7ff590157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.725+0000 7ff595421640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59015f360 con 0x7ff59015ea10 2024-09-21T06:45:33.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7ff594c20640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff59006d1a0 0x7ff5901f9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:33.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7ff595421640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff59015ea10 0x7ff59015ee20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff59006b050 tx=0x7ff588003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7fd6f1ffb640 1 -- 172.21.15.81:0/2312117470 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd6f40d3a70 con 0x7fd6f417e610 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a0a1a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0406eff0 0x7f6a040b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a0a1a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406f400 0x7f6a040b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a0a1a8640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a040b2ca0 0x7f6a0409c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a0a1a8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a040af700 con 0x7f6a0406f400 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a0a1a8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0409ac40 con 0x7f6a0406eff0 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a0a1a8640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040af880 con 0x7f6a040b2ca0 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406f400 0x7f6a040b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0406eff0 0x7f6a040b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.726+0000 7f6a037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0406eff0 0x7f6a040b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58610/0 (socket says 172.21.15.81:58610) 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a037fe640 1 -- 172.21.15.81:0/1246742168 learned_addr learned my addr 172.21.15.81:0/1246742168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406f400 0x7f6a040b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54944/0 (socket says 172.21.15.81:54944) 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a03fff640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a040b2ca0 0x7f6a0409c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a037fe640 1 -- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a040b2ca0 msgr2=0x7f6a0409c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a037fe640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a040b2ca0 0x7f6a0409c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a037fe640 1 -- 172.21.15.81:0/1246742168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406f400 msgr2=0x7f6a040b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a037fe640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406f400 0x7f6a040b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a037fe640 1 -- 172.21.15.81:0/1246742168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040b1a90 con 0x7f6a0406eff0 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a02ffd640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406f400 0x7f6a040b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.727+0000 7f6a037fe640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0406eff0 0x7f6a040b3350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69f402a9f0 tx=0x7f69f40045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.730+0000 7f69ebfff640 1 -- 172.21.15.81:0/1246742168 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4003a80 con 0x7f6a0406eff0 2024-09-21T06:45:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.730+0000 7ff58d7fa640 1 -- 172.21.15.81:0/3202124749 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588031db0 con 0x7ff59015ea10 2024-09-21T06:45:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7f69ebfff640 1 -- 172.21.15.81:0/1246742168 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69f4003d10 con 0x7f6a0406eff0 2024-09-21T06:45:33.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7f632bfff640 1 -- 172.21.15.81:0/1928861702 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f633c0b1020 con 0x7f632c004800 2024-09-21T06:45:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a040b1d70 con 0x7f6a0406eff0 2024-09-21T06:45:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a04147b50 con 0x7f6a0406eff0 2024-09-21T06:45:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7ff58d7fa640 1 -- 172.21.15.81:0/3202124749 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5880330d0 con 0x7ff59015ea10 2024-09-21T06:45:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7ff58d7fa640 1 -- 172.21.15.81:0/3202124749 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588033520 con 0x7ff59015ea10 2024-09-21T06:45:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5900add30 con 0x7ff59015ea10 2024-09-21T06:45:33.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5900ae2f0 con 0x7ff59015ea10 2024-09-21T06:45:33.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.731+0000 7f69ebfff640 1 -- 172.21.15.81:0/1246742168 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4005280 con 0x7f6a0406eff0 2024-09-21T06:45:33.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.732+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59006fe50 con 0x7ff59015ea10 2024-09-21T06:45:33.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.735+0000 7ff58d7fa640 1 -- 172.21.15.81:0/3202124749 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5880336c0 con 0x7ff59015ea10 2024-09-21T06:45:33.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.736+0000 7f69ebfff640 1 -- 172.21.15.81:0/1246742168 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69f4043030 con 0x7f6a0406eff0 2024-09-21T06:45:33.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.736+0000 7ff58d7fa640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff57c078bc0 0x7ff57c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.736+0000 7ff58d7fa640 1 -- 172.21.15.81:0/3202124749 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff5880bbfc0 con 0x7ff59015ea10 2024-09-21T06:45:33.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.737+0000 7ff594c20640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff57c078bc0 0x7ff57c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.737+0000 7f69ebfff640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f69f0078b90 0x7f69f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.737+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e4005290 con 0x7f6a0406eff0 2024-09-21T06:45:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.737+0000 7ff594c20640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff57c078bc0 0x7ff57c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff580001bd0 tx=0x7ff580007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.738+0000 7f6a02ffd640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f69f0078b90 0x7f69f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.738+0000 7f69ebfff640 1 -- 172.21.15.81:0/1246742168 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f69f40bc2e0 con 0x7f6a0406eff0 2024-09-21T06:45:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.738+0000 7f6a02ffd640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f69f0078b90 0x7f69f007b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a04158080 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.739+0000 7ff58d7fa640 1 -- 172.21.15.81:0/3202124749 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff59006fe50 con 0x7ff59015ea10 2024-09-21T06:45:33.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.745+0000 7f69ebfff640 1 -- 172.21.15.81:0/1246742168 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f69f4083e10 con 0x7f6a0406eff0 2024-09-21T06:45:33.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f29e7562640 1 -- 172.21.15.81:0/2062506182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e00ae640 msgr2=0x7f29e015b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f29e7562640 1 --2- 172.21.15.81:0/2062506182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e00ae640 0x7f29e015b930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f29dc005fd0 tx=0x7f29dc032ae0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 -- 172.21.15.81:0/1278497860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c06e270 msgr2=0x7f176c070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 --2- 172.21.15.81:0/1278497860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c06e270 0x7f176c070d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1764005fd0 tx=0x7f176402aaa0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f29e7562640 1 -- 172.21.15.81:0/2062506182 shutdown_connections 2024-09-21T06:45:33.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f29e7562640 1 --2- 172.21.15.81:0/2062506182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e00ae640 0x7f29e015b930 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f29dc005fd0 tx=0x7f29dc032ae0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f29e7562640 1 -- 172.21.15.81:0/2062506182 >> 172.21.15.81:0/2062506182 conn(0x7f29e00d1150 msgr2=0x7f29e00d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 -- 172.21.15.81:0/1278497860 shutdown_connections 2024-09-21T06:45:33.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 --2- 172.21.15.81:0/1278497860 >> v2:172.21.15.81:3300/0 conn(0x7f176c15eec0 0x7f176c06cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 --2- 172.21.15.81:0/1278497860 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c06e270 0x7f176c070d60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 -- 172.21.15.81:0/1278497860 >> 172.21.15.81:0/1278497860 conn(0x7f176c0d0840 msgr2=0x7f176c0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 -- 172.21.15.81:0/1278497860 shutdown_connections 2024-09-21T06:45:33.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.778+0000 7f29e7562640 1 -- 172.21.15.81:0/2062506182 shutdown_connections 2024-09-21T06:45:33.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.777+0000 7f1773d90640 1 -- 172.21.15.81:0/1278497860 wait complete. 2024-09-21T06:45:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.780+0000 7f1773d90640 1 Processor -- start 2024-09-21T06:45:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.778+0000 7f29e7562640 1 -- 172.21.15.81:0/2062506182 wait complete. 2024-09-21T06:45:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.781+0000 7f29e7562640 1 Processor -- start 2024-09-21T06:45:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.781+0000 7f1773d90640 1 -- start start 2024-09-21T06:45:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.783+0000 7f1773d90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c06e270 0x7f176c202d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.781+0000 7f29e7562640 1 -- start start 2024-09-21T06:45:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.783+0000 7f1773d90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f176c0b4940 0x7f176c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.783+0000 7f29e7562640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e006f280 0x7f29e009d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.783+0000 7f29e7562640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e0155a20 0x7f29e00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f29e52fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e006f280 0x7f29e009d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f29e52fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e006f280 0x7f29e009d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39618/0 (socket says 172.21.15.81:39618) 2024-09-21T06:45:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f177132b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f176c0b4940 0x7f176c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f29e7562640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e0202b20 0x7f29e0202f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f177132b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f176c0b4940 0x7f176c0b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54960/0 (socket says 172.21.15.81:54960) 2024-09-21T06:45:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f1771b2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c06e270 0x7f176c202d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f1771b2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c06e270 0x7f176c202d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58622/0 (socket says 172.21.15.81:58622) 2024-09-21T06:45:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f177132b640 1 -- 172.21.15.81:0/4074482050 learned_addr learned my addr 172.21.15.81:0/4074482050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f1773d90640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c15eec0 0x7f176c1f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f29e5aff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e0202b20 0x7f29e0202f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f176c0b50e0 con 0x7f176c0b4940 2024-09-21T06:45:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f176c0b4f60 con 0x7f176c06e270 2024-09-21T06:45:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f176c071440 con 0x7f176c15eec0 2024-09-21T06:45:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f29e5aff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e0202b20 0x7f29e0202f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54970/0 (socket says 172.21.15.81:54970) 2024-09-21T06:45:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f29e4afd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e0155a20 0x7f29e00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.784+0000 7f29e4afd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e0155a20 0x7f29e00cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:58628/0 (socket says 172.21.15.81:58628) 2024-09-21T06:45:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e7562640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00b5b20 con 0x7f29e0202b20 2024-09-21T06:45:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e7562640 1 -- 172.21.15.81:0/1386685829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f29e00b59a0 con 0x7f29e0155a20 2024-09-21T06:45:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f177232d640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c15eec0 0x7f176c1f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e52fe640 1 -- 172.21.15.81:0/1386685829 learned_addr learned my addr 172.21.15.81:0/1386685829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e7562640 1 -- 172.21.15.81:0/1386685829 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f29e00b5ca0 con 0x7f29e006f280 2024-09-21T06:45:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f177232d640 1 -- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c06e270 msgr2=0x7f176c202d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f177232d640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c06e270 0x7f176c202d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f177232d640 1 -- 172.21.15.81:0/4074482050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f176c0b4940 msgr2=0x7f176c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f177232d640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f176c0b4940 0x7f176c0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f177232d640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c15d280 con 0x7f176c15eec0 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e5aff640 1 -- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e006f280 msgr2=0x7f29e009d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e5aff640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e006f280 0x7f29e009d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e5aff640 1 -- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e0155a20 msgr2=0x7f29e00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e5aff640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e0155a20 0x7f29e00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.785+0000 7f29e5aff640 1 -- 172.21.15.81:0/1386685829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0206960 con 0x7f29e0202b20 2024-09-21T06:45:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.786+0000 7f29e52fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e006f280 0x7f29e009d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.786+0000 7f177232d640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c15eec0 0x7f176c1f8870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f175c00d610 tx=0x7f175c00dad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.786+0000 7f177132b640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f176c0b4940 0x7f176c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.786+0000 7f1771b2c640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c06e270 0x7f176c202d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f17627fc640 1 -- 172.21.15.81:0/4074482050 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c004230 con 0x7f176c15eec0 2024-09-21T06:45:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c15b130 con 0x7f176c15eec0 2024-09-21T06:45:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c15b6f0 con 0x7f176c15eec0 2024-09-21T06:45:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f17627fc640 1 -- 172.21.15.81:0/4074482050 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f175c0044c0 con 0x7f176c15eec0 2024-09-21T06:45:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f17627fc640 1 -- 172.21.15.81:0/4074482050 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c005280 con 0x7f176c15eec0 2024-09-21T06:45:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.786+0000 7f29e5aff640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e0202b20 0x7f29e0202f30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c7f0 tx=0x7f29d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.786+0000 7f29e4afd640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e0155a20 0x7f29e00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f29d5ffb640 1 -- 172.21.15.81:0/1386685829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8003b70 con 0x7f29e0202b20 2024-09-21T06:45:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f29d5ffb640 1 -- 172.21.15.81:0/1386685829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29d8003d10 con 0x7f29e0202b20 2024-09-21T06:45:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f29d5ffb640 1 -- 172.21.15.81:0/1386685829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8005330 con 0x7f29e0202b20 2024-09-21T06:45:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.787+0000 7f29e7562640 1 -- 172.21.15.81:0/1386685829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e02060c0 con 0x7f29e0202b20 2024-09-21T06:45:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.788+0000 7f29e7562640 1 -- 172.21.15.81:0/1386685829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e0206680 con 0x7f29e0202b20 2024-09-21T06:45:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.791+0000 7f17627fc640 1 -- 172.21.15.81:0/4074482050 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f175c005440 con 0x7f176c15eec0 2024-09-21T06:45:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.791+0000 7f29d5ffb640 1 -- 172.21.15.81:0/1386685829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29d80054d0 con 0x7f29e0202b20 2024-09-21T06:45:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.792+0000 7f17627fc640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1750078c60 0x7f175007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.792+0000 7f17627fc640 1 -- 172.21.15.81:0/4074482050 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f175c09b370 con 0x7f176c15eec0 2024-09-21T06:45:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.792+0000 7f29d5ffb640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f29c4078c60 0x7f29c407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.792+0000 7f29d5ffb640 1 -- 172.21.15.81:0/1386685829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f29d809a950 con 0x7f29e0202b20 2024-09-21T06:45:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.792+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1754005290 con 0x7f176c15eec0 2024-09-21T06:45:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.792+0000 7f29e52fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f29c4078c60 0x7f29c407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.793+0000 7f1771b2c640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1750078c60 0x7f175007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.793+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e0205e30 con 0x7f29e0202b20 2024-09-21T06:45:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.793+0000 7f29e52fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f29c4078c60 0x7f29c407b170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006fd0 tx=0x7f29d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.795+0000 7f1771b2c640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1750078c60 0x7f175007b170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1764035000 tx=0x7f1764004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.798+0000 7f17627fc640 1 -- 172.21.15.81:0/4074482050 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f175c020020 con 0x7f176c15eec0 2024-09-21T06:45:33.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.802+0000 7f29d5ffb640 1 -- 172.21.15.81:0/1386685829 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f29d8020060 con 0x7f29e0202b20 2024-09-21T06:45:33.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 -- 172.21.15.81:0/2482027679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec0adb70 msgr2=0x7f09ec0b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 --2- 172.21.15.81:0/2482027679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec0adb70 0x7f09ec0b30f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f09e4005fd0 tx=0x7f09e402aa50 comp rx=0 tx=0).stop 2024-09-21T06:45:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 -- 172.21.15.81:0/2482027679 shutdown_connections 2024-09-21T06:45:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 --2- 172.21.15.81:0/2482027679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec0adb70 0x7f09ec0b30f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 --2- 172.21.15.81:0/2482027679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0ad630 0x7f09ec070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 -- 172.21.15.81:0/2482027679 >> 172.21.15.81:0/2482027679 conn(0x7f09ec0b1c40 msgr2=0x7f09ec0b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 -- 172.21.15.81:0/2482027679 shutdown_connections 2024-09-21T06:45:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.857+0000 7f09f4415640 1 -- 172.21.15.81:0/2482027679 wait complete. 2024-09-21T06:45:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.861+0000 7f09f4415640 1 Processor -- start 2024-09-21T06:45:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.861+0000 7f09f4415640 1 -- start start 2024-09-21T06:45:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.863+0000 7f09f4415640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09ec0adb70 0x7f09ec144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.863+0000 7f09f4415640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0cfcc0 0x7f09ec145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.863+0000 7f09f4415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec1610a0 0x7f09ec1614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.864+0000 7f09f19b0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0cfcc0 0x7f09ec145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.864+0000 7f09f19b0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0cfcc0 0x7f09ec145d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39642/0 (socket says 172.21.15.81:39642) 2024-09-21T06:45:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.864+0000 7f09f19b0640 1 -- 172.21.15.81:0/1618570622 learned_addr learned my addr 172.21.15.81:0/1618570622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:33.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.864+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec0b3c60 con 0x7f09ec1610a0 2024-09-21T06:45:33.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.864+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec0b3ae0 con 0x7f09ec0adb70 2024-09-21T06:45:33.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.864+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f09ec0b3de0 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f29b2640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec1610a0 0x7f09ec1614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f19b0640 1 -- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09ec0adb70 msgr2=0x7f09ec144570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:45:33.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f19b0640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09ec0adb70 0x7f09ec144570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f19b0640 1 -- 172.21.15.81:0/1618570622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec1610a0 msgr2=0x7f09ec1614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f19b0640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec1610a0 0x7f09ec1614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f19b0640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec206140 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f29b2640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec1610a0 0x7f09ec1614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.865+0000 7f09f19b0640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0cfcc0 0x7f09ec145d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e710 tx=0x7f09e800ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.866+0000 7f09e2ffd640 1 -- 172.21.15.81:0/1618570622 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e800cab0 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.866+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec146290 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.866+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec205b80 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.866+0000 7f09e2ffd640 1 -- 172.21.15.81:0/1618570622 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09e800cd40 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.866+0000 7f09e2ffd640 1 -- 172.21.15.81:0/1618570622 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8010670 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.869+0000 7f09e2ffd640 1 -- 172.21.15.81:0/1618570622 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09e8010810 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.870+0000 7f09e2ffd640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f09d0078c90 0x7f09d007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.871+0000 7f09f21b1640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f09d0078c90 0x7f09d007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.871+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d4005290 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.871+0000 7f09e2ffd640 1 -- 172.21.15.81:0/1618570622 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f09e809bb50 con 0x7f09ec0cfcc0 2024-09-21T06:45:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.871+0000 7f09f21b1640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f09d0078c90 0x7f09d007b1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0014e0 tx=0x7f09dc007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:33.876+0000 7f09e2ffd640 1 -- 172.21.15.81:0/1618570622 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f09e8063c30 con 0x7f09ec0cfcc0 2024-09-21T06:45:34.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.118+0000 7fa550ff9640 1 -- 172.21.15.81:0/1940533681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa548005580 con 0x7fa564072e70 2024-09-21T06:45:34.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.119+0000 7fa552ffd640 1 -- 172.21.15.81:0/1940533681 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa55c0098b0 con 0x7fa564072e70 2024-09-21T06:45:34.121 INFO:teuthology.orchestra.run.smithi081.stdout:64424509449 2024-09-21T06:45:34.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.123+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa544078c90 msgr2=0x7fa54407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.123+0000 7fa5689e6640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa544078c90 0x7fa54407b1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa564161de0 tx=0x7fa5540090e0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.123+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa564072e70 msgr2=0x7fa5641f9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.123+0000 7fa5689e6640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa564072e70 0x7fa5641f9cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa564070000 tx=0x7fa55c004660 comp rx=0 tx=0).stop 2024-09-21T06:45:34.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 shutdown_connections 2024-09-21T06:45:34.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa544078c90 0x7fa54407b1a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5641622a0 0x7fa564160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5640ce340 0x7fa5641495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 --2- 172.21.15.81:0/1940533681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa564072e70 0x7fa5641f9cd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 >> 172.21.15.81:0/1940533681 conn(0x7fa5640d25e0 msgr2=0x7fa5640b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 shutdown_connections 2024-09-21T06:45:34.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.124+0000 7fa5689e6640 1 -- 172.21.15.81:0/1940533681 wait complete. 2024-09-21T06:45:34.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-21T06:45:34.143 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.141+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f69e4005580 con 0x7f6a0406eff0 2024-09-21T06:45:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.142+0000 7f69ebfff640 1 -- 172.21.15.81:0/1246742168 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f69f4088840 con 0x7f6a0406eff0 2024-09-21T06:45:34.144 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2024-09-21T06:45:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.144+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd6f4051be0 con 0x7fd6f417e610 2024-09-21T06:45:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.145+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff59006faf0 con 0x7ff59015ea10 2024-09-21T06:45:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.145+0000 7fd6f1ffb640 1 -- 172.21.15.81:0/2312117470 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd6ec020020 con 0x7fd6f417e610 2024-09-21T06:45:34.147 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2024-09-21T06:45:34.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7ff58d7fa640 1 -- 172.21.15.81:0/3202124749 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff58804a070 con 0x7ff59015ea10 2024-09-21T06:45:34.148 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f69f0078b90 msgr2=0x7f69f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f69f0078b90 0x7f69f007b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a04158080 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0406eff0 msgr2=0x7f6a040b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0406eff0 0x7f6a040b3350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69f402a9f0 tx=0x7f69f40045e0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 shutdown_connections 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f69f0078b90 0x7f69f007b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a040b2ca0 0x7f6a0409c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a0406f400 0x7f6a040b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 --2- 172.21.15.81:0/1246742168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a0406eff0 0x7f6a040b3350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 >> 172.21.15.81:0/1246742168 conn(0x7f6a040740a0 msgr2=0x7f6a0415be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 shutdown_connections 2024-09-21T06:45:34.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.146+0000 7f6a0a1a8640 1 -- 172.21.15.81:0/1246742168 wait complete. 2024-09-21T06:45:34.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd6e0078bc0 msgr2=0x7fd6e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd6e0078bc0 0x7fd6e007b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001b70 tx=0x7fd6f802d070 comp rx=0 tx=0).stop 2024-09-21T06:45:34.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f417e610 msgr2=0x7fd6f40d3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f417e610 0x7fd6f40d3530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec003f50 tx=0x7fd6ec0018c0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 shutdown_connections 2024-09-21T06:45:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd6e0078bc0 0x7fd6e007b0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd6f4034650 0x7fd6f4034a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f417e610 0x7fd6f40d3530 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 --2- 172.21.15.81:0/2312117470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6e8003bc0 0x7fd6f404cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 >> 172.21.15.81:0/2312117470 conn(0x7fd6f401e230 msgr2=0x7fd6f40e1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 shutdown_connections 2024-09-21T06:45:34.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.148+0000 7fd7024fc640 1 -- 172.21.15.81:0/2312117470 wait complete. 2024-09-21T06:45:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff57c078bc0 msgr2=0x7ff57c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff57c078bc0 0x7ff57c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff580001bd0 tx=0x7ff580007f50 comp rx=0 tx=0).stop 2024-09-21T06:45:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff59015ea10 msgr2=0x7ff59015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff59015ea10 0x7ff59015ee20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff59006b050 tx=0x7ff588003c20 comp rx=0 tx=0).stop 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 shutdown_connections 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff57c078bc0 0x7ff57c07b0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff59015ea10 0x7ff59015ee20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5900b3910 0x7ff590157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 --2- 172.21.15.81:0/3202124749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff59006d1a0 0x7ff5901f9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 >> 172.21.15.81:0/3202124749 conn(0x7ff5900d0840 msgr2=0x7ff590160ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 shutdown_connections 2024-09-21T06:45:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.149+0000 7ff596e84640 1 -- 172.21.15.81:0/3202124749 wait complete. 2024-09-21T06:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.152+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f63440b2050 con 0x7f632c004800 2024-09-21T06:45:34.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.152+0000 7f632bfff640 1 -- 172.21.15.81:0/1928861702 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6344144280 con 0x7f632c004800 2024-09-21T06:45:34.154 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-21T06:45:34.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6330078be0 msgr2=0x7f633007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6330078be0 0x7f633007b0f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6334032000 tx=0x7f63340012e0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 msgr2=0x7f63440b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f63440b14c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f633c01ca70 tx=0x7f633c01cf30 comp rx=0 tx=0).stop 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 shutdown_connections 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6330078be0 0x7f633007b0f0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6334032000 tx=0x7f63340012e0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441fa1a0 0x7f63441fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63440c5890 0x7f6344143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 --2- 172.21.15.81:0/1928861702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c004800 0x7f63440b14c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.156+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 >> 172.21.15.81:0/1928861702 conn(0x7f63440b1c40 msgr2=0x7f6344145c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.157+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 shutdown_connections 2024-09-21T06:45:34.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.157+0000 7f6329ffb640 1 -- 172.21.15.81:0/1928861702 wait complete. 2024-09-21T06:45:34.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2024-09-21T06:45:34.169 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2024-09-21T06:45:34.170 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-21T06:45:34.171 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-21T06:45:34.178 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.181+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1754005580 con 0x7f176c15eec0 2024-09-21T06:45:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.181+0000 7f17627fc640 1 -- 172.21.15.81:0/4074482050 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f175c017030 con 0x7f176c15eec0 2024-09-21T06:45:34.183 INFO:teuthology.orchestra.run.smithi081.stdout:60129542153 2024-09-21T06:45:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1750078c60 msgr2=0x7f175007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1750078c60 0x7f175007b170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1764035000 tx=0x7f1764004ab0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c15eec0 msgr2=0x7f176c1f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c15eec0 0x7f176c1f8870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f175c00d610 tx=0x7f175c00dad0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 shutdown_connections 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1750078c60 0x7f175007b170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f176c15eec0 0x7f176c1f8870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f176c0b4940 0x7f176c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 --2- 172.21.15.81:0/4074482050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f176c06e270 0x7f176c202d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 >> 172.21.15.81:0/4074482050 conn(0x7f176c0d0840 msgr2=0x7f176c0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 shutdown_connections 2024-09-21T06:45:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.183+0000 7f1773d90640 1 -- 172.21.15.81:0/4074482050 wait complete. 2024-09-21T06:45:34.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.192+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f29e015b930 con 0x7f29e0202b20 2024-09-21T06:45:34.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.193+0000 7f29d5ffb640 1 -- 172.21.15.81:0/1386685829 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29d8062b50 con 0x7f29e0202b20 2024-09-21T06:45:34.195 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-21T06:45:34.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2024-09-21T06:45:34.197 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f29c4078c60 msgr2=0x7f29c407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f29c4078c60 0x7f29c407b170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006fd0 tx=0x7f29d0008040 comp rx=0 tx=0).stop 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e0202b20 msgr2=0x7f29e0202f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e0202b20 0x7f29e0202f30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c7f0 tx=0x7f29d800ccb0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 shutdown_connections 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f29c4078c60 0x7f29c407b170 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e0202b20 0x7f29e0202f30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29e0155a20 0x7f29e00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 --2- 172.21.15.81:0/1386685829 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29e006f280 0x7f29e009d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 >> 172.21.15.81:0/1386685829 conn(0x7f29e00d1150 msgr2=0x7f29e0154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 shutdown_connections 2024-09-21T06:45:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.195+0000 7f29c37fe640 1 -- 172.21.15.81:0/1386685829 wait complete. 2024-09-21T06:45:34.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-21T06:45:34.208 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.221+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f09d4005580 con 0x7f09ec0cfcc0 2024-09-21T06:45:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.221+0000 7f09e2ffd640 1 -- 172.21.15.81:0/1618570622 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f09e8063530 con 0x7f09ec0cfcc0 2024-09-21T06:45:34.223 INFO:teuthology.orchestra.run.smithi081.stdout:60129542152 2024-09-21T06:45:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f09d0078c90 msgr2=0x7f09d007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f09d0078c90 0x7f09d007b1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0014e0 tx=0x7f09dc007970 comp rx=0 tx=0).stop 2024-09-21T06:45:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0cfcc0 msgr2=0x7f09ec145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0cfcc0 0x7f09ec145d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09e800e710 tx=0x7f09e800ebd0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 shutdown_connections 2024-09-21T06:45:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f09d0078c90 0x7f09d007b1a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09ec0cfcc0 0x7f09ec145d50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09ec1610a0 0x7f09ec1614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 --2- 172.21.15.81:0/1618570622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09ec0adb70 0x7f09ec144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 >> 172.21.15.81:0/1618570622 conn(0x7f09ec0b1c40 msgr2=0x7f09ec0b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 shutdown_connections 2024-09-21T06:45:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.224+0000 7f09f4415640 1 -- 172.21.15.81:0/1618570622 wait complete. 2024-09-21T06:45:34.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2024-09-21T06:45:34.236 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:34.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:45:34.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:45:34.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 -- 172.21.15.81:0/1352108901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c0d41a0 msgr2=0x7f7b1c0d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 --2- 172.21.15.81:0/1352108901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c0d41a0 0x7f7b1c0d45b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b14005fd0 tx=0x7f7b1402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 -- 172.21.15.81:0/1352108901 shutdown_connections 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 --2- 172.21.15.81:0/1352108901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c0d41a0 0x7f7b1c0d45b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 --2- 172.21.15.81:0/1352108901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b1c15c450 0x7f7b1c0d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 -- 172.21.15.81:0/1352108901 >> 172.21.15.81:0/1352108901 conn(0x7f7b1c0b7330 msgr2=0x7f7b1c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 -- 172.21.15.81:0/1352108901 shutdown_connections 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.387+0000 7f7b225a1640 1 -- 172.21.15.81:0/1352108901 wait complete. 2024-09-21T06:45:34.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.389+0000 7f7b225a1640 1 Processor -- start 2024-09-21T06:45:34.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.389+0000 7f7b225a1640 1 -- start start 2024-09-21T06:45:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b225a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b1c0d41a0 0x7f7b1c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b225a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c15c450 0x7f7b1c1f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b225a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b1c15eda0 0x7f7b1c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b225a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0b35c0 con 0x7f7b1c15c450 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b225a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0b3440 con 0x7f7b1c0d41a0 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b225a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c0b3740 con 0x7f7b1c15eda0 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c15c450 0x7f7b1c1f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c15c450 0x7f7b1c1f6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55014/0 (socket says 172.21.15.81:55014) 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b1b7fe640 1 -- 172.21.15.81:0/434517603 learned_addr learned my addr 172.21.15.81:0/434517603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b20b3e640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b1c15eda0 0x7f7b1c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.390+0000 7f7b1bfff640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b1c0d41a0 0x7f7b1c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b1b7fe640 1 -- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b1c15eda0 msgr2=0x7f7b1c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b1b7fe640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b1c15eda0 0x7f7b1c0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b1b7fe640 1 -- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b1c0d41a0 msgr2=0x7f7b1c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b1b7fe640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b1c0d41a0 0x7f7b1c06d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b1b7fe640 1 -- 172.21.15.81:0/434517603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c06db20 con 0x7f7b1c15c450 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b1b7fe640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c15c450 0x7f7b1c1f6f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c3d0 tx=0x7f7b1000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b18ff9640 1 -- 172.21.15.81:0/434517603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011790 con 0x7f7b1c15c450 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b18ff9640 1 -- 172.21.15.81:0/434517603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b10017070 con 0x7f7b1c15c450 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c0c9090 con 0x7f7b1c15c450 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b18ff9640 1 -- 172.21.15.81:0/434517603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10011cc0 con 0x7f7b1c15c450 2024-09-21T06:45:34.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.391+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c0c9610 con 0x7f7b1c15c450 2024-09-21T06:45:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.392+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c08d110 con 0x7f7b1c15c450 2024-09-21T06:45:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.393+0000 7f7b18ff9640 1 -- 172.21.15.81:0/434517603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b1001c460 con 0x7f7b1c15c450 2024-09-21T06:45:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.393+0000 7f7b18ff9640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7b08078bc0 0x7f7b0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.393+0000 7f7b18ff9640 1 -- 172.21.15.81:0/434517603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7b1009ad60 con 0x7f7b1c15c450 2024-09-21T06:45:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.393+0000 7f7b1bfff640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7b08078bc0 0x7f7b0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.394+0000 7f7b1bfff640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7b08078bc0 0x7f7b0807b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c08c9c0 tx=0x7f7b0c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:34.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.398+0000 7f7b18ff9640 1 -- 172.21.15.81:0/434517603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7b1c08d110 con 0x7f7b1c15c450 2024-09-21T06:45:34.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.574+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b1c0d45b0 con 0x7f7b08078bc0 2024-09-21T06:45:34.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.581+0000 7f7b18ff9640 1 -- 172.21.15.81:0/434517603 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f7b1c0d45b0 con 0x7f7b08078bc0 2024-09-21T06:45:34.586 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7b08078bc0 msgr2=0x7f7b0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7b08078bc0 0x7f7b0807b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c08c9c0 tx=0x7f7b0c00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c15c450 msgr2=0x7f7b1c1f6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c15c450 0x7f7b1c1f6f80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c3d0 tx=0x7f7b1000c890 comp rx=0 tx=0).stop 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 shutdown_connections 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7b08078bc0 0x7f7b0807b0d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b1c15eda0 0x7f7b1c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b1c15c450 0x7f7b1c1f6f80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 --2- 172.21.15.81:0/434517603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b1c0d41a0 0x7f7b1c06d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.584+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 >> 172.21.15.81:0/434517603 conn(0x7f7b1c0b7330 msgr2=0x7f7b1c0d2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.585+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 shutdown_connections 2024-09-21T06:45:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.585+0000 7f7b225a1640 1 -- 172.21.15.81:0/434517603 wait complete. 2024-09-21T06:45:34.598 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-21T06:45:32.655224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2042240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003074"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508468+0000","last_change":"2024-09-21T06:45:14.464339+0000","last_active":"2024-09-21T06:45:20.508468+0000","last_peered":"2024-09-21T06:45:20.508468+0000","last_clean":"2024-09-21T06:45:20.508468+0000","last_became_active":"2024-09-21T06:45:14.464012+0000","last_became_peered":"2024-09-21T06:45:14.464012+0000","last_unstale":"2024-09-21T06:45:20.508468+0000","last_undegraded":"2024-09-21T06:45:20.508468+0000","last_fullsized":"2024-09-21T06:45:20.508468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:36.925765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032175+0000","last_change":"2024-09-21T06:45:15.471510+0000","last_active":"2024-09-21T06:45:21.032175+0000","last_peered":"2024-09-21T06:45:21.032175+0000","last_clean":"2024-09-21T06:45:21.032175+0000","last_became_active":"2024-09-21T06:45:15.471143+0000","last_became_peered":"2024-09-21T06:45:15.471143+0000","last_unstale":"2024-09-21T06:45:21.032175+0000","last_undegraded":"2024-09-21T06:45:21.032175+0000","last_fullsized":"2024-09-21T06:45:21.032175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030689+0000","last_change":"2024-09-21T06:45:19.508650+0000","last_active":"2024-09-21T06:45:21.030689+0000","last_peered":"2024-09-21T06:45:21.030689+0000","last_clean":"2024-09-21T06:45:21.030689+0000","last_became_active":"2024-09-21T06:45:19.508068+0000","last_became_peered":"2024-09-21T06:45:19.508068+0000","last_unstale":"2024-09-21T06:45:21.030689+0000","last_undegraded":"2024-09-21T06:45:21.030689+0000","last_fullsized":"2024-09-21T06:45:21.030689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:00.812495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032318+0000","last_change":"2024-09-21T06:45:14.463510+0000","last_active":"2024-09-21T06:45:21.032318+0000","last_peered":"2024-09-21T06:45:21.032318+0000","last_clean":"2024-09-21T06:45:21.032318+0000","last_became_active":"2024-09-21T06:45:14.462560+0000","last_became_peered":"2024-09-21T06:45:14.462560+0000","last_unstale":"2024-09-21T06:45:21.032318+0000","last_undegraded":"2024-09-21T06:45:21.032318+0000","last_fullsized":"2024-09-21T06:45:21.032318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032076+0000","last_change":"2024-09-21T06:45:15.469206+0000","last_active":"2024-09-21T06:45:21.032076+0000","last_peered":"2024-09-21T06:45:21.032076+0000","last_clean":"2024-09-21T06:45:21.032076+0000","last_became_active":"2024-09-21T06:45:15.468852+0000","last_became_peered":"2024-09-21T06:45:15.468852+0000","last_unstale":"2024-09-21T06:45:21.032076+0000","last_undegraded":"2024-09-21T06:45:21.032076+0000","last_fullsized":"2024-09-21T06:45:21.032076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:53.718982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.029911+0000","last_change":"2024-09-21T06:45:19.499958+0000","last_active":"2024-09-21T06:45:21.029911+0000","last_peered":"2024-09-21T06:45:21.029911+0000","last_clean":"2024-09-21T06:45:21.029911+0000","last_became_active":"2024-09-21T06:45:19.498778+0000","last_became_peered":"2024-09-21T06:45:19.498778+0000","last_unstale":"2024-09-21T06:45:21.029911+0000","last_undegraded":"2024-09-21T06:45:21.029911+0000","last_fullsized":"2024-09-21T06:45:21.029911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:30.663232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031112+0000","last_change":"2024-09-21T06:45:14.467815+0000","last_active":"2024-09-21T06:45:21.031112+0000","last_peered":"2024-09-21T06:45:21.031112+0000","last_clean":"2024-09-21T06:45:21.031112+0000","last_became_active":"2024-09-21T06:45:14.467402+0000","last_became_peered":"2024-09-21T06:45:14.467402+0000","last_unstale":"2024-09-21T06:45:21.031112+0000","last_undegraded":"2024-09-21T06:45:21.031112+0000","last_fullsized":"2024-09-21T06:45:21.031112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032375+0000","last_change":"2024-09-21T06:45:15.472639+0000","last_active":"2024-09-21T06:45:21.032375+0000","last_peered":"2024-09-21T06:45:21.032375+0000","last_clean":"2024-09-21T06:45:21.032375+0000","last_became_active":"2024-09-21T06:45:15.472020+0000","last_became_peered":"2024-09-21T06:45:15.472020+0000","last_unstale":"2024-09-21T06:45:21.032375+0000","last_undegraded":"2024-09-21T06:45:21.032375+0000","last_fullsized":"2024-09-21T06:45:21.032375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031061+0000","last_change":"2024-09-21T06:45:19.506108+0000","last_active":"2024-09-21T06:45:21.031061+0000","last_peered":"2024-09-21T06:45:21.031061+0000","last_clean":"2024-09-21T06:45:21.031061+0000","last_became_active":"2024-09-21T06:45:19.505693+0000","last_became_peered":"2024-09-21T06:45:19.505693+0000","last_unstale":"2024-09-21T06:45:21.031061+0000","last_undegraded":"2024-09-21T06:45:21.031061+0000","last_fullsized":"2024-09-21T06:45:21.031061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:04.498857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031623+0000","last_change":"2024-09-21T06:45:14.468290+0000","last_active":"2024-09-21T06:45:21.031623+0000","last_peered":"2024-09-21T06:45:21.031623+0000","last_clean":"2024-09-21T06:45:21.031623+0000","last_became_active":"2024-09-21T06:45:14.466952+0000","last_became_peered":"2024-09-21T06:45:14.466952+0000","last_unstale":"2024-09-21T06:45:21.031623+0000","last_undegraded":"2024-09-21T06:45:21.031623+0000","last_fullsized":"2024-09-21T06:45:21.031623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506797+0000","last_change":"2024-09-21T06:45:15.478969+0000","last_active":"2024-09-21T06:45:20.506797+0000","last_peered":"2024-09-21T06:45:20.506797+0000","last_clean":"2024-09-21T06:45:20.506797+0000","last_became_active":"2024-09-21T06:45:15.478560+0000","last_became_peered":"2024-09-21T06:45:15.478560+0000","last_unstale":"2024-09-21T06:45:20.506797+0000","last_undegraded":"2024-09-21T06:45:20.506797+0000","last_fullsized":"2024-09-21T06:45:20.506797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030140+0000","last_change":"2024-09-21T06:45:19.501225+0000","last_active":"2024-09-21T06:45:21.030140+0000","last_peered":"2024-09-21T06:45:21.030140+0000","last_clean":"2024-09-21T06:45:21.030140+0000","last_became_active":"2024-09-21T06:45:19.500690+0000","last_became_peered":"2024-09-21T06:45:19.500690+0000","last_unstale":"2024-09-21T06:45:21.030140+0000","last_undegraded":"2024-09-21T06:45:21.030140+0000","last_fullsized":"2024-09-21T06:45:21.030140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:19.848228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506286+0000","last_change":"2024-09-21T06:45:15.464877+0000","last_active":"2024-09-21T06:45:20.506286+0000","last_peered":"2024-09-21T06:45:20.506286+0000","last_clean":"2024-09-21T06:45:20.506286+0000","last_became_active":"2024-09-21T06:45:15.464588+0000","last_became_peered":"2024-09-21T06:45:15.464588+0000","last_unstale":"2024-09-21T06:45:20.506286+0000","last_undegraded":"2024-09-21T06:45:20.506286+0000","last_fullsized":"2024-09-21T06:45:20.506286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:42.134939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506529+0000","last_change":"2024-09-21T06:45:14.467476+0000","last_active":"2024-09-21T06:45:20.506529+0000","last_peered":"2024-09-21T06:45:20.506529+0000","last_clean":"2024-09-21T06:45:20.506529+0000","last_became_active":"2024-09-21T06:45:14.466897+0000","last_became_peered":"2024-09-21T06:45:14.466897+0000","last_unstale":"2024-09-21T06:45:20.506529+0000","last_undegraded":"2024-09-21T06:45:20.506529+0000","last_fullsized":"2024-09-21T06:45:20.506529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:10.023372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506859+0000","last_change":"2024-09-21T06:45:19.498544+0000","last_active":"2024-09-21T06:45:20.506859+0000","last_peered":"2024-09-21T06:45:20.506859+0000","last_clean":"2024-09-21T06:45:20.506859+0000","last_became_active":"2024-09-21T06:45:19.497658+0000","last_became_peered":"2024-09-21T06:45:19.497658+0000","last_unstale":"2024-09-21T06:45:20.506859+0000","last_undegraded":"2024-09-21T06:45:20.506859+0000","last_fullsized":"2024-09-21T06:45:20.506859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:52.803324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031062+0000","last_change":"2024-09-21T06:45:15.468182+0000","last_active":"2024-09-21T06:45:21.031062+0000","last_peered":"2024-09-21T06:45:21.031062+0000","last_clean":"2024-09-21T06:45:21.031062+0000","last_became_active":"2024-09-21T06:45:15.467824+0000","last_became_peered":"2024-09-21T06:45:15.467824+0000","last_unstale":"2024-09-21T06:45:21.031062+0000","last_undegraded":"2024-09-21T06:45:21.031062+0000","last_fullsized":"2024-09-21T06:45:21.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508135+0000","last_change":"2024-09-21T06:45:14.466757+0000","last_active":"2024-09-21T06:45:20.508135+0000","last_peered":"2024-09-21T06:45:20.508135+0000","last_clean":"2024-09-21T06:45:20.508135+0000","last_became_active":"2024-09-21T06:45:14.466415+0000","last_became_peered":"2024-09-21T06:45:14.466415+0000","last_unstale":"2024-09-21T06:45:20.508135+0000","last_undegraded":"2024-09-21T06:45:20.508135+0000","last_fullsized":"2024-09-21T06:45:20.508135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:07.383477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031176+0000","last_change":"2024-09-21T06:45:19.499423+0000","last_active":"2024-09-21T06:45:21.031176+0000","last_peered":"2024-09-21T06:45:21.031176+0000","last_clean":"2024-09-21T06:45:21.031176+0000","last_became_active":"2024-09-21T06:45:19.498952+0000","last_became_peered":"2024-09-21T06:45:19.498952+0000","last_unstale":"2024-09-21T06:45:21.031176+0000","last_undegraded":"2024-09-21T06:45:21.031176+0000","last_fullsized":"2024-09-21T06:45:21.031176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508529+0000","last_change":"2024-09-21T06:45:15.466008+0000","last_active":"2024-09-21T06:45:20.508529+0000","last_peered":"2024-09-21T06:45:20.508529+0000","last_clean":"2024-09-21T06:45:20.508529+0000","last_became_active":"2024-09-21T06:45:15.465647+0000","last_became_peered":"2024-09-21T06:45:15.465647+0000","last_unstale":"2024-09-21T06:45:20.508529+0000","last_undegraded":"2024-09-21T06:45:20.508529+0000","last_fullsized":"2024-09-21T06:45:20.508529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:31.085363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507731+0000","last_change":"2024-09-21T06:45:14.469576+0000","last_active":"2024-09-21T06:45:20.507731+0000","last_peered":"2024-09-21T06:45:20.507731+0000","last_clean":"2024-09-21T06:45:20.507731+0000","last_became_active":"2024-09-21T06:45:14.469236+0000","last_became_peered":"2024-09-21T06:45:14.469236+0000","last_unstale":"2024-09-21T06:45:20.507731+0000","last_undegraded":"2024-09-21T06:45:20.507731+0000","last_fullsized":"2024-09-21T06:45:20.507731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:02.696088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032184+0000","last_change":"2024-09-21T06:45:19.510297+0000","last_active":"2024-09-21T06:45:21.032184+0000","last_peered":"2024-09-21T06:45:21.032184+0000","last_clean":"2024-09-21T06:45:21.032184+0000","last_became_active":"2024-09-21T06:45:19.509889+0000","last_became_peered":"2024-09-21T06:45:19.509889+0000","last_unstale":"2024-09-21T06:45:21.032184+0000","last_undegraded":"2024-09-21T06:45:21.032184+0000","last_fullsized":"2024-09-21T06:45:21.032184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:59.748038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506005+0000","last_change":"2024-09-21T06:45:15.464901+0000","last_active":"2024-09-21T06:45:20.506005+0000","last_peered":"2024-09-21T06:45:20.506005+0000","last_clean":"2024-09-21T06:45:20.506005+0000","last_became_active":"2024-09-21T06:45:15.464616+0000","last_became_peered":"2024-09-21T06:45:15.464616+0000","last_unstale":"2024-09-21T06:45:20.506005+0000","last_undegraded":"2024-09-21T06:45:20.506005+0000","last_fullsized":"2024-09-21T06:45:20.506005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030008+0000","last_change":"2024-09-21T06:45:14.469791+0000","last_active":"2024-09-21T06:45:21.030008+0000","last_peered":"2024-09-21T06:45:21.030008+0000","last_clean":"2024-09-21T06:45:21.030008+0000","last_became_active":"2024-09-21T06:45:14.469113+0000","last_became_peered":"2024-09-21T06:45:14.469113+0000","last_unstale":"2024-09-21T06:45:21.030008+0000","last_undegraded":"2024-09-21T06:45:21.030008+0000","last_fullsized":"2024-09-21T06:45:21.030008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030884+0000","last_change":"2024-09-21T06:45:19.503593+0000","last_active":"2024-09-21T06:45:21.030884+0000","last_peered":"2024-09-21T06:45:21.030884+0000","last_clean":"2024-09-21T06:45:21.030884+0000","last_became_active":"2024-09-21T06:45:19.503150+0000","last_became_peered":"2024-09-21T06:45:19.503150+0000","last_unstale":"2024-09-21T06:45:21.030884+0000","last_undegraded":"2024-09-21T06:45:21.030884+0000","last_fullsized":"2024-09-21T06:45:21.030884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.348456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507905+0000","last_change":"2024-09-21T06:45:15.464731+0000","last_active":"2024-09-21T06:45:20.507905+0000","last_peered":"2024-09-21T06:45:20.507905+0000","last_clean":"2024-09-21T06:45:20.507905+0000","last_became_active":"2024-09-21T06:45:15.464397+0000","last_became_peered":"2024-09-21T06:45:15.464397+0000","last_unstale":"2024-09-21T06:45:20.507905+0000","last_undegraded":"2024-09-21T06:45:20.507905+0000","last_fullsized":"2024-09-21T06:45:20.507905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:24.268833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507028+0000","last_change":"2024-09-21T06:45:14.463206+0000","last_active":"2024-09-21T06:45:20.507028+0000","last_peered":"2024-09-21T06:45:20.507028+0000","last_clean":"2024-09-21T06:45:20.507028+0000","last_became_active":"2024-09-21T06:45:14.462858+0000","last_became_peered":"2024-09-21T06:45:14.462858+0000","last_unstale":"2024-09-21T06:45:20.507028+0000","last_undegraded":"2024-09-21T06:45:20.507028+0000","last_fullsized":"2024-09-21T06:45:20.507028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:09.685089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030880+0000","last_change":"2024-09-21T06:45:19.504734+0000","last_active":"2024-09-21T06:45:21.030880+0000","last_peered":"2024-09-21T06:45:21.030880+0000","last_clean":"2024-09-21T06:45:21.030880+0000","last_became_active":"2024-09-21T06:45:19.504280+0000","last_became_peered":"2024-09-21T06:45:19.504280+0000","last_unstale":"2024-09-21T06:45:21.030880+0000","last_undegraded":"2024-09-21T06:45:21.030880+0000","last_fullsized":"2024-09-21T06:45:21.030880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:29.145421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508777+0000","last_change":"2024-09-21T06:45:15.470507+0000","last_active":"2024-09-21T06:45:20.508777+0000","last_peered":"2024-09-21T06:45:20.508777+0000","last_clean":"2024-09-21T06:45:20.508777+0000","last_became_active":"2024-09-21T06:45:15.470151+0000","last_became_peered":"2024-09-21T06:45:15.470151+0000","last_unstale":"2024-09-21T06:45:20.508777+0000","last_undegraded":"2024-09-21T06:45:20.508777+0000","last_fullsized":"2024-09-21T06:45:20.508777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:23.908138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508277+0000","last_change":"2024-09-21T06:45:14.463895+0000","last_active":"2024-09-21T06:45:20.508277+0000","last_peered":"2024-09-21T06:45:20.508277+0000","last_clean":"2024-09-21T06:45:20.508277+0000","last_became_active":"2024-09-21T06:45:14.463553+0000","last_became_peered":"2024-09-21T06:45:14.463553+0000","last_unstale":"2024-09-21T06:45:20.508277+0000","last_undegraded":"2024-09-21T06:45:20.508277+0000","last_fullsized":"2024-09-21T06:45:20.508277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:18.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508458+0000","last_change":"2024-09-21T06:45:19.501027+0000","last_active":"2024-09-21T06:45:20.508458+0000","last_peered":"2024-09-21T06:45:20.508458+0000","last_clean":"2024-09-21T06:45:20.508458+0000","last_became_active":"2024-09-21T06:45:19.500456+0000","last_became_peered":"2024-09-21T06:45:19.500456+0000","last_unstale":"2024-09-21T06:45:20.508458+0000","last_undegraded":"2024-09-21T06:45:20.508458+0000","last_fullsized":"2024-09-21T06:45:20.508458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:24.217258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509016+0000","last_change":"2024-09-21T06:45:15.475607+0000","last_active":"2024-09-21T06:45:20.509016+0000","last_peered":"2024-09-21T06:45:20.509016+0000","last_clean":"2024-09-21T06:45:20.509016+0000","last_became_active":"2024-09-21T06:45:15.475256+0000","last_became_peered":"2024-09-21T06:45:15.475256+0000","last_unstale":"2024-09-21T06:45:20.509016+0000","last_undegraded":"2024-09-21T06:45:20.509016+0000","last_fullsized":"2024-09-21T06:45:20.509016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:18.300400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507126+0000","last_change":"2024-09-21T06:45:14.463043+0000","last_active":"2024-09-21T06:45:20.507126+0000","last_peered":"2024-09-21T06:45:20.507126+0000","last_clean":"2024-09-21T06:45:20.507126+0000","last_became_active":"2024-09-21T06:45:14.462253+0000","last_became_peered":"2024-09-21T06:45:14.462253+0000","last_unstale":"2024-09-21T06:45:20.507126+0000","last_undegraded":"2024-09-21T06:45:20.507126+0000","last_fullsized":"2024-09-21T06:45:20.507126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508325+0000","last_change":"2024-09-21T06:45:19.499431+0000","last_active":"2024-09-21T06:45:20.508325+0000","last_peered":"2024-09-21T06:45:20.508325+0000","last_clean":"2024-09-21T06:45:20.508325+0000","last_became_active":"2024-09-21T06:45:19.498990+0000","last_became_peered":"2024-09-21T06:45:19.498990+0000","last_unstale":"2024-09-21T06:45:20.508325+0000","last_undegraded":"2024-09-21T06:45:20.508325+0000","last_fullsized":"2024-09-21T06:45:20.508325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:22.135690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030357+0000","last_change":"2024-09-21T06:45:15.476862+0000","last_active":"2024-09-21T06:45:21.030357+0000","last_peered":"2024-09-21T06:45:21.030357+0000","last_clean":"2024-09-21T06:45:21.030357+0000","last_became_active":"2024-09-21T06:45:15.476545+0000","last_became_peered":"2024-09-21T06:45:15.476545+0000","last_unstale":"2024-09-21T06:45:21.030357+0000","last_undegraded":"2024-09-21T06:45:21.030357+0000","last_fullsized":"2024-09-21T06:45:21.030357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031479+0000","last_change":"2024-09-21T06:45:14.465001+0000","last_active":"2024-09-21T06:45:21.031479+0000","last_peered":"2024-09-21T06:45:21.031479+0000","last_clean":"2024-09-21T06:45:21.031479+0000","last_became_active":"2024-09-21T06:45:14.463300+0000","last_became_peered":"2024-09-21T06:45:14.463300+0000","last_unstale":"2024-09-21T06:45:21.031479+0000","last_undegraded":"2024-09-21T06:45:21.031479+0000","last_fullsized":"2024-09-21T06:45:21.031479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508546+0000","last_change":"2024-09-21T06:45:19.504273+0000","last_active":"2024-09-21T06:45:20.508546+0000","last_peered":"2024-09-21T06:45:20.508546+0000","last_clean":"2024-09-21T06:45:20.508546+0000","last_became_active":"2024-09-21T06:45:19.503505+0000","last_became_peered":"2024-09-21T06:45:19.503505+0000","last_unstale":"2024-09-21T06:45:20.508546+0000","last_undegraded":"2024-09-21T06:45:20.508546+0000","last_fullsized":"2024-09-21T06:45:20.508546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:17.053992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030362+0000","last_change":"2024-09-21T06:45:15.478404+0000","last_active":"2024-09-21T06:45:21.030362+0000","last_peered":"2024-09-21T06:45:21.030362+0000","last_clean":"2024-09-21T06:45:21.030362+0000","last_became_active":"2024-09-21T06:45:15.478121+0000","last_became_peered":"2024-09-21T06:45:15.478121+0000","last_unstale":"2024-09-21T06:45:21.030362+0000","last_undegraded":"2024-09-21T06:45:21.030362+0000","last_fullsized":"2024-09-21T06:45:21.030362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506726+0000","last_change":"2024-09-21T06:45:14.465807+0000","last_active":"2024-09-21T06:45:20.506726+0000","last_peered":"2024-09-21T06:45:20.506726+0000","last_clean":"2024-09-21T06:45:20.506726+0000","last_became_active":"2024-09-21T06:45:14.464509+0000","last_became_peered":"2024-09-21T06:45:14.464509+0000","last_unstale":"2024-09-21T06:45:20.506726+0000","last_undegraded":"2024-09-21T06:45:20.506726+0000","last_fullsized":"2024-09-21T06:45:20.506726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508935+0000","last_change":"2024-09-21T06:45:19.504015+0000","last_active":"2024-09-21T06:45:20.508935+0000","last_peered":"2024-09-21T06:45:20.508935+0000","last_clean":"2024-09-21T06:45:20.508935+0000","last_became_active":"2024-09-21T06:45:19.503577+0000","last_became_peered":"2024-09-21T06:45:19.503577+0000","last_unstale":"2024-09-21T06:45:20.508935+0000","last_undegraded":"2024-09-21T06:45:20.508935+0000","last_fullsized":"2024-09-21T06:45:20.508935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030571+0000","last_change":"2024-09-21T06:45:15.474182+0000","last_active":"2024-09-21T06:45:21.030571+0000","last_peered":"2024-09-21T06:45:21.030571+0000","last_clean":"2024-09-21T06:45:21.030571+0000","last_became_active":"2024-09-21T06:45:15.473818+0000","last_became_peered":"2024-09-21T06:45:15.473818+0000","last_unstale":"2024-09-21T06:45:21.030571+0000","last_undegraded":"2024-09-21T06:45:21.030571+0000","last_fullsized":"2024-09-21T06:45:21.030571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030836+0000","last_change":"2024-09-21T06:45:14.469718+0000","last_active":"2024-09-21T06:45:21.030836+0000","last_peered":"2024-09-21T06:45:21.030836+0000","last_clean":"2024-09-21T06:45:21.030836+0000","last_became_active":"2024-09-21T06:45:14.469379+0000","last_became_peered":"2024-09-21T06:45:14.469379+0000","last_unstale":"2024-09-21T06:45:21.030836+0000","last_undegraded":"2024-09-21T06:45:21.030836+0000","last_fullsized":"2024-09-21T06:45:21.030836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507427+0000","last_change":"2024-09-21T06:45:19.496958+0000","last_active":"2024-09-21T06:45:20.507427+0000","last_peered":"2024-09-21T06:45:20.507427+0000","last_clean":"2024-09-21T06:45:20.507427+0000","last_became_active":"2024-09-21T06:45:19.496555+0000","last_became_peered":"2024-09-21T06:45:19.496555+0000","last_unstale":"2024-09-21T06:45:20.507427+0000","last_undegraded":"2024-09-21T06:45:20.507427+0000","last_fullsized":"2024-09-21T06:45:20.507427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:44.406905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506844+0000","last_change":"2024-09-21T06:45:15.472140+0000","last_active":"2024-09-21T06:45:20.506844+0000","last_peered":"2024-09-21T06:45:20.506844+0000","last_clean":"2024-09-21T06:45:20.506844+0000","last_became_active":"2024-09-21T06:45:15.471806+0000","last_became_peered":"2024-09-21T06:45:15.471806+0000","last_unstale":"2024-09-21T06:45:20.506844+0000","last_undegraded":"2024-09-21T06:45:20.506844+0000","last_fullsized":"2024-09-21T06:45:20.506844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:23.439120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506380+0000","last_change":"2024-09-21T06:45:14.469896+0000","last_active":"2024-09-21T06:45:20.506380+0000","last_peered":"2024-09-21T06:45:20.506380+0000","last_clean":"2024-09-21T06:45:20.506380+0000","last_became_active":"2024-09-21T06:45:14.469577+0000","last_became_peered":"2024-09-21T06:45:14.469577+0000","last_unstale":"2024-09-21T06:45:20.506380+0000","last_undegraded":"2024-09-21T06:45:20.506380+0000","last_fullsized":"2024-09-21T06:45:20.506380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031840+0000","last_change":"2024-09-21T06:45:19.500636+0000","last_active":"2024-09-21T06:45:21.031840+0000","last_peered":"2024-09-21T06:45:21.031840+0000","last_clean":"2024-09-21T06:45:21.031840+0000","last_became_active":"2024-09-21T06:45:19.500192+0000","last_became_peered":"2024-09-21T06:45:19.500192+0000","last_unstale":"2024-09-21T06:45:21.031840+0000","last_undegraded":"2024-09-21T06:45:21.031840+0000","last_fullsized":"2024-09-21T06:45:21.031840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.980314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507558+0000","last_change":"2024-09-21T06:45:15.472278+0000","last_active":"2024-09-21T06:45:20.507558+0000","last_peered":"2024-09-21T06:45:20.507558+0000","last_clean":"2024-09-21T06:45:20.507558+0000","last_became_active":"2024-09-21T06:45:15.471284+0000","last_became_peered":"2024-09-21T06:45:15.471284+0000","last_unstale":"2024-09-21T06:45:20.507558+0000","last_undegraded":"2024-09-21T06:45:20.507558+0000","last_fullsized":"2024-09-21T06:45:20.507558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:55.552947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506692+0000","last_change":"2024-09-21T06:45:14.467169+0000","last_active":"2024-09-21T06:45:20.506692+0000","last_peered":"2024-09-21T06:45:20.506692+0000","last_clean":"2024-09-21T06:45:20.506692+0000","last_became_active":"2024-09-21T06:45:14.466525+0000","last_became_peered":"2024-09-21T06:45:14.466525+0000","last_unstale":"2024-09-21T06:45:20.506692+0000","last_undegraded":"2024-09-21T06:45:20.506692+0000","last_fullsized":"2024-09-21T06:45:20.506692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:45.167373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032068+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:45:21.032068+0000","last_peered":"2024-09-21T06:45:21.032068+0000","last_clean":"2024-09-21T06:45:21.032068+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:45:21.032068+0000","last_undegraded":"2024-09-21T06:45:21.032068+0000","last_fullsized":"2024-09-21T06:45:21.032068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507129+0000","last_change":"2024-09-21T06:45:19.497733+0000","last_active":"2024-09-21T06:45:20.507129+0000","last_peered":"2024-09-21T06:45:20.507129+0000","last_clean":"2024-09-21T06:45:20.507129+0000","last_became_active":"2024-09-21T06:45:19.496641+0000","last_became_peered":"2024-09-21T06:45:19.496641+0000","last_unstale":"2024-09-21T06:45:20.507129+0000","last_undegraded":"2024-09-21T06:45:20.507129+0000","last_fullsized":"2024-09-21T06:45:20.507129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:51.619714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506921+0000","last_change":"2024-09-21T06:45:15.461030+0000","last_active":"2024-09-21T06:45:20.506921+0000","last_peered":"2024-09-21T06:45:20.506921+0000","last_clean":"2024-09-21T06:45:20.506921+0000","last_became_active":"2024-09-21T06:45:15.460706+0000","last_became_peered":"2024-09-21T06:45:15.460706+0000","last_unstale":"2024-09-21T06:45:20.506921+0000","last_undegraded":"2024-09-21T06:45:20.506921+0000","last_fullsized":"2024-09-21T06:45:20.506921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.152926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509104+0000","last_change":"2024-09-21T06:45:14.461396+0000","last_active":"2024-09-21T06:45:20.509104+0000","last_peered":"2024-09-21T06:45:20.509104+0000","last_clean":"2024-09-21T06:45:20.509104+0000","last_became_active":"2024-09-21T06:45:14.461060+0000","last_became_peered":"2024-09-21T06:45:14.461060+0000","last_unstale":"2024-09-21T06:45:20.509104+0000","last_undegraded":"2024-09-21T06:45:20.509104+0000","last_fullsized":"2024-09-21T06:45:20.509104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:55.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030371+0000","last_change":"2024-09-21T06:45:19.502382+0000","last_active":"2024-09-21T06:45:21.030371+0000","last_peered":"2024-09-21T06:45:21.030371+0000","last_clean":"2024-09-21T06:45:21.030371+0000","last_became_active":"2024-09-21T06:45:19.498046+0000","last_became_peered":"2024-09-21T06:45:19.498046+0000","last_unstale":"2024-09-21T06:45:21.030371+0000","last_undegraded":"2024-09-21T06:45:21.030371+0000","last_fullsized":"2024-09-21T06:45:21.030371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:24.671126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031519+0000","last_change":"2024-09-21T06:45:15.475752+0000","last_active":"2024-09-21T06:45:21.031519+0000","last_peered":"2024-09-21T06:45:21.031519+0000","last_clean":"2024-09-21T06:45:21.031519+0000","last_became_active":"2024-09-21T06:45:15.469527+0000","last_became_peered":"2024-09-21T06:45:15.469527+0000","last_unstale":"2024-09-21T06:45:21.031519+0000","last_undegraded":"2024-09-21T06:45:21.031519+0000","last_fullsized":"2024-09-21T06:45:21.031519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031784+0000","last_change":"2024-09-21T06:45:14.465420+0000","last_active":"2024-09-21T06:45:21.031784+0000","last_peered":"2024-09-21T06:45:21.031784+0000","last_clean":"2024-09-21T06:45:21.031784+0000","last_became_active":"2024-09-21T06:45:14.464543+0000","last_became_peered":"2024-09-21T06:45:14.464543+0000","last_unstale":"2024-09-21T06:45:21.031784+0000","last_undegraded":"2024-09-21T06:45:21.031784+0000","last_fullsized":"2024-09-21T06:45:21.031784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031628+0000","last_change":"2024-09-21T06:45:19.498221+0000","last_active":"2024-09-21T06:45:21.031628+0000","last_peered":"2024-09-21T06:45:21.031628+0000","last_clean":"2024-09-21T06:45:21.031628+0000","last_became_active":"2024-09-21T06:45:19.497811+0000","last_became_peered":"2024-09-21T06:45:19.497811+0000","last_unstale":"2024-09-21T06:45:21.031628+0000","last_undegraded":"2024-09-21T06:45:21.031628+0000","last_fullsized":"2024-09-21T06:45:21.031628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030455+0000","last_change":"2024-09-21T06:45:15.460768+0000","last_active":"2024-09-21T06:45:21.030455+0000","last_peered":"2024-09-21T06:45:21.030455+0000","last_clean":"2024-09-21T06:45:21.030455+0000","last_became_active":"2024-09-21T06:45:15.460450+0000","last_became_peered":"2024-09-21T06:45:15.460450+0000","last_unstale":"2024-09-21T06:45:21.030455+0000","last_undegraded":"2024-09-21T06:45:21.030455+0000","last_fullsized":"2024-09-21T06:45:21.030455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508036+0000","last_change":"2024-09-21T06:45:14.470579+0000","last_active":"2024-09-21T06:45:20.508036+0000","last_peered":"2024-09-21T06:45:20.508036+0000","last_clean":"2024-09-21T06:45:20.508036+0000","last_became_active":"2024-09-21T06:45:14.470201+0000","last_became_peered":"2024-09-21T06:45:14.470201+0000","last_unstale":"2024-09-21T06:45:20.508036+0000","last_undegraded":"2024-09-21T06:45:20.508036+0000","last_fullsized":"2024-09-21T06:45:20.508036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.320663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505901+0000","last_change":"2024-09-21T06:45:19.495223+0000","last_active":"2024-09-21T06:45:20.505901+0000","last_peered":"2024-09-21T06:45:20.505901+0000","last_clean":"2024-09-21T06:45:20.505901+0000","last_became_active":"2024-09-21T06:45:19.494717+0000","last_became_peered":"2024-09-21T06:45:19.494717+0000","last_unstale":"2024-09-21T06:45:20.505901+0000","last_undegraded":"2024-09-21T06:45:20.505901+0000","last_fullsized":"2024-09-21T06:45:20.505901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:24.234212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031148+0000","last_change":"2024-09-21T06:45:15.470009+0000","last_active":"2024-09-21T06:45:21.031148+0000","last_peered":"2024-09-21T06:45:21.031148+0000","last_clean":"2024-09-21T06:45:21.031148+0000","last_became_active":"2024-09-21T06:45:15.469587+0000","last_became_peered":"2024-09-21T06:45:15.469587+0000","last_unstale":"2024-09-21T06:45:21.031148+0000","last_undegraded":"2024-09-21T06:45:21.031148+0000","last_fullsized":"2024-09-21T06:45:21.031148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030553+0000","last_change":"2024-09-21T06:45:14.462600+0000","last_active":"2024-09-21T06:45:21.030553+0000","last_peered":"2024-09-21T06:45:21.030553+0000","last_clean":"2024-09-21T06:45:21.030553+0000","last_became_active":"2024-09-21T06:45:14.461889+0000","last_became_peered":"2024-09-21T06:45:14.461889+0000","last_unstale":"2024-09-21T06:45:21.030553+0000","last_undegraded":"2024-09-21T06:45:21.030553+0000","last_fullsized":"2024-09-21T06:45:21.030553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032139+0000","last_change":"2024-09-21T06:45:19.506001+0000","last_active":"2024-09-21T06:45:21.032139+0000","last_peered":"2024-09-21T06:45:21.032139+0000","last_clean":"2024-09-21T06:45:21.032139+0000","last_became_active":"2024-09-21T06:45:19.505578+0000","last_became_peered":"2024-09-21T06:45:19.505578+0000","last_unstale":"2024-09-21T06:45:21.032139+0000","last_undegraded":"2024-09-21T06:45:21.032139+0000","last_fullsized":"2024-09-21T06:45:21.032139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:57.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505958+0000","last_change":"2024-09-21T06:45:15.471185+0000","last_active":"2024-09-21T06:45:20.505958+0000","last_peered":"2024-09-21T06:45:20.505958+0000","last_clean":"2024-09-21T06:45:20.505958+0000","last_became_active":"2024-09-21T06:45:15.470821+0000","last_became_peered":"2024-09-21T06:45:15.470821+0000","last_unstale":"2024-09-21T06:45:20.505958+0000","last_undegraded":"2024-09-21T06:45:20.505958+0000","last_fullsized":"2024-09-21T06:45:20.505958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508648+0000","last_change":"2024-09-21T06:45:14.463644+0000","last_active":"2024-09-21T06:45:20.508648+0000","last_peered":"2024-09-21T06:45:20.508648+0000","last_clean":"2024-09-21T06:45:20.508648+0000","last_became_active":"2024-09-21T06:45:14.463293+0000","last_became_peered":"2024-09-21T06:45:14.463293+0000","last_unstale":"2024-09-21T06:45:20.508648+0000","last_undegraded":"2024-09-21T06:45:20.508648+0000","last_fullsized":"2024-09-21T06:45:20.508648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:29.580518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032313+0000","last_change":"2024-09-21T06:45:19.499445+0000","last_active":"2024-09-21T06:45:21.032313+0000","last_peered":"2024-09-21T06:45:21.032313+0000","last_clean":"2024-09-21T06:45:21.032313+0000","last_became_active":"2024-09-21T06:45:19.499033+0000","last_became_peered":"2024-09-21T06:45:19.499033+0000","last_unstale":"2024-09-21T06:45:21.032313+0000","last_undegraded":"2024-09-21T06:45:21.032313+0000","last_fullsized":"2024-09-21T06:45:21.032313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:39.968433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031953+0000","last_change":"2024-09-21T06:45:15.462244+0000","last_active":"2024-09-21T06:45:21.031953+0000","last_peered":"2024-09-21T06:45:21.031953+0000","last_clean":"2024-09-21T06:45:21.031953+0000","last_became_active":"2024-09-21T06:45:15.461962+0000","last_became_peered":"2024-09-21T06:45:15.461962+0000","last_unstale":"2024-09-21T06:45:21.031953+0000","last_undegraded":"2024-09-21T06:45:21.031953+0000","last_fullsized":"2024-09-21T06:45:21.031953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030514+0000","last_change":"2024-09-21T06:45:14.458035+0000","last_active":"2024-09-21T06:45:21.030514+0000","last_peered":"2024-09-21T06:45:21.030514+0000","last_clean":"2024-09-21T06:45:21.030514+0000","last_became_active":"2024-09-21T06:45:14.457478+0000","last_became_peered":"2024-09-21T06:45:14.457478+0000","last_unstale":"2024-09-21T06:45:21.030514+0000","last_undegraded":"2024-09-21T06:45:21.030514+0000","last_fullsized":"2024-09-21T06:45:21.030514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:46.341816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032245+0000","last_change":"2024-09-21T06:45:19.496692+0000","last_active":"2024-09-21T06:45:21.032245+0000","last_peered":"2024-09-21T06:45:21.032245+0000","last_clean":"2024-09-21T06:45:21.032245+0000","last_became_active":"2024-09-21T06:45:19.496273+0000","last_became_peered":"2024-09-21T06:45:19.496273+0000","last_unstale":"2024-09-21T06:45:21.032245+0000","last_undegraded":"2024-09-21T06:45:21.032245+0000","last_fullsized":"2024-09-21T06:45:21.032245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:08.738093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506263+0000","last_change":"2024-09-21T06:45:15.474239+0000","last_active":"2024-09-21T06:45:20.506263+0000","last_peered":"2024-09-21T06:45:20.506263+0000","last_clean":"2024-09-21T06:45:20.506263+0000","last_became_active":"2024-09-21T06:45:15.473936+0000","last_became_peered":"2024-09-21T06:45:15.473936+0000","last_unstale":"2024-09-21T06:45:20.506263+0000","last_undegraded":"2024-09-21T06:45:20.506263+0000","last_fullsized":"2024-09-21T06:45:20.506263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:07.138927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506611+0000","last_change":"2024-09-21T06:45:14.465782+0000","last_active":"2024-09-21T06:45:20.506611+0000","last_peered":"2024-09-21T06:45:20.506611+0000","last_clean":"2024-09-21T06:45:20.506611+0000","last_became_active":"2024-09-21T06:45:14.464892+0000","last_became_peered":"2024-09-21T06:45:14.464892+0000","last_unstale":"2024-09-21T06:45:20.506611+0000","last_undegraded":"2024-09-21T06:45:20.506611+0000","last_fullsized":"2024-09-21T06:45:20.506611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508817+0000","last_change":"2024-09-21T06:45:19.496653+0000","last_active":"2024-09-21T06:45:20.508817+0000","last_peered":"2024-09-21T06:45:20.508817+0000","last_clean":"2024-09-21T06:45:20.508817+0000","last_became_active":"2024-09-21T06:45:19.496215+0000","last_became_peered":"2024-09-21T06:45:19.496215+0000","last_unstale":"2024-09-21T06:45:20.508817+0000","last_undegraded":"2024-09-21T06:45:20.508817+0000","last_fullsized":"2024-09-21T06:45:20.508817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507938+0000","last_change":"2024-09-21T06:45:15.468032+0000","last_active":"2024-09-21T06:45:20.507938+0000","last_peered":"2024-09-21T06:45:20.507938+0000","last_clean":"2024-09-21T06:45:20.507938+0000","last_became_active":"2024-09-21T06:45:15.467695+0000","last_became_peered":"2024-09-21T06:45:15.467695+0000","last_unstale":"2024-09-21T06:45:20.507938+0000","last_undegraded":"2024-09-21T06:45:20.507938+0000","last_fullsized":"2024-09-21T06:45:20.507938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:48.275548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031757+0000","last_change":"2024-09-21T06:45:14.472291+0000","last_active":"2024-09-21T06:45:21.031757+0000","last_peered":"2024-09-21T06:45:21.031757+0000","last_clean":"2024-09-21T06:45:21.031757+0000","last_became_active":"2024-09-21T06:45:14.472043+0000","last_became_peered":"2024-09-21T06:45:14.472043+0000","last_unstale":"2024-09-21T06:45:21.031757+0000","last_undegraded":"2024-09-21T06:45:21.031757+0000","last_fullsized":"2024-09-21T06:45:21.031757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506551+0000","last_change":"2024-09-21T06:45:19.499994+0000","last_active":"2024-09-21T06:45:20.506551+0000","last_peered":"2024-09-21T06:45:20.506551+0000","last_clean":"2024-09-21T06:45:20.506551+0000","last_became_active":"2024-09-21T06:45:19.497222+0000","last_became_peered":"2024-09-21T06:45:19.497222+0000","last_unstale":"2024-09-21T06:45:20.506551+0000","last_undegraded":"2024-09-21T06:45:20.506551+0000","last_fullsized":"2024-09-21T06:45:20.506551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:50.997451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030936+0000","last_change":"2024-09-21T06:45:15.477441+0000","last_active":"2024-09-21T06:45:21.030936+0000","last_peered":"2024-09-21T06:45:21.030936+0000","last_clean":"2024-09-21T06:45:21.030936+0000","last_became_active":"2024-09-21T06:45:15.477115+0000","last_became_peered":"2024-09-21T06:45:15.477115+0000","last_unstale":"2024-09-21T06:45:21.030936+0000","last_undegraded":"2024-09-21T06:45:21.030936+0000","last_fullsized":"2024-09-21T06:45:21.030936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:25.309327+0000","last_change":"2024-09-21T06:45:14.469539+0000","last_active":"2024-09-21T06:45:25.309327+0000","last_peered":"2024-09-21T06:45:25.309327+0000","last_clean":"2024-09-21T06:45:25.309327+0000","last_became_active":"2024-09-21T06:45:14.469221+0000","last_became_peered":"2024-09-21T06:45:14.469221+0000","last_unstale":"2024-09-21T06:45:25.309327+0000","last_undegraded":"2024-09-21T06:45:25.309327+0000","last_fullsized":"2024-09-21T06:45:25.309327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:28.598849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507385+0000","last_change":"2024-09-21T06:45:19.506781+0000","last_active":"2024-09-21T06:45:20.507385+0000","last_peered":"2024-09-21T06:45:20.507385+0000","last_clean":"2024-09-21T06:45:20.507385+0000","last_became_active":"2024-09-21T06:45:19.501911+0000","last_became_peered":"2024-09-21T06:45:19.501911+0000","last_unstale":"2024-09-21T06:45:20.507385+0000","last_undegraded":"2024-09-21T06:45:20.507385+0000","last_fullsized":"2024-09-21T06:45:20.507385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506203+0000","last_change":"2024-09-21T06:45:15.468579+0000","last_active":"2024-09-21T06:45:20.506203+0000","last_peered":"2024-09-21T06:45:20.506203+0000","last_clean":"2024-09-21T06:45:20.506203+0000","last_became_active":"2024-09-21T06:45:15.468329+0000","last_became_peered":"2024-09-21T06:45:15.468329+0000","last_unstale":"2024-09-21T06:45:20.506203+0000","last_undegraded":"2024-09-21T06:45:20.506203+0000","last_fullsized":"2024-09-21T06:45:20.506203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:07.302209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032248+0000","last_change":"2024-09-21T06:45:14.469511+0000","last_active":"2024-09-21T06:45:21.032248+0000","last_peered":"2024-09-21T06:45:21.032248+0000","last_clean":"2024-09-21T06:45:21.032248+0000","last_became_active":"2024-09-21T06:45:14.469153+0000","last_became_peered":"2024-09-21T06:45:14.469153+0000","last_unstale":"2024-09-21T06:45:21.032248+0000","last_undegraded":"2024-09-21T06:45:21.032248+0000","last_fullsized":"2024-09-21T06:45:21.032248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:21.542258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030751+0000","last_change":"2024-09-21T06:45:19.506219+0000","last_active":"2024-09-21T06:45:21.030751+0000","last_peered":"2024-09-21T06:45:21.030751+0000","last_clean":"2024-09-21T06:45:21.030751+0000","last_became_active":"2024-09-21T06:45:19.505827+0000","last_became_peered":"2024-09-21T06:45:19.505827+0000","last_unstale":"2024-09-21T06:45:21.030751+0000","last_undegraded":"2024-09-21T06:45:21.030751+0000","last_fullsized":"2024-09-21T06:45:21.030751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:15.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032207+0000","last_change":"2024-09-21T06:45:15.467787+0000","last_active":"2024-09-21T06:45:21.032207+0000","last_peered":"2024-09-21T06:45:21.032207+0000","last_clean":"2024-09-21T06:45:21.032207+0000","last_became_active":"2024-09-21T06:45:15.467470+0000","last_became_peered":"2024-09-21T06:45:15.467470+0000","last_unstale":"2024-09-21T06:45:21.032207+0000","last_undegraded":"2024-09-21T06:45:21.032207+0000","last_fullsized":"2024-09-21T06:45:21.032207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030710+0000","last_change":"2024-09-21T06:45:14.466812+0000","last_active":"2024-09-21T06:45:21.030710+0000","last_peered":"2024-09-21T06:45:21.030710+0000","last_clean":"2024-09-21T06:45:21.030710+0000","last_became_active":"2024-09-21T06:45:14.466356+0000","last_became_peered":"2024-09-21T06:45:14.466356+0000","last_unstale":"2024-09-21T06:45:21.030710+0000","last_undegraded":"2024-09-21T06:45:21.030710+0000","last_fullsized":"2024-09-21T06:45:21.030710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030568+0000","last_change":"2024-09-21T06:45:19.504492+0000","last_active":"2024-09-21T06:45:21.030568+0000","last_peered":"2024-09-21T06:45:21.030568+0000","last_clean":"2024-09-21T06:45:21.030568+0000","last_became_active":"2024-09-21T06:45:19.503845+0000","last_became_peered":"2024-09-21T06:45:19.503845+0000","last_unstale":"2024-09-21T06:45:21.030568+0000","last_undegraded":"2024-09-21T06:45:21.030568+0000","last_fullsized":"2024-09-21T06:45:21.030568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:50.206431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031079+0000","last_change":"2024-09-21T06:45:15.467027+0000","last_active":"2024-09-21T06:45:21.031079+0000","last_peered":"2024-09-21T06:45:21.031079+0000","last_clean":"2024-09-21T06:45:21.031079+0000","last_became_active":"2024-09-21T06:45:15.466419+0000","last_became_peered":"2024-09-21T06:45:15.466419+0000","last_unstale":"2024-09-21T06:45:21.031079+0000","last_undegraded":"2024-09-21T06:45:21.031079+0000","last_fullsized":"2024-09-21T06:45:21.031079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032027+0000","last_change":"2024-09-21T06:45:14.467184+0000","last_active":"2024-09-21T06:45:21.032027+0000","last_peered":"2024-09-21T06:45:21.032027+0000","last_clean":"2024-09-21T06:45:21.032027+0000","last_became_active":"2024-09-21T06:45:14.466888+0000","last_became_peered":"2024-09-21T06:45:14.466888+0000","last_unstale":"2024-09-21T06:45:21.032027+0000","last_undegraded":"2024-09-21T06:45:21.032027+0000","last_fullsized":"2024-09-21T06:45:21.032027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:14.862437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507441+0000","last_change":"2024-09-21T06:45:19.502432+0000","last_active":"2024-09-21T06:45:20.507441+0000","last_peered":"2024-09-21T06:45:20.507441+0000","last_clean":"2024-09-21T06:45:20.507441+0000","last_became_active":"2024-09-21T06:45:19.501859+0000","last_became_peered":"2024-09-21T06:45:19.501859+0000","last_unstale":"2024-09-21T06:45:20.507441+0000","last_undegraded":"2024-09-21T06:45:20.507441+0000","last_fullsized":"2024-09-21T06:45:20.507441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507823+0000","last_change":"2024-09-21T06:45:19.500757+0000","last_active":"2024-09-21T06:45:20.507823+0000","last_peered":"2024-09-21T06:45:20.507823+0000","last_clean":"2024-09-21T06:45:20.507823+0000","last_became_active":"2024-09-21T06:45:19.500330+0000","last_became_peered":"2024-09-21T06:45:19.500330+0000","last_unstale":"2024-09-21T06:45:20.507823+0000","last_undegraded":"2024-09-21T06:45:20.507823+0000","last_fullsized":"2024-09-21T06:45:20.507823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:54.472367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507536+0000","last_change":"2024-09-21T06:45:15.468255+0000","last_active":"2024-09-21T06:45:20.507536+0000","last_peered":"2024-09-21T06:45:20.507536+0000","last_clean":"2024-09-21T06:45:20.507536+0000","last_became_active":"2024-09-21T06:45:15.467926+0000","last_became_peered":"2024-09-21T06:45:15.467926+0000","last_unstale":"2024-09-21T06:45:20.507536+0000","last_undegraded":"2024-09-21T06:45:20.507536+0000","last_fullsized":"2024-09-21T06:45:20.507536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:46.878776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506248+0000","last_change":"2024-09-21T06:45:14.469185+0000","last_active":"2024-09-21T06:45:20.506248+0000","last_peered":"2024-09-21T06:45:20.506248+0000","last_clean":"2024-09-21T06:45:20.506248+0000","last_became_active":"2024-09-21T06:45:14.468890+0000","last_became_peered":"2024-09-21T06:45:14.468890+0000","last_unstale":"2024-09-21T06:45:20.506248+0000","last_undegraded":"2024-09-21T06:45:20.506248+0000","last_fullsized":"2024-09-21T06:45:20.506248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506605+0000","last_change":"2024-09-21T06:45:19.499608+0000","last_active":"2024-09-21T06:45:20.506605+0000","last_peered":"2024-09-21T06:45:20.506605+0000","last_clean":"2024-09-21T06:45:20.506605+0000","last_became_active":"2024-09-21T06:45:19.498220+0000","last_became_peered":"2024-09-21T06:45:19.498220+0000","last_unstale":"2024-09-21T06:45:20.506605+0000","last_undegraded":"2024-09-21T06:45:20.506605+0000","last_fullsized":"2024-09-21T06:45:20.506605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:22.588015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030646+0000","last_change":"2024-09-21T06:45:15.470401+0000","last_active":"2024-09-21T06:45:21.030646+0000","last_peered":"2024-09-21T06:45:21.030646+0000","last_clean":"2024-09-21T06:45:21.030646+0000","last_became_active":"2024-09-21T06:45:15.469676+0000","last_became_peered":"2024-09-21T06:45:15.469676+0000","last_unstale":"2024-09-21T06:45:21.030646+0000","last_undegraded":"2024-09-21T06:45:21.030646+0000","last_fullsized":"2024-09-21T06:45:21.030646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506888+0000","last_change":"2024-09-21T06:45:14.468923+0000","last_active":"2024-09-21T06:45:20.506888+0000","last_peered":"2024-09-21T06:45:20.506888+0000","last_clean":"2024-09-21T06:45:20.506888+0000","last_became_active":"2024-09-21T06:45:14.468591+0000","last_became_peered":"2024-09-21T06:45:14.468591+0000","last_unstale":"2024-09-21T06:45:20.506888+0000","last_undegraded":"2024-09-21T06:45:20.506888+0000","last_fullsized":"2024-09-21T06:45:20.506888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:25.844164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506904+0000","last_change":"2024-09-21T06:45:14.466145+0000","last_active":"2024-09-21T06:45:20.506904+0000","last_peered":"2024-09-21T06:45:20.506904+0000","last_clean":"2024-09-21T06:45:20.506904+0000","last_became_active":"2024-09-21T06:45:14.465260+0000","last_became_peered":"2024-09-21T06:45:14.465260+0000","last_unstale":"2024-09-21T06:45:20.506904+0000","last_undegraded":"2024-09-21T06:45:20.506904+0000","last_fullsized":"2024-09-21T06:45:20.506904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.506269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507474+0000","last_change":"2024-09-21T06:45:15.479102+0000","last_active":"2024-09-21T06:45:20.507474+0000","last_peered":"2024-09-21T06:45:20.507474+0000","last_clean":"2024-09-21T06:45:20.507474+0000","last_became_active":"2024-09-21T06:45:15.477931+0000","last_became_peered":"2024-09-21T06:45:15.477931+0000","last_unstale":"2024-09-21T06:45:20.507474+0000","last_undegraded":"2024-09-21T06:45:20.507474+0000","last_fullsized":"2024-09-21T06:45:20.507474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:15.776123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508961+0000","last_change":"2024-09-21T06:45:19.496596+0000","last_active":"2024-09-21T06:45:20.508961+0000","last_peered":"2024-09-21T06:45:20.508961+0000","last_clean":"2024-09-21T06:45:20.508961+0000","last_became_active":"2024-09-21T06:45:19.496164+0000","last_became_peered":"2024-09-21T06:45:19.496164+0000","last_unstale":"2024-09-21T06:45:20.508961+0000","last_undegraded":"2024-09-21T06:45:20.508961+0000","last_fullsized":"2024-09-21T06:45:20.508961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:50.753263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031547+0000","last_change":"2024-09-21T06:45:14.465515+0000","last_active":"2024-09-21T06:45:21.031547+0000","last_peered":"2024-09-21T06:45:21.031547+0000","last_clean":"2024-09-21T06:45:21.031547+0000","last_became_active":"2024-09-21T06:45:14.464349+0000","last_became_peered":"2024-09-21T06:45:14.464349+0000","last_unstale":"2024-09-21T06:45:21.031547+0000","last_undegraded":"2024-09-21T06:45:21.031547+0000","last_fullsized":"2024-09-21T06:45:21.031547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031752+0000","last_change":"2024-09-21T06:45:15.462226+0000","last_active":"2024-09-21T06:45:21.031752+0000","last_peered":"2024-09-21T06:45:21.031752+0000","last_clean":"2024-09-21T06:45:21.031752+0000","last_became_active":"2024-09-21T06:45:15.461939+0000","last_became_peered":"2024-09-21T06:45:15.461939+0000","last_unstale":"2024-09-21T06:45:21.031752+0000","last_undegraded":"2024-09-21T06:45:21.031752+0000","last_fullsized":"2024-09-21T06:45:21.031752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032165+0000","last_change":"2024-09-21T06:45:19.503463+0000","last_active":"2024-09-21T06:45:21.032165+0000","last_peered":"2024-09-21T06:45:21.032165+0000","last_clean":"2024-09-21T06:45:21.032165+0000","last_became_active":"2024-09-21T06:45:19.502870+0000","last_became_peered":"2024-09-21T06:45:19.502870+0000","last_unstale":"2024-09-21T06:45:21.032165+0000","last_undegraded":"2024-09-21T06:45:21.032165+0000","last_fullsized":"2024-09-21T06:45:21.032165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:41.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030040+0000","last_change":"2024-09-21T06:45:15.469971+0000","last_active":"2024-09-21T06:45:21.030040+0000","last_peered":"2024-09-21T06:45:21.030040+0000","last_clean":"2024-09-21T06:45:21.030040+0000","last_became_active":"2024-09-21T06:45:15.469549+0000","last_became_peered":"2024-09-21T06:45:15.469549+0000","last_unstale":"2024-09-21T06:45:21.030040+0000","last_undegraded":"2024-09-21T06:45:21.030040+0000","last_fullsized":"2024-09-21T06:45:21.030040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030790+0000","last_change":"2024-09-21T06:45:15.467015+0000","last_active":"2024-09-21T06:45:21.030790+0000","last_peered":"2024-09-21T06:45:21.030790+0000","last_clean":"2024-09-21T06:45:21.030790+0000","last_became_active":"2024-09-21T06:45:15.466693+0000","last_became_peered":"2024-09-21T06:45:15.466693+0000","last_unstale":"2024-09-21T06:45:21.030790+0000","last_undegraded":"2024-09-21T06:45:21.030790+0000","last_fullsized":"2024-09-21T06:45:21.030790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506161+0000","last_change":"2024-09-21T06:45:15.464050+0000","last_active":"2024-09-21T06:45:20.506161+0000","last_peered":"2024-09-21T06:45:20.506161+0000","last_clean":"2024-09-21T06:45:20.506161+0000","last_became_active":"2024-09-21T06:45:15.463716+0000","last_became_peered":"2024-09-21T06:45:15.463716+0000","last_unstale":"2024-09-21T06:45:20.506161+0000","last_undegraded":"2024-09-21T06:45:20.506161+0000","last_fullsized":"2024-09-21T06:45:20.506161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:06.081721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031406+0000","last_change":"2024-09-21T06:45:15.462023+0000","last_active":"2024-09-21T06:45:21.031406+0000","last_peered":"2024-09-21T06:45:21.031406+0000","last_clean":"2024-09-21T06:45:21.031406+0000","last_became_active":"2024-09-21T06:45:15.461673+0000","last_became_peered":"2024-09-21T06:45:15.461673+0000","last_unstale":"2024-09-21T06:45:21.031406+0000","last_undegraded":"2024-09-21T06:45:21.031406+0000","last_fullsized":"2024-09-21T06:45:21.031406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:34.273188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508975+0000","last_change":"2024-09-21T06:45:15.476773+0000","last_active":"2024-09-21T06:45:20.508975+0000","last_peered":"2024-09-21T06:45:20.508975+0000","last_clean":"2024-09-21T06:45:20.508975+0000","last_became_active":"2024-09-21T06:45:15.476452+0000","last_became_peered":"2024-09-21T06:45:15.476452+0000","last_unstale":"2024-09-21T06:45:20.508975+0000","last_undegraded":"2024-09-21T06:45:20.508975+0000","last_fullsized":"2024-09-21T06:45:20.508975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507490+0000","last_change":"2024-09-21T06:45:15.476075+0000","last_active":"2024-09-21T06:45:20.507490+0000","last_peered":"2024-09-21T06:45:20.507490+0000","last_clean":"2024-09-21T06:45:20.507490+0000","last_became_active":"2024-09-21T06:45:15.475645+0000","last_became_peered":"2024-09-21T06:45:15.475645+0000","last_unstale":"2024-09-21T06:45:20.507490+0000","last_undegraded":"2024-09-21T06:45:20.507490+0000","last_fullsized":"2024-09-21T06:45:20.507490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:11.856243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031037+0000","last_change":"2024-09-21T06:45:15.467350+0000","last_active":"2024-09-21T06:45:21.031037+0000","last_peered":"2024-09-21T06:45:21.031037+0000","last_clean":"2024-09-21T06:45:21.031037+0000","last_became_active":"2024-09-21T06:45:15.466738+0000","last_became_peered":"2024-09-21T06:45:15.466738+0000","last_unstale":"2024-09-21T06:45:21.031037+0000","last_undegraded":"2024-09-21T06:45:21.031037+0000","last_fullsized":"2024-09-21T06:45:21.031037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031917+0000","last_change":"2024-09-21T06:45:15.474042+0000","last_active":"2024-09-21T06:45:21.031917+0000","last_peered":"2024-09-21T06:45:21.031917+0000","last_clean":"2024-09-21T06:45:21.031917+0000","last_became_active":"2024-09-21T06:45:15.472921+0000","last_became_peered":"2024-09-21T06:45:15.472921+0000","last_unstale":"2024-09-21T06:45:21.031917+0000","last_undegraded":"2024-09-21T06:45:21.031917+0000","last_fullsized":"2024-09-21T06:45:21.031917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:55.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506242+0000","last_change":"2024-09-21T06:45:15.465615+0000","last_active":"2024-09-21T06:45:20.506242+0000","last_peered":"2024-09-21T06:45:20.506242+0000","last_clean":"2024-09-21T06:45:20.506242+0000","last_became_active":"2024-09-21T06:45:15.465295+0000","last_became_peered":"2024-09-21T06:45:15.465295+0000","last_unstale":"2024-09-21T06:45:20.506242+0000","last_undegraded":"2024-09-21T06:45:20.506242+0000","last_fullsized":"2024-09-21T06:45:20.506242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:49.579027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030830+0000","last_change":"2024-09-21T06:45:15.471829+0000","last_active":"2024-09-21T06:45:21.030830+0000","last_peered":"2024-09-21T06:45:21.030830+0000","last_clean":"2024-09-21T06:45:21.030830+0000","last_became_active":"2024-09-21T06:45:15.470063+0000","last_became_peered":"2024-09-21T06:45:15.470063+0000","last_unstale":"2024-09-21T06:45:21.030830+0000","last_undegraded":"2024-09-21T06:45:21.030830+0000","last_fullsized":"2024-09-21T06:45:21.030830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031632+0000","last_change":"2024-09-21T06:45:15.460833+0000","last_active":"2024-09-21T06:45:21.031632+0000","last_peered":"2024-09-21T06:45:21.031632+0000","last_clean":"2024-09-21T06:45:21.031632+0000","last_became_active":"2024-09-21T06:45:15.460524+0000","last_became_peered":"2024-09-21T06:45:15.460524+0000","last_unstale":"2024-09-21T06:45:21.031632+0000","last_undegraded":"2024-09-21T06:45:21.031632+0000","last_fullsized":"2024-09-21T06:45:21.031632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507357+0000","last_change":"2024-09-21T06:45:15.468655+0000","last_active":"2024-09-21T06:45:20.507357+0000","last_peered":"2024-09-21T06:45:20.507357+0000","last_clean":"2024-09-21T06:45:20.507357+0000","last_became_active":"2024-09-21T06:45:15.468310+0000","last_became_peered":"2024-09-21T06:45:15.468310+0000","last_unstale":"2024-09-21T06:45:20.507357+0000","last_undegraded":"2024-09-21T06:45:20.507357+0000","last_fullsized":"2024-09-21T06:45:20.507357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031414+0000","last_change":"2024-09-21T06:45:15.470151+0000","last_active":"2024-09-21T06:45:21.031414+0000","last_peered":"2024-09-21T06:45:21.031414+0000","last_clean":"2024-09-21T06:45:21.031414+0000","last_became_active":"2024-09-21T06:45:15.469649+0000","last_became_peered":"2024-09-21T06:45:15.469649+0000","last_unstale":"2024-09-21T06:45:21.031414+0000","last_undegraded":"2024-09-21T06:45:21.031414+0000","last_fullsized":"2024-09-21T06:45:21.031414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:37.996645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507052+0000","last_change":"2024-09-21T06:45:15.461412+0000","last_active":"2024-09-21T06:45:20.507052+0000","last_peered":"2024-09-21T06:45:20.507052+0000","last_clean":"2024-09-21T06:45:20.507052+0000","last_became_active":"2024-09-21T06:45:15.461063+0000","last_became_peered":"2024-09-21T06:45:15.461063+0000","last_unstale":"2024-09-21T06:45:20.507052+0000","last_undegraded":"2024-09-21T06:45:20.507052+0000","last_fullsized":"2024-09-21T06:45:20.507052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:15.663968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031669+0000","last_change":"2024-09-21T06:45:15.471096+0000","last_active":"2024-09-21T06:45:21.031669+0000","last_peered":"2024-09-21T06:45:21.031669+0000","last_clean":"2024-09-21T06:45:21.031669+0000","last_became_active":"2024-09-21T06:45:15.470745+0000","last_became_peered":"2024-09-21T06:45:15.470745+0000","last_unstale":"2024-09-21T06:45:21.031669+0000","last_undegraded":"2024-09-21T06:45:21.031669+0000","last_fullsized":"2024-09-21T06:45:21.031669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506933+0000","last_change":"2024-09-21T06:45:15.471359+0000","last_active":"2024-09-21T06:45:20.506933+0000","last_peered":"2024-09-21T06:45:20.506933+0000","last_clean":"2024-09-21T06:45:20.506933+0000","last_became_active":"2024-09-21T06:45:15.471058+0000","last_became_peered":"2024-09-21T06:45:15.471058+0000","last_unstale":"2024-09-21T06:45:20.506933+0000","last_undegraded":"2024-09-21T06:45:20.506933+0000","last_fullsized":"2024-09-21T06:45:20.506933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:16.265829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505982+0000","last_change":"2024-09-21T06:45:15.468454+0000","last_active":"2024-09-21T06:45:20.505982+0000","last_peered":"2024-09-21T06:45:20.505982+0000","last_clean":"2024-09-21T06:45:20.505982+0000","last_became_active":"2024-09-21T06:45:15.468156+0000","last_became_peered":"2024-09-21T06:45:15.468156+0000","last_unstale":"2024-09-21T06:45:20.505982+0000","last_undegraded":"2024-09-21T06:45:20.505982+0000","last_fullsized":"2024-09-21T06:45:20.505982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030537+0000","last_change":"2024-09-21T06:45:15.473222+0000","last_active":"2024-09-21T06:45:21.030537+0000","last_peered":"2024-09-21T06:45:21.030537+0000","last_clean":"2024-09-21T06:45:21.030537+0000","last_became_active":"2024-09-21T06:45:15.470238+0000","last_became_peered":"2024-09-21T06:45:15.470238+0000","last_unstale":"2024-09-21T06:45:21.030537+0000","last_undegraded":"2024-09-21T06:45:21.030537+0000","last_fullsized":"2024-09-21T06:45:21.030537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:15.814240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507835+0000","last_change":"2024-09-21T06:45:15.469249+0000","last_active":"2024-09-21T06:45:20.507835+0000","last_peered":"2024-09-21T06:45:20.507835+0000","last_clean":"2024-09-21T06:45:20.507835+0000","last_became_active":"2024-09-21T06:45:15.468891+0000","last_became_peered":"2024-09-21T06:45:15.468891+0000","last_unstale":"2024-09-21T06:45:20.507835+0000","last_undegraded":"2024-09-21T06:45:20.507835+0000","last_fullsized":"2024-09-21T06:45:20.507835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:30.588823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508365+0000","last_change":"2024-09-21T06:45:15.474819+0000","last_active":"2024-09-21T06:45:20.508365+0000","last_peered":"2024-09-21T06:45:20.508365+0000","last_clean":"2024-09-21T06:45:20.508365+0000","last_became_active":"2024-09-21T06:45:15.474480+0000","last_became_peered":"2024-09-21T06:45:15.474480+0000","last_unstale":"2024-09-21T06:45:20.508365+0000","last_undegraded":"2024-09-21T06:45:20.508365+0000","last_fullsized":"2024-09-21T06:45:20.508365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:33.846712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031351+0000","last_change":"2024-09-21T06:45:15.470503+0000","last_active":"2024-09-21T06:45:21.031351+0000","last_peered":"2024-09-21T06:45:21.031351+0000","last_clean":"2024-09-21T06:45:21.031351+0000","last_became_active":"2024-09-21T06:45:15.469857+0000","last_became_peered":"2024-09-21T06:45:15.469857+0000","last_unstale":"2024-09-21T06:45:21.031351+0000","last_undegraded":"2024-09-21T06:45:21.031351+0000","last_fullsized":"2024-09-21T06:45:21.031351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030846+0000","last_change":"2024-09-21T06:45:15.476713+0000","last_active":"2024-09-21T06:45:21.030846+0000","last_peered":"2024-09-21T06:45:21.030846+0000","last_clean":"2024-09-21T06:45:21.030846+0000","last_became_active":"2024-09-21T06:45:15.476116+0000","last_became_peered":"2024-09-21T06:45:15.476116+0000","last_unstale":"2024-09-21T06:45:21.030846+0000","last_undegraded":"2024-09-21T06:45:21.030846+0000","last_fullsized":"2024-09-21T06:45:21.030846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:38.613487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030607+0000","last_change":"2024-09-21T06:45:15.477443+0000","last_active":"2024-09-21T06:45:21.030607+0000","last_peered":"2024-09-21T06:45:21.030607+0000","last_clean":"2024-09-21T06:45:21.030607+0000","last_became_active":"2024-09-21T06:45:15.476960+0000","last_became_peered":"2024-09-21T06:45:15.476960+0000","last_unstale":"2024-09-21T06:45:21.030607+0000","last_undegraded":"2024-09-21T06:45:21.030607+0000","last_fullsized":"2024-09-21T06:45:21.030607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:43.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031952+0000","last_change":"2024-09-21T06:45:15.463639+0000","last_active":"2024-09-21T06:45:21.031952+0000","last_peered":"2024-09-21T06:45:21.031952+0000","last_clean":"2024-09-21T06:45:21.031952+0000","last_became_active":"2024-09-21T06:45:15.463208+0000","last_became_peered":"2024-09-21T06:45:15.463208+0000","last_unstale":"2024-09-21T06:45:21.031952+0000","last_undegraded":"2024-09-21T06:45:21.031952+0000","last_fullsized":"2024-09-21T06:45:21.031952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030528+0000","last_change":"2024-09-21T06:45:15.473790+0000","last_active":"2024-09-21T06:45:21.030528+0000","last_peered":"2024-09-21T06:45:21.030528+0000","last_clean":"2024-09-21T06:45:21.030528+0000","last_became_active":"2024-09-21T06:45:15.472962+0000","last_became_peered":"2024-09-21T06:45:15.472962+0000","last_unstale":"2024-09-21T06:45:21.030528+0000","last_undegraded":"2024-09-21T06:45:21.030528+0000","last_fullsized":"2024-09-21T06:45:21.030528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:47.239754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030418+0000","last_change":"2024-09-21T06:45:15.469545+0000","last_active":"2024-09-21T06:45:21.030418+0000","last_peered":"2024-09-21T06:45:21.030418+0000","last_clean":"2024-09-21T06:45:21.030418+0000","last_became_active":"2024-09-21T06:45:15.469169+0000","last_became_peered":"2024-09-21T06:45:15.469169+0000","last_unstale":"2024-09-21T06:45:21.030418+0000","last_undegraded":"2024-09-21T06:45:21.030418+0000","last_fullsized":"2024-09-21T06:45:21.030418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030577+0000","last_change":"2024-09-21T06:45:15.466759+0000","last_active":"2024-09-21T06:45:21.030577+0000","last_peered":"2024-09-21T06:45:21.030577+0000","last_clean":"2024-09-21T06:45:21.030577+0000","last_became_active":"2024-09-21T06:45:15.466478+0000","last_became_peered":"2024-09-21T06:45:15.466478+0000","last_unstale":"2024-09-21T06:45:21.030577+0000","last_undegraded":"2024-09-21T06:45:21.030577+0000","last_fullsized":"2024-09-21T06:45:21.030577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030244+0000","last_change":"2024-09-21T06:45:15.472637+0000","last_active":"2024-09-21T06:45:21.030244+0000","last_peered":"2024-09-21T06:45:21.030244+0000","last_clean":"2024-09-21T06:45:21.030244+0000","last_became_active":"2024-09-21T06:45:15.470326+0000","last_became_peered":"2024-09-21T06:45:15.470326+0000","last_unstale":"2024-09-21T06:45:21.030244+0000","last_undegraded":"2024-09-21T06:45:21.030244+0000","last_fullsized":"2024-09-21T06:45:21.030244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:20.637139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030961+0000","last_change":"2024-09-21T06:45:15.461625+0000","last_active":"2024-09-21T06:45:21.030961+0000","last_peered":"2024-09-21T06:45:21.030961+0000","last_clean":"2024-09-21T06:45:21.030961+0000","last_became_active":"2024-09-21T06:45:15.461296+0000","last_became_peered":"2024-09-21T06:45:15.461296+0000","last_unstale":"2024-09-21T06:45:21.030961+0000","last_undegraded":"2024-09-21T06:45:21.030961+0000","last_fullsized":"2024-09-21T06:45:21.030961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031625+0000","last_change":"2024-09-21T06:45:15.474538+0000","last_active":"2024-09-21T06:45:21.031625+0000","last_peered":"2024-09-21T06:45:21.031625+0000","last_clean":"2024-09-21T06:45:21.031625+0000","last_became_active":"2024-09-21T06:45:15.474164+0000","last_became_peered":"2024-09-21T06:45:15.474164+0000","last_unstale":"2024-09-21T06:45:21.031625+0000","last_undegraded":"2024-09-21T06:45:21.031625+0000","last_fullsized":"2024-09-21T06:45:21.031625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:08.489330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031957+0000","last_change":"2024-09-21T06:45:15.475008+0000","last_active":"2024-09-21T06:45:21.031957+0000","last_peered":"2024-09-21T06:45:21.031957+0000","last_clean":"2024-09-21T06:45:21.031957+0000","last_became_active":"2024-09-21T06:45:15.474621+0000","last_became_peered":"2024-09-21T06:45:15.474621+0000","last_unstale":"2024-09-21T06:45:21.031957+0000","last_undegraded":"2024-09-21T06:45:21.031957+0000","last_fullsized":"2024-09-21T06:45:21.031957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030146+0000","last_change":"2024-09-21T06:45:15.463461+0000","last_active":"2024-09-21T06:45:21.030146+0000","last_peered":"2024-09-21T06:45:21.030146+0000","last_clean":"2024-09-21T06:45:21.030146+0000","last_became_active":"2024-09-21T06:45:15.463156+0000","last_became_peered":"2024-09-21T06:45:15.463156+0000","last_unstale":"2024-09-21T06:45:21.030146+0000","last_undegraded":"2024-09-21T06:45:21.030146+0000","last_fullsized":"2024-09-21T06:45:21.030146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.464870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:45:34.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.750+0000 7fbd040f9640 1 -- 172.21.15.81:0/1931188272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc0ce340 msgr2=0x7fbcfc0731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.750+0000 7fbd040f9640 1 --2- 172.21.15.81:0/1931188272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc0ce340 0x7fbcfc0731d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc06fc10 tx=0x7fbcec02a530 comp rx=0 tx=0).stop 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.750+0000 7fbd040f9640 1 -- 172.21.15.81:0/1931188272 shutdown_connections 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.750+0000 7fbd040f9640 1 --2- 172.21.15.81:0/1931188272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc0ce340 0x7fbcfc0731d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.750+0000 7fbd040f9640 1 --2- 172.21.15.81:0/1931188272 >> v2:172.21.15.89:3300/0 conn(0x7fbcfc15e8b0 0x7fbcfc072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.750+0000 7fbd040f9640 1 -- 172.21.15.81:0/1931188272 >> 172.21.15.81:0/1931188272 conn(0x7fbcfc0d25e0 msgr2=0x7fbcfc0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.751+0000 7fbd040f9640 1 -- 172.21.15.81:0/1931188272 shutdown_connections 2024-09-21T06:45:34.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.751+0000 7fbd040f9640 1 -- 172.21.15.81:0/1931188272 wait complete. 2024-09-21T06:45:34.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.752+0000 7fbd040f9640 1 Processor -- start 2024-09-21T06:45:34.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.752+0000 7fbd040f9640 1 -- start start 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0ce340 0x7fbcfc1f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0d0230 0x7fbcfc0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc15e8b0 0x7fbcfc151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc162b30 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc1629b0 con 0x7fbcfc0d0230 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fbcfc162cb0 con 0x7fbcfc0ce340 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc15e8b0 0x7fbcfc151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc15e8b0 0x7fbcfc151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55030/0 (socket says 172.21.15.81:55030) 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 -- 172.21.15.81:0/466032944 learned_addr learned my addr 172.21.15.81:0/466032944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd01e95640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0ce340 0x7fbcfc1f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd01694640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0d0230 0x7fbcfc0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 -- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0ce340 msgr2=0x7fbcfc1f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0ce340 0x7fbcfc1f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 -- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0d0230 msgr2=0x7fbcfc0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0d0230 0x7fbcfc0cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 -- 172.21.15.81:0/466032944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc0c9a90 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd01694640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0d0230 0x7fbcfc0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd01e95640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0ce340 0x7fbcfc1f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd02696640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc15e8b0 0x7fbcfc151530 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ca80 tx=0x7fbcf400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbcf27fc640 1 -- 172.21.15.81:0/466032944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4016020 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbcf27fc640 1 -- 172.21.15.81:0/466032944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf400ad20 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbcf27fc640 1 -- 172.21.15.81:0/466032944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4012680 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcfc0c9d70 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.754+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcfc0c5a00 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.755+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcfc1622a0 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.756+0000 7fbcf27fc640 1 -- 172.21.15.81:0/466032944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbcf4019020 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.757+0000 7fbcf27fc640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbce0078b90 0x7fbce007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:34.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.757+0000 7fbcf27fc640 1 -- 172.21.15.81:0/466032944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbcf409b6b0 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.757+0000 7fbd01e95640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbce0078b90 0x7fbce007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:34.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.758+0000 7fbd01e95640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbce0078b90 0x7fbce007b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009aa0 tx=0x7fbcf8005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:34.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.764+0000 7fbcf27fc640 1 -- 172.21.15.81:0/466032944 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbcf4020020 con 0x7fbcfc15e8b0 2024-09-21T06:45:34.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.939+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcfc0b5390 con 0x7fbce0078b90 2024-09-21T06:45:34.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.945+0000 7fbcf27fc640 1 -- 172.21.15.81:0/466032944 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fbcfc0b5390 con 0x7fbce0078b90 2024-09-21T06:45:34.949 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:34.951 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:45:34.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbce0078b90 msgr2=0x7fbce007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbce0078b90 0x7fbce007b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009aa0 tx=0x7fbcf8005db0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc15e8b0 msgr2=0x7fbcfc151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc15e8b0 0x7fbcfc151530 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ca80 tx=0x7fbcf400cf40 comp rx=0 tx=0).stop 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 shutdown_connections 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbce0078b90 0x7fbce007b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcfc15e8b0 0x7fbcfc151530 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcfc0d0230 0x7fbcfc0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 --2- 172.21.15.81:0/466032944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcfc0ce340 0x7fbcfc1f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.948+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 >> 172.21.15.81:0/466032944 conn(0x7fbcfc0d25e0 msgr2=0x7fbcfc0b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.949+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 shutdown_connections 2024-09-21T06:45:34.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:34.949+0000 7fbd040f9640 1 -- 172.21.15.81:0/466032944 wait complete. 2024-09-21T06:45:34.961 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-21T06:45:34.655906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219564,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755156,"statfs":{"total":773094113280,"available":772869279744,"internally_reserved":0,"allocated":3416064,"data_stored":2042240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003388"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508468+0000","last_change":"2024-09-21T06:45:14.464339+0000","last_active":"2024-09-21T06:45:20.508468+0000","last_peered":"2024-09-21T06:45:20.508468+0000","last_clean":"2024-09-21T06:45:20.508468+0000","last_became_active":"2024-09-21T06:45:14.464012+0000","last_became_peered":"2024-09-21T06:45:14.464012+0000","last_unstale":"2024-09-21T06:45:20.508468+0000","last_undegraded":"2024-09-21T06:45:20.508468+0000","last_fullsized":"2024-09-21T06:45:20.508468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:36.925765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032175+0000","last_change":"2024-09-21T06:45:15.471510+0000","last_active":"2024-09-21T06:45:21.032175+0000","last_peered":"2024-09-21T06:45:21.032175+0000","last_clean":"2024-09-21T06:45:21.032175+0000","last_became_active":"2024-09-21T06:45:15.471143+0000","last_became_peered":"2024-09-21T06:45:15.471143+0000","last_unstale":"2024-09-21T06:45:21.032175+0000","last_undegraded":"2024-09-21T06:45:21.032175+0000","last_fullsized":"2024-09-21T06:45:21.032175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030689+0000","last_change":"2024-09-21T06:45:19.508650+0000","last_active":"2024-09-21T06:45:21.030689+0000","last_peered":"2024-09-21T06:45:21.030689+0000","last_clean":"2024-09-21T06:45:21.030689+0000","last_became_active":"2024-09-21T06:45:19.508068+0000","last_became_peered":"2024-09-21T06:45:19.508068+0000","last_unstale":"2024-09-21T06:45:21.030689+0000","last_undegraded":"2024-09-21T06:45:21.030689+0000","last_fullsized":"2024-09-21T06:45:21.030689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:00.812495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032318+0000","last_change":"2024-09-21T06:45:14.463510+0000","last_active":"2024-09-21T06:45:21.032318+0000","last_peered":"2024-09-21T06:45:21.032318+0000","last_clean":"2024-09-21T06:45:21.032318+0000","last_became_active":"2024-09-21T06:45:14.462560+0000","last_became_peered":"2024-09-21T06:45:14.462560+0000","last_unstale":"2024-09-21T06:45:21.032318+0000","last_undegraded":"2024-09-21T06:45:21.032318+0000","last_fullsized":"2024-09-21T06:45:21.032318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032076+0000","last_change":"2024-09-21T06:45:15.469206+0000","last_active":"2024-09-21T06:45:21.032076+0000","last_peered":"2024-09-21T06:45:21.032076+0000","last_clean":"2024-09-21T06:45:21.032076+0000","last_became_active":"2024-09-21T06:45:15.468852+0000","last_became_peered":"2024-09-21T06:45:15.468852+0000","last_unstale":"2024-09-21T06:45:21.032076+0000","last_undegraded":"2024-09-21T06:45:21.032076+0000","last_fullsized":"2024-09-21T06:45:21.032076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:53.718982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.029911+0000","last_change":"2024-09-21T06:45:19.499958+0000","last_active":"2024-09-21T06:45:21.029911+0000","last_peered":"2024-09-21T06:45:21.029911+0000","last_clean":"2024-09-21T06:45:21.029911+0000","last_became_active":"2024-09-21T06:45:19.498778+0000","last_became_peered":"2024-09-21T06:45:19.498778+0000","last_unstale":"2024-09-21T06:45:21.029911+0000","last_undegraded":"2024-09-21T06:45:21.029911+0000","last_fullsized":"2024-09-21T06:45:21.029911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:30.663232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031112+0000","last_change":"2024-09-21T06:45:14.467815+0000","last_active":"2024-09-21T06:45:21.031112+0000","last_peered":"2024-09-21T06:45:21.031112+0000","last_clean":"2024-09-21T06:45:21.031112+0000","last_became_active":"2024-09-21T06:45:14.467402+0000","last_became_peered":"2024-09-21T06:45:14.467402+0000","last_unstale":"2024-09-21T06:45:21.031112+0000","last_undegraded":"2024-09-21T06:45:21.031112+0000","last_fullsized":"2024-09-21T06:45:21.031112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:08.439046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032375+0000","last_change":"2024-09-21T06:45:15.472639+0000","last_active":"2024-09-21T06:45:21.032375+0000","last_peered":"2024-09-21T06:45:21.032375+0000","last_clean":"2024-09-21T06:45:21.032375+0000","last_became_active":"2024-09-21T06:45:15.472020+0000","last_became_peered":"2024-09-21T06:45:15.472020+0000","last_unstale":"2024-09-21T06:45:21.032375+0000","last_undegraded":"2024-09-21T06:45:21.032375+0000","last_fullsized":"2024-09-21T06:45:21.032375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031061+0000","last_change":"2024-09-21T06:45:19.506108+0000","last_active":"2024-09-21T06:45:21.031061+0000","last_peered":"2024-09-21T06:45:21.031061+0000","last_clean":"2024-09-21T06:45:21.031061+0000","last_became_active":"2024-09-21T06:45:19.505693+0000","last_became_peered":"2024-09-21T06:45:19.505693+0000","last_unstale":"2024-09-21T06:45:21.031061+0000","last_undegraded":"2024-09-21T06:45:21.031061+0000","last_fullsized":"2024-09-21T06:45:21.031061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:04.498857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031623+0000","last_change":"2024-09-21T06:45:14.468290+0000","last_active":"2024-09-21T06:45:21.031623+0000","last_peered":"2024-09-21T06:45:21.031623+0000","last_clean":"2024-09-21T06:45:21.031623+0000","last_became_active":"2024-09-21T06:45:14.466952+0000","last_became_peered":"2024-09-21T06:45:14.466952+0000","last_unstale":"2024-09-21T06:45:21.031623+0000","last_undegraded":"2024-09-21T06:45:21.031623+0000","last_fullsized":"2024-09-21T06:45:21.031623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506797+0000","last_change":"2024-09-21T06:45:15.478969+0000","last_active":"2024-09-21T06:45:20.506797+0000","last_peered":"2024-09-21T06:45:20.506797+0000","last_clean":"2024-09-21T06:45:20.506797+0000","last_became_active":"2024-09-21T06:45:15.478560+0000","last_became_peered":"2024-09-21T06:45:15.478560+0000","last_unstale":"2024-09-21T06:45:20.506797+0000","last_undegraded":"2024-09-21T06:45:20.506797+0000","last_fullsized":"2024-09-21T06:45:20.506797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030140+0000","last_change":"2024-09-21T06:45:19.501225+0000","last_active":"2024-09-21T06:45:21.030140+0000","last_peered":"2024-09-21T06:45:21.030140+0000","last_clean":"2024-09-21T06:45:21.030140+0000","last_became_active":"2024-09-21T06:45:19.500690+0000","last_became_peered":"2024-09-21T06:45:19.500690+0000","last_unstale":"2024-09-21T06:45:21.030140+0000","last_undegraded":"2024-09-21T06:45:21.030140+0000","last_fullsized":"2024-09-21T06:45:21.030140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:19.848228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506286+0000","last_change":"2024-09-21T06:45:15.464877+0000","last_active":"2024-09-21T06:45:20.506286+0000","last_peered":"2024-09-21T06:45:20.506286+0000","last_clean":"2024-09-21T06:45:20.506286+0000","last_became_active":"2024-09-21T06:45:15.464588+0000","last_became_peered":"2024-09-21T06:45:15.464588+0000","last_unstale":"2024-09-21T06:45:20.506286+0000","last_undegraded":"2024-09-21T06:45:20.506286+0000","last_fullsized":"2024-09-21T06:45:20.506286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:42.134939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506529+0000","last_change":"2024-09-21T06:45:14.467476+0000","last_active":"2024-09-21T06:45:20.506529+0000","last_peered":"2024-09-21T06:45:20.506529+0000","last_clean":"2024-09-21T06:45:20.506529+0000","last_became_active":"2024-09-21T06:45:14.466897+0000","last_became_peered":"2024-09-21T06:45:14.466897+0000","last_unstale":"2024-09-21T06:45:20.506529+0000","last_undegraded":"2024-09-21T06:45:20.506529+0000","last_fullsized":"2024-09-21T06:45:20.506529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:10.023372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506859+0000","last_change":"2024-09-21T06:45:19.498544+0000","last_active":"2024-09-21T06:45:20.506859+0000","last_peered":"2024-09-21T06:45:20.506859+0000","last_clean":"2024-09-21T06:45:20.506859+0000","last_became_active":"2024-09-21T06:45:19.497658+0000","last_became_peered":"2024-09-21T06:45:19.497658+0000","last_unstale":"2024-09-21T06:45:20.506859+0000","last_undegraded":"2024-09-21T06:45:20.506859+0000","last_fullsized":"2024-09-21T06:45:20.506859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:52.803324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031062+0000","last_change":"2024-09-21T06:45:15.468182+0000","last_active":"2024-09-21T06:45:21.031062+0000","last_peered":"2024-09-21T06:45:21.031062+0000","last_clean":"2024-09-21T06:45:21.031062+0000","last_became_active":"2024-09-21T06:45:15.467824+0000","last_became_peered":"2024-09-21T06:45:15.467824+0000","last_unstale":"2024-09-21T06:45:21.031062+0000","last_undegraded":"2024-09-21T06:45:21.031062+0000","last_fullsized":"2024-09-21T06:45:21.031062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508135+0000","last_change":"2024-09-21T06:45:14.466757+0000","last_active":"2024-09-21T06:45:20.508135+0000","last_peered":"2024-09-21T06:45:20.508135+0000","last_clean":"2024-09-21T06:45:20.508135+0000","last_became_active":"2024-09-21T06:45:14.466415+0000","last_became_peered":"2024-09-21T06:45:14.466415+0000","last_unstale":"2024-09-21T06:45:20.508135+0000","last_undegraded":"2024-09-21T06:45:20.508135+0000","last_fullsized":"2024-09-21T06:45:20.508135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:07.383477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031176+0000","last_change":"2024-09-21T06:45:19.499423+0000","last_active":"2024-09-21T06:45:21.031176+0000","last_peered":"2024-09-21T06:45:21.031176+0000","last_clean":"2024-09-21T06:45:21.031176+0000","last_became_active":"2024-09-21T06:45:19.498952+0000","last_became_peered":"2024-09-21T06:45:19.498952+0000","last_unstale":"2024-09-21T06:45:21.031176+0000","last_undegraded":"2024-09-21T06:45:21.031176+0000","last_fullsized":"2024-09-21T06:45:21.031176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508529+0000","last_change":"2024-09-21T06:45:15.466008+0000","last_active":"2024-09-21T06:45:20.508529+0000","last_peered":"2024-09-21T06:45:20.508529+0000","last_clean":"2024-09-21T06:45:20.508529+0000","last_became_active":"2024-09-21T06:45:15.465647+0000","last_became_peered":"2024-09-21T06:45:15.465647+0000","last_unstale":"2024-09-21T06:45:20.508529+0000","last_undegraded":"2024-09-21T06:45:20.508529+0000","last_fullsized":"2024-09-21T06:45:20.508529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:31.085363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507731+0000","last_change":"2024-09-21T06:45:14.469576+0000","last_active":"2024-09-21T06:45:20.507731+0000","last_peered":"2024-09-21T06:45:20.507731+0000","last_clean":"2024-09-21T06:45:20.507731+0000","last_became_active":"2024-09-21T06:45:14.469236+0000","last_became_peered":"2024-09-21T06:45:14.469236+0000","last_unstale":"2024-09-21T06:45:20.507731+0000","last_undegraded":"2024-09-21T06:45:20.507731+0000","last_fullsized":"2024-09-21T06:45:20.507731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:02.696088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032184+0000","last_change":"2024-09-21T06:45:19.510297+0000","last_active":"2024-09-21T06:45:21.032184+0000","last_peered":"2024-09-21T06:45:21.032184+0000","last_clean":"2024-09-21T06:45:21.032184+0000","last_became_active":"2024-09-21T06:45:19.509889+0000","last_became_peered":"2024-09-21T06:45:19.509889+0000","last_unstale":"2024-09-21T06:45:21.032184+0000","last_undegraded":"2024-09-21T06:45:21.032184+0000","last_fullsized":"2024-09-21T06:45:21.032184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:59.748038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506005+0000","last_change":"2024-09-21T06:45:15.464901+0000","last_active":"2024-09-21T06:45:20.506005+0000","last_peered":"2024-09-21T06:45:20.506005+0000","last_clean":"2024-09-21T06:45:20.506005+0000","last_became_active":"2024-09-21T06:45:15.464616+0000","last_became_peered":"2024-09-21T06:45:15.464616+0000","last_unstale":"2024-09-21T06:45:20.506005+0000","last_undegraded":"2024-09-21T06:45:20.506005+0000","last_fullsized":"2024-09-21T06:45:20.506005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030008+0000","last_change":"2024-09-21T06:45:14.469791+0000","last_active":"2024-09-21T06:45:21.030008+0000","last_peered":"2024-09-21T06:45:21.030008+0000","last_clean":"2024-09-21T06:45:21.030008+0000","last_became_active":"2024-09-21T06:45:14.469113+0000","last_became_peered":"2024-09-21T06:45:14.469113+0000","last_unstale":"2024-09-21T06:45:21.030008+0000","last_undegraded":"2024-09-21T06:45:21.030008+0000","last_fullsized":"2024-09-21T06:45:21.030008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030884+0000","last_change":"2024-09-21T06:45:19.503593+0000","last_active":"2024-09-21T06:45:21.030884+0000","last_peered":"2024-09-21T06:45:21.030884+0000","last_clean":"2024-09-21T06:45:21.030884+0000","last_became_active":"2024-09-21T06:45:19.503150+0000","last_became_peered":"2024-09-21T06:45:19.503150+0000","last_unstale":"2024-09-21T06:45:21.030884+0000","last_undegraded":"2024-09-21T06:45:21.030884+0000","last_fullsized":"2024-09-21T06:45:21.030884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:56.348456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507905+0000","last_change":"2024-09-21T06:45:15.464731+0000","last_active":"2024-09-21T06:45:20.507905+0000","last_peered":"2024-09-21T06:45:20.507905+0000","last_clean":"2024-09-21T06:45:20.507905+0000","last_became_active":"2024-09-21T06:45:15.464397+0000","last_became_peered":"2024-09-21T06:45:15.464397+0000","last_unstale":"2024-09-21T06:45:20.507905+0000","last_undegraded":"2024-09-21T06:45:20.507905+0000","last_fullsized":"2024-09-21T06:45:20.507905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:24.268833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507028+0000","last_change":"2024-09-21T06:45:14.463206+0000","last_active":"2024-09-21T06:45:20.507028+0000","last_peered":"2024-09-21T06:45:20.507028+0000","last_clean":"2024-09-21T06:45:20.507028+0000","last_became_active":"2024-09-21T06:45:14.462858+0000","last_became_peered":"2024-09-21T06:45:14.462858+0000","last_unstale":"2024-09-21T06:45:20.507028+0000","last_undegraded":"2024-09-21T06:45:20.507028+0000","last_fullsized":"2024-09-21T06:45:20.507028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:09.685089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030880+0000","last_change":"2024-09-21T06:45:19.504734+0000","last_active":"2024-09-21T06:45:21.030880+0000","last_peered":"2024-09-21T06:45:21.030880+0000","last_clean":"2024-09-21T06:45:21.030880+0000","last_became_active":"2024-09-21T06:45:19.504280+0000","last_became_peered":"2024-09-21T06:45:19.504280+0000","last_unstale":"2024-09-21T06:45:21.030880+0000","last_undegraded":"2024-09-21T06:45:21.030880+0000","last_fullsized":"2024-09-21T06:45:21.030880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:29.145421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508777+0000","last_change":"2024-09-21T06:45:15.470507+0000","last_active":"2024-09-21T06:45:20.508777+0000","last_peered":"2024-09-21T06:45:20.508777+0000","last_clean":"2024-09-21T06:45:20.508777+0000","last_became_active":"2024-09-21T06:45:15.470151+0000","last_became_peered":"2024-09-21T06:45:15.470151+0000","last_unstale":"2024-09-21T06:45:20.508777+0000","last_undegraded":"2024-09-21T06:45:20.508777+0000","last_fullsized":"2024-09-21T06:45:20.508777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:23.908138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508277+0000","last_change":"2024-09-21T06:45:14.463895+0000","last_active":"2024-09-21T06:45:20.508277+0000","last_peered":"2024-09-21T06:45:20.508277+0000","last_clean":"2024-09-21T06:45:20.508277+0000","last_became_active":"2024-09-21T06:45:14.463553+0000","last_became_peered":"2024-09-21T06:45:14.463553+0000","last_unstale":"2024-09-21T06:45:20.508277+0000","last_undegraded":"2024-09-21T06:45:20.508277+0000","last_fullsized":"2024-09-21T06:45:20.508277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:18.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508458+0000","last_change":"2024-09-21T06:45:19.501027+0000","last_active":"2024-09-21T06:45:20.508458+0000","last_peered":"2024-09-21T06:45:20.508458+0000","last_clean":"2024-09-21T06:45:20.508458+0000","last_became_active":"2024-09-21T06:45:19.500456+0000","last_became_peered":"2024-09-21T06:45:19.500456+0000","last_unstale":"2024-09-21T06:45:20.508458+0000","last_undegraded":"2024-09-21T06:45:20.508458+0000","last_fullsized":"2024-09-21T06:45:20.508458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:24.217258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509016+0000","last_change":"2024-09-21T06:45:15.475607+0000","last_active":"2024-09-21T06:45:20.509016+0000","last_peered":"2024-09-21T06:45:20.509016+0000","last_clean":"2024-09-21T06:45:20.509016+0000","last_became_active":"2024-09-21T06:45:15.475256+0000","last_became_peered":"2024-09-21T06:45:15.475256+0000","last_unstale":"2024-09-21T06:45:20.509016+0000","last_undegraded":"2024-09-21T06:45:20.509016+0000","last_fullsized":"2024-09-21T06:45:20.509016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:09:18.300400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507126+0000","last_change":"2024-09-21T06:45:14.463043+0000","last_active":"2024-09-21T06:45:20.507126+0000","last_peered":"2024-09-21T06:45:20.507126+0000","last_clean":"2024-09-21T06:45:20.507126+0000","last_became_active":"2024-09-21T06:45:14.462253+0000","last_became_peered":"2024-09-21T06:45:14.462253+0000","last_unstale":"2024-09-21T06:45:20.507126+0000","last_undegraded":"2024-09-21T06:45:20.507126+0000","last_fullsized":"2024-09-21T06:45:20.507126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.407253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508325+0000","last_change":"2024-09-21T06:45:19.499431+0000","last_active":"2024-09-21T06:45:20.508325+0000","last_peered":"2024-09-21T06:45:20.508325+0000","last_clean":"2024-09-21T06:45:20.508325+0000","last_became_active":"2024-09-21T06:45:19.498990+0000","last_became_peered":"2024-09-21T06:45:19.498990+0000","last_unstale":"2024-09-21T06:45:20.508325+0000","last_undegraded":"2024-09-21T06:45:20.508325+0000","last_fullsized":"2024-09-21T06:45:20.508325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:22.135690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030357+0000","last_change":"2024-09-21T06:45:15.476862+0000","last_active":"2024-09-21T06:45:21.030357+0000","last_peered":"2024-09-21T06:45:21.030357+0000","last_clean":"2024-09-21T06:45:21.030357+0000","last_became_active":"2024-09-21T06:45:15.476545+0000","last_became_peered":"2024-09-21T06:45:15.476545+0000","last_unstale":"2024-09-21T06:45:21.030357+0000","last_undegraded":"2024-09-21T06:45:21.030357+0000","last_fullsized":"2024-09-21T06:45:21.030357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031479+0000","last_change":"2024-09-21T06:45:14.465001+0000","last_active":"2024-09-21T06:45:21.031479+0000","last_peered":"2024-09-21T06:45:21.031479+0000","last_clean":"2024-09-21T06:45:21.031479+0000","last_became_active":"2024-09-21T06:45:14.463300+0000","last_became_peered":"2024-09-21T06:45:14.463300+0000","last_unstale":"2024-09-21T06:45:21.031479+0000","last_undegraded":"2024-09-21T06:45:21.031479+0000","last_fullsized":"2024-09-21T06:45:21.031479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:08.599904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508546+0000","last_change":"2024-09-21T06:45:19.504273+0000","last_active":"2024-09-21T06:45:20.508546+0000","last_peered":"2024-09-21T06:45:20.508546+0000","last_clean":"2024-09-21T06:45:20.508546+0000","last_became_active":"2024-09-21T06:45:19.503505+0000","last_became_peered":"2024-09-21T06:45:19.503505+0000","last_unstale":"2024-09-21T06:45:20.508546+0000","last_undegraded":"2024-09-21T06:45:20.508546+0000","last_fullsized":"2024-09-21T06:45:20.508546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:17.053992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030362+0000","last_change":"2024-09-21T06:45:15.478404+0000","last_active":"2024-09-21T06:45:21.030362+0000","last_peered":"2024-09-21T06:45:21.030362+0000","last_clean":"2024-09-21T06:45:21.030362+0000","last_became_active":"2024-09-21T06:45:15.478121+0000","last_became_peered":"2024-09-21T06:45:15.478121+0000","last_unstale":"2024-09-21T06:45:21.030362+0000","last_undegraded":"2024-09-21T06:45:21.030362+0000","last_fullsized":"2024-09-21T06:45:21.030362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506726+0000","last_change":"2024-09-21T06:45:14.465807+0000","last_active":"2024-09-21T06:45:20.506726+0000","last_peered":"2024-09-21T06:45:20.506726+0000","last_clean":"2024-09-21T06:45:20.506726+0000","last_became_active":"2024-09-21T06:45:14.464509+0000","last_became_peered":"2024-09-21T06:45:14.464509+0000","last_unstale":"2024-09-21T06:45:20.506726+0000","last_undegraded":"2024-09-21T06:45:20.506726+0000","last_fullsized":"2024-09-21T06:45:20.506726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:48.784970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508935+0000","last_change":"2024-09-21T06:45:19.504015+0000","last_active":"2024-09-21T06:45:20.508935+0000","last_peered":"2024-09-21T06:45:20.508935+0000","last_clean":"2024-09-21T06:45:20.508935+0000","last_became_active":"2024-09-21T06:45:19.503577+0000","last_became_peered":"2024-09-21T06:45:19.503577+0000","last_unstale":"2024-09-21T06:45:20.508935+0000","last_undegraded":"2024-09-21T06:45:20.508935+0000","last_fullsized":"2024-09-21T06:45:20.508935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030571+0000","last_change":"2024-09-21T06:45:15.474182+0000","last_active":"2024-09-21T06:45:21.030571+0000","last_peered":"2024-09-21T06:45:21.030571+0000","last_clean":"2024-09-21T06:45:21.030571+0000","last_became_active":"2024-09-21T06:45:15.473818+0000","last_became_peered":"2024-09-21T06:45:15.473818+0000","last_unstale":"2024-09-21T06:45:21.030571+0000","last_undegraded":"2024-09-21T06:45:21.030571+0000","last_fullsized":"2024-09-21T06:45:21.030571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:15.405798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030836+0000","last_change":"2024-09-21T06:45:14.469718+0000","last_active":"2024-09-21T06:45:21.030836+0000","last_peered":"2024-09-21T06:45:21.030836+0000","last_clean":"2024-09-21T06:45:21.030836+0000","last_became_active":"2024-09-21T06:45:14.469379+0000","last_became_peered":"2024-09-21T06:45:14.469379+0000","last_unstale":"2024-09-21T06:45:21.030836+0000","last_undegraded":"2024-09-21T06:45:21.030836+0000","last_fullsized":"2024-09-21T06:45:21.030836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507427+0000","last_change":"2024-09-21T06:45:19.496958+0000","last_active":"2024-09-21T06:45:20.507427+0000","last_peered":"2024-09-21T06:45:20.507427+0000","last_clean":"2024-09-21T06:45:20.507427+0000","last_became_active":"2024-09-21T06:45:19.496555+0000","last_became_peered":"2024-09-21T06:45:19.496555+0000","last_unstale":"2024-09-21T06:45:20.507427+0000","last_undegraded":"2024-09-21T06:45:20.507427+0000","last_fullsized":"2024-09-21T06:45:20.507427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:44.406905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506844+0000","last_change":"2024-09-21T06:45:15.472140+0000","last_active":"2024-09-21T06:45:20.506844+0000","last_peered":"2024-09-21T06:45:20.506844+0000","last_clean":"2024-09-21T06:45:20.506844+0000","last_became_active":"2024-09-21T06:45:15.471806+0000","last_became_peered":"2024-09-21T06:45:15.471806+0000","last_unstale":"2024-09-21T06:45:20.506844+0000","last_undegraded":"2024-09-21T06:45:20.506844+0000","last_fullsized":"2024-09-21T06:45:20.506844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:23.439120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506380+0000","last_change":"2024-09-21T06:45:14.469896+0000","last_active":"2024-09-21T06:45:20.506380+0000","last_peered":"2024-09-21T06:45:20.506380+0000","last_clean":"2024-09-21T06:45:20.506380+0000","last_became_active":"2024-09-21T06:45:14.469577+0000","last_became_peered":"2024-09-21T06:45:14.469577+0000","last_unstale":"2024-09-21T06:45:20.506380+0000","last_undegraded":"2024-09-21T06:45:20.506380+0000","last_fullsized":"2024-09-21T06:45:20.506380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031840+0000","last_change":"2024-09-21T06:45:19.500636+0000","last_active":"2024-09-21T06:45:21.031840+0000","last_peered":"2024-09-21T06:45:21.031840+0000","last_clean":"2024-09-21T06:45:21.031840+0000","last_became_active":"2024-09-21T06:45:19.500192+0000","last_became_peered":"2024-09-21T06:45:19.500192+0000","last_unstale":"2024-09-21T06:45:21.031840+0000","last_undegraded":"2024-09-21T06:45:21.031840+0000","last_fullsized":"2024-09-21T06:45:21.031840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:58.980314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507558+0000","last_change":"2024-09-21T06:45:15.472278+0000","last_active":"2024-09-21T06:45:20.507558+0000","last_peered":"2024-09-21T06:45:20.507558+0000","last_clean":"2024-09-21T06:45:20.507558+0000","last_became_active":"2024-09-21T06:45:15.471284+0000","last_became_peered":"2024-09-21T06:45:15.471284+0000","last_unstale":"2024-09-21T06:45:20.507558+0000","last_undegraded":"2024-09-21T06:45:20.507558+0000","last_fullsized":"2024-09-21T06:45:20.507558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:55.552947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506692+0000","last_change":"2024-09-21T06:45:14.467169+0000","last_active":"2024-09-21T06:45:20.506692+0000","last_peered":"2024-09-21T06:45:20.506692+0000","last_clean":"2024-09-21T06:45:20.506692+0000","last_became_active":"2024-09-21T06:45:14.466525+0000","last_became_peered":"2024-09-21T06:45:14.466525+0000","last_unstale":"2024-09-21T06:45:20.506692+0000","last_undegraded":"2024-09-21T06:45:20.506692+0000","last_fullsized":"2024-09-21T06:45:20.506692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:45.167373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032068+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:45:21.032068+0000","last_peered":"2024-09-21T06:45:21.032068+0000","last_clean":"2024-09-21T06:45:21.032068+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:45:21.032068+0000","last_undegraded":"2024-09-21T06:45:21.032068+0000","last_fullsized":"2024-09-21T06:45:21.032068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507129+0000","last_change":"2024-09-21T06:45:19.497733+0000","last_active":"2024-09-21T06:45:20.507129+0000","last_peered":"2024-09-21T06:45:20.507129+0000","last_clean":"2024-09-21T06:45:20.507129+0000","last_became_active":"2024-09-21T06:45:19.496641+0000","last_became_peered":"2024-09-21T06:45:19.496641+0000","last_unstale":"2024-09-21T06:45:20.507129+0000","last_undegraded":"2024-09-21T06:45:20.507129+0000","last_fullsized":"2024-09-21T06:45:20.507129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:51.619714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506921+0000","last_change":"2024-09-21T06:45:15.461030+0000","last_active":"2024-09-21T06:45:20.506921+0000","last_peered":"2024-09-21T06:45:20.506921+0000","last_clean":"2024-09-21T06:45:20.506921+0000","last_became_active":"2024-09-21T06:45:15.460706+0000","last_became_peered":"2024-09-21T06:45:15.460706+0000","last_unstale":"2024-09-21T06:45:20.506921+0000","last_undegraded":"2024-09-21T06:45:20.506921+0000","last_fullsized":"2024-09-21T06:45:20.506921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.152926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.509104+0000","last_change":"2024-09-21T06:45:14.461396+0000","last_active":"2024-09-21T06:45:20.509104+0000","last_peered":"2024-09-21T06:45:20.509104+0000","last_clean":"2024-09-21T06:45:20.509104+0000","last_became_active":"2024-09-21T06:45:14.461060+0000","last_became_peered":"2024-09-21T06:45:14.461060+0000","last_unstale":"2024-09-21T06:45:20.509104+0000","last_undegraded":"2024-09-21T06:45:20.509104+0000","last_fullsized":"2024-09-21T06:45:20.509104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:55.556990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030371+0000","last_change":"2024-09-21T06:45:19.502382+0000","last_active":"2024-09-21T06:45:21.030371+0000","last_peered":"2024-09-21T06:45:21.030371+0000","last_clean":"2024-09-21T06:45:21.030371+0000","last_became_active":"2024-09-21T06:45:19.498046+0000","last_became_peered":"2024-09-21T06:45:19.498046+0000","last_unstale":"2024-09-21T06:45:21.030371+0000","last_undegraded":"2024-09-21T06:45:21.030371+0000","last_fullsized":"2024-09-21T06:45:21.030371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:24.671126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031519+0000","last_change":"2024-09-21T06:45:15.475752+0000","last_active":"2024-09-21T06:45:21.031519+0000","last_peered":"2024-09-21T06:45:21.031519+0000","last_clean":"2024-09-21T06:45:21.031519+0000","last_became_active":"2024-09-21T06:45:15.469527+0000","last_became_peered":"2024-09-21T06:45:15.469527+0000","last_unstale":"2024-09-21T06:45:21.031519+0000","last_undegraded":"2024-09-21T06:45:21.031519+0000","last_fullsized":"2024-09-21T06:45:21.031519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:25:50.777226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031784+0000","last_change":"2024-09-21T06:45:14.465420+0000","last_active":"2024-09-21T06:45:21.031784+0000","last_peered":"2024-09-21T06:45:21.031784+0000","last_clean":"2024-09-21T06:45:21.031784+0000","last_became_active":"2024-09-21T06:45:14.464543+0000","last_became_peered":"2024-09-21T06:45:14.464543+0000","last_unstale":"2024-09-21T06:45:21.031784+0000","last_undegraded":"2024-09-21T06:45:21.031784+0000","last_fullsized":"2024-09-21T06:45:21.031784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031628+0000","last_change":"2024-09-21T06:45:19.498221+0000","last_active":"2024-09-21T06:45:21.031628+0000","last_peered":"2024-09-21T06:45:21.031628+0000","last_clean":"2024-09-21T06:45:21.031628+0000","last_became_active":"2024-09-21T06:45:19.497811+0000","last_became_peered":"2024-09-21T06:45:19.497811+0000","last_unstale":"2024-09-21T06:45:21.031628+0000","last_undegraded":"2024-09-21T06:45:21.031628+0000","last_fullsized":"2024-09-21T06:45:21.031628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.239619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030455+0000","last_change":"2024-09-21T06:45:15.460768+0000","last_active":"2024-09-21T06:45:21.030455+0000","last_peered":"2024-09-21T06:45:21.030455+0000","last_clean":"2024-09-21T06:45:21.030455+0000","last_became_active":"2024-09-21T06:45:15.460450+0000","last_became_peered":"2024-09-21T06:45:15.460450+0000","last_unstale":"2024-09-21T06:45:21.030455+0000","last_undegraded":"2024-09-21T06:45:21.030455+0000","last_fullsized":"2024-09-21T06:45:21.030455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:41.947532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508036+0000","last_change":"2024-09-21T06:45:14.470579+0000","last_active":"2024-09-21T06:45:20.508036+0000","last_peered":"2024-09-21T06:45:20.508036+0000","last_clean":"2024-09-21T06:45:20.508036+0000","last_became_active":"2024-09-21T06:45:14.470201+0000","last_became_peered":"2024-09-21T06:45:14.470201+0000","last_unstale":"2024-09-21T06:45:20.508036+0000","last_undegraded":"2024-09-21T06:45:20.508036+0000","last_fullsized":"2024-09-21T06:45:20.508036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:50.320663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505901+0000","last_change":"2024-09-21T06:45:19.495223+0000","last_active":"2024-09-21T06:45:20.505901+0000","last_peered":"2024-09-21T06:45:20.505901+0000","last_clean":"2024-09-21T06:45:20.505901+0000","last_became_active":"2024-09-21T06:45:19.494717+0000","last_became_peered":"2024-09-21T06:45:19.494717+0000","last_unstale":"2024-09-21T06:45:20.505901+0000","last_undegraded":"2024-09-21T06:45:20.505901+0000","last_fullsized":"2024-09-21T06:45:20.505901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:24.234212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031148+0000","last_change":"2024-09-21T06:45:15.470009+0000","last_active":"2024-09-21T06:45:21.031148+0000","last_peered":"2024-09-21T06:45:21.031148+0000","last_clean":"2024-09-21T06:45:21.031148+0000","last_became_active":"2024-09-21T06:45:15.469587+0000","last_became_peered":"2024-09-21T06:45:15.469587+0000","last_unstale":"2024-09-21T06:45:21.031148+0000","last_undegraded":"2024-09-21T06:45:21.031148+0000","last_fullsized":"2024-09-21T06:45:21.031148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030553+0000","last_change":"2024-09-21T06:45:14.462600+0000","last_active":"2024-09-21T06:45:21.030553+0000","last_peered":"2024-09-21T06:45:21.030553+0000","last_clean":"2024-09-21T06:45:21.030553+0000","last_became_active":"2024-09-21T06:45:14.461889+0000","last_became_peered":"2024-09-21T06:45:14.461889+0000","last_unstale":"2024-09-21T06:45:21.030553+0000","last_undegraded":"2024-09-21T06:45:21.030553+0000","last_fullsized":"2024-09-21T06:45:21.030553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032139+0000","last_change":"2024-09-21T06:45:19.506001+0000","last_active":"2024-09-21T06:45:21.032139+0000","last_peered":"2024-09-21T06:45:21.032139+0000","last_clean":"2024-09-21T06:45:21.032139+0000","last_became_active":"2024-09-21T06:45:19.505578+0000","last_became_peered":"2024-09-21T06:45:19.505578+0000","last_unstale":"2024-09-21T06:45:21.032139+0000","last_undegraded":"2024-09-21T06:45:21.032139+0000","last_fullsized":"2024-09-21T06:45:21.032139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:57.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505958+0000","last_change":"2024-09-21T06:45:15.471185+0000","last_active":"2024-09-21T06:45:20.505958+0000","last_peered":"2024-09-21T06:45:20.505958+0000","last_clean":"2024-09-21T06:45:20.505958+0000","last_became_active":"2024-09-21T06:45:15.470821+0000","last_became_peered":"2024-09-21T06:45:15.470821+0000","last_unstale":"2024-09-21T06:45:20.505958+0000","last_undegraded":"2024-09-21T06:45:20.505958+0000","last_fullsized":"2024-09-21T06:45:20.505958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508648+0000","last_change":"2024-09-21T06:45:14.463644+0000","last_active":"2024-09-21T06:45:20.508648+0000","last_peered":"2024-09-21T06:45:20.508648+0000","last_clean":"2024-09-21T06:45:20.508648+0000","last_became_active":"2024-09-21T06:45:14.463293+0000","last_became_peered":"2024-09-21T06:45:14.463293+0000","last_unstale":"2024-09-21T06:45:20.508648+0000","last_undegraded":"2024-09-21T06:45:20.508648+0000","last_fullsized":"2024-09-21T06:45:20.508648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:29.580518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032313+0000","last_change":"2024-09-21T06:45:19.499445+0000","last_active":"2024-09-21T06:45:21.032313+0000","last_peered":"2024-09-21T06:45:21.032313+0000","last_clean":"2024-09-21T06:45:21.032313+0000","last_became_active":"2024-09-21T06:45:19.499033+0000","last_became_peered":"2024-09-21T06:45:19.499033+0000","last_unstale":"2024-09-21T06:45:21.032313+0000","last_undegraded":"2024-09-21T06:45:21.032313+0000","last_fullsized":"2024-09-21T06:45:21.032313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:57:39.968433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031953+0000","last_change":"2024-09-21T06:45:15.462244+0000","last_active":"2024-09-21T06:45:21.031953+0000","last_peered":"2024-09-21T06:45:21.031953+0000","last_clean":"2024-09-21T06:45:21.031953+0000","last_became_active":"2024-09-21T06:45:15.461962+0000","last_became_peered":"2024-09-21T06:45:15.461962+0000","last_unstale":"2024-09-21T06:45:21.031953+0000","last_undegraded":"2024-09-21T06:45:21.031953+0000","last_fullsized":"2024-09-21T06:45:21.031953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:10.690159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030514+0000","last_change":"2024-09-21T06:45:14.458035+0000","last_active":"2024-09-21T06:45:21.030514+0000","last_peered":"2024-09-21T06:45:21.030514+0000","last_clean":"2024-09-21T06:45:21.030514+0000","last_became_active":"2024-09-21T06:45:14.457478+0000","last_became_peered":"2024-09-21T06:45:14.457478+0000","last_unstale":"2024-09-21T06:45:21.030514+0000","last_undegraded":"2024-09-21T06:45:21.030514+0000","last_fullsized":"2024-09-21T06:45:21.030514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:46.341816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032245+0000","last_change":"2024-09-21T06:45:19.496692+0000","last_active":"2024-09-21T06:45:21.032245+0000","last_peered":"2024-09-21T06:45:21.032245+0000","last_clean":"2024-09-21T06:45:21.032245+0000","last_became_active":"2024-09-21T06:45:19.496273+0000","last_became_peered":"2024-09-21T06:45:19.496273+0000","last_unstale":"2024-09-21T06:45:21.032245+0000","last_undegraded":"2024-09-21T06:45:21.032245+0000","last_fullsized":"2024-09-21T06:45:21.032245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:08.738093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506263+0000","last_change":"2024-09-21T06:45:15.474239+0000","last_active":"2024-09-21T06:45:20.506263+0000","last_peered":"2024-09-21T06:45:20.506263+0000","last_clean":"2024-09-21T06:45:20.506263+0000","last_became_active":"2024-09-21T06:45:15.473936+0000","last_became_peered":"2024-09-21T06:45:15.473936+0000","last_unstale":"2024-09-21T06:45:20.506263+0000","last_undegraded":"2024-09-21T06:45:20.506263+0000","last_fullsized":"2024-09-21T06:45:20.506263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:07.138927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506611+0000","last_change":"2024-09-21T06:45:14.465782+0000","last_active":"2024-09-21T06:45:20.506611+0000","last_peered":"2024-09-21T06:45:20.506611+0000","last_clean":"2024-09-21T06:45:20.506611+0000","last_became_active":"2024-09-21T06:45:14.464892+0000","last_became_peered":"2024-09-21T06:45:14.464892+0000","last_unstale":"2024-09-21T06:45:20.506611+0000","last_undegraded":"2024-09-21T06:45:20.506611+0000","last_fullsized":"2024-09-21T06:45:20.506611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508817+0000","last_change":"2024-09-21T06:45:19.496653+0000","last_active":"2024-09-21T06:45:20.508817+0000","last_peered":"2024-09-21T06:45:20.508817+0000","last_clean":"2024-09-21T06:45:20.508817+0000","last_became_active":"2024-09-21T06:45:19.496215+0000","last_became_peered":"2024-09-21T06:45:19.496215+0000","last_unstale":"2024-09-21T06:45:20.508817+0000","last_undegraded":"2024-09-21T06:45:20.508817+0000","last_fullsized":"2024-09-21T06:45:20.508817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507938+0000","last_change":"2024-09-21T06:45:15.468032+0000","last_active":"2024-09-21T06:45:20.507938+0000","last_peered":"2024-09-21T06:45:20.507938+0000","last_clean":"2024-09-21T06:45:20.507938+0000","last_became_active":"2024-09-21T06:45:15.467695+0000","last_became_peered":"2024-09-21T06:45:15.467695+0000","last_unstale":"2024-09-21T06:45:20.507938+0000","last_undegraded":"2024-09-21T06:45:20.507938+0000","last_fullsized":"2024-09-21T06:45:20.507938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:48.275548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031757+0000","last_change":"2024-09-21T06:45:14.472291+0000","last_active":"2024-09-21T06:45:21.031757+0000","last_peered":"2024-09-21T06:45:21.031757+0000","last_clean":"2024-09-21T06:45:21.031757+0000","last_became_active":"2024-09-21T06:45:14.472043+0000","last_became_peered":"2024-09-21T06:45:14.472043+0000","last_unstale":"2024-09-21T06:45:21.031757+0000","last_undegraded":"2024-09-21T06:45:21.031757+0000","last_fullsized":"2024-09-21T06:45:21.031757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:39.953181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506551+0000","last_change":"2024-09-21T06:45:19.499994+0000","last_active":"2024-09-21T06:45:20.506551+0000","last_peered":"2024-09-21T06:45:20.506551+0000","last_clean":"2024-09-21T06:45:20.506551+0000","last_became_active":"2024-09-21T06:45:19.497222+0000","last_became_peered":"2024-09-21T06:45:19.497222+0000","last_unstale":"2024-09-21T06:45:20.506551+0000","last_undegraded":"2024-09-21T06:45:20.506551+0000","last_fullsized":"2024-09-21T06:45:20.506551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:06:50.997451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030936+0000","last_change":"2024-09-21T06:45:15.477441+0000","last_active":"2024-09-21T06:45:21.030936+0000","last_peered":"2024-09-21T06:45:21.030936+0000","last_clean":"2024-09-21T06:45:21.030936+0000","last_became_active":"2024-09-21T06:45:15.477115+0000","last_became_peered":"2024-09-21T06:45:15.477115+0000","last_unstale":"2024-09-21T06:45:21.030936+0000","last_undegraded":"2024-09-21T06:45:21.030936+0000","last_fullsized":"2024-09-21T06:45:21.030936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:25.111434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:25.309327+0000","last_change":"2024-09-21T06:45:14.469539+0000","last_active":"2024-09-21T06:45:25.309327+0000","last_peered":"2024-09-21T06:45:25.309327+0000","last_clean":"2024-09-21T06:45:25.309327+0000","last_became_active":"2024-09-21T06:45:14.469221+0000","last_became_peered":"2024-09-21T06:45:14.469221+0000","last_unstale":"2024-09-21T06:45:25.309327+0000","last_undegraded":"2024-09-21T06:45:25.309327+0000","last_fullsized":"2024-09-21T06:45:25.309327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:28.598849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507385+0000","last_change":"2024-09-21T06:45:19.506781+0000","last_active":"2024-09-21T06:45:20.507385+0000","last_peered":"2024-09-21T06:45:20.507385+0000","last_clean":"2024-09-21T06:45:20.507385+0000","last_became_active":"2024-09-21T06:45:19.501911+0000","last_became_peered":"2024-09-21T06:45:19.501911+0000","last_unstale":"2024-09-21T06:45:20.507385+0000","last_undegraded":"2024-09-21T06:45:20.507385+0000","last_fullsized":"2024-09-21T06:45:20.507385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:58.566024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506203+0000","last_change":"2024-09-21T06:45:15.468579+0000","last_active":"2024-09-21T06:45:20.506203+0000","last_peered":"2024-09-21T06:45:20.506203+0000","last_clean":"2024-09-21T06:45:20.506203+0000","last_became_active":"2024-09-21T06:45:15.468329+0000","last_became_peered":"2024-09-21T06:45:15.468329+0000","last_unstale":"2024-09-21T06:45:20.506203+0000","last_undegraded":"2024-09-21T06:45:20.506203+0000","last_fullsized":"2024-09-21T06:45:20.506203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:07.302209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032248+0000","last_change":"2024-09-21T06:45:14.469511+0000","last_active":"2024-09-21T06:45:21.032248+0000","last_peered":"2024-09-21T06:45:21.032248+0000","last_clean":"2024-09-21T06:45:21.032248+0000","last_became_active":"2024-09-21T06:45:14.469153+0000","last_became_peered":"2024-09-21T06:45:14.469153+0000","last_unstale":"2024-09-21T06:45:21.032248+0000","last_undegraded":"2024-09-21T06:45:21.032248+0000","last_fullsized":"2024-09-21T06:45:21.032248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:21.542258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030751+0000","last_change":"2024-09-21T06:45:19.506219+0000","last_active":"2024-09-21T06:45:21.030751+0000","last_peered":"2024-09-21T06:45:21.030751+0000","last_clean":"2024-09-21T06:45:21.030751+0000","last_became_active":"2024-09-21T06:45:19.505827+0000","last_became_peered":"2024-09-21T06:45:19.505827+0000","last_unstale":"2024-09-21T06:45:21.030751+0000","last_undegraded":"2024-09-21T06:45:21.030751+0000","last_fullsized":"2024-09-21T06:45:21.030751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:15.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032207+0000","last_change":"2024-09-21T06:45:15.467787+0000","last_active":"2024-09-21T06:45:21.032207+0000","last_peered":"2024-09-21T06:45:21.032207+0000","last_clean":"2024-09-21T06:45:21.032207+0000","last_became_active":"2024-09-21T06:45:15.467470+0000","last_became_peered":"2024-09-21T06:45:15.467470+0000","last_unstale":"2024-09-21T06:45:21.032207+0000","last_undegraded":"2024-09-21T06:45:21.032207+0000","last_fullsized":"2024-09-21T06:45:21.032207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030710+0000","last_change":"2024-09-21T06:45:14.466812+0000","last_active":"2024-09-21T06:45:21.030710+0000","last_peered":"2024-09-21T06:45:21.030710+0000","last_clean":"2024-09-21T06:45:21.030710+0000","last_became_active":"2024-09-21T06:45:14.466356+0000","last_became_peered":"2024-09-21T06:45:14.466356+0000","last_unstale":"2024-09-21T06:45:21.030710+0000","last_undegraded":"2024-09-21T06:45:21.030710+0000","last_fullsized":"2024-09-21T06:45:21.030710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:45.791653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030568+0000","last_change":"2024-09-21T06:45:19.504492+0000","last_active":"2024-09-21T06:45:21.030568+0000","last_peered":"2024-09-21T06:45:21.030568+0000","last_clean":"2024-09-21T06:45:21.030568+0000","last_became_active":"2024-09-21T06:45:19.503845+0000","last_became_peered":"2024-09-21T06:45:19.503845+0000","last_unstale":"2024-09-21T06:45:21.030568+0000","last_undegraded":"2024-09-21T06:45:21.030568+0000","last_fullsized":"2024-09-21T06:45:21.030568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:50.206431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031079+0000","last_change":"2024-09-21T06:45:15.467027+0000","last_active":"2024-09-21T06:45:21.031079+0000","last_peered":"2024-09-21T06:45:21.031079+0000","last_clean":"2024-09-21T06:45:21.031079+0000","last_became_active":"2024-09-21T06:45:15.466419+0000","last_became_peered":"2024-09-21T06:45:15.466419+0000","last_unstale":"2024-09-21T06:45:21.031079+0000","last_undegraded":"2024-09-21T06:45:21.031079+0000","last_fullsized":"2024-09-21T06:45:21.031079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:49.790041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032027+0000","last_change":"2024-09-21T06:45:14.467184+0000","last_active":"2024-09-21T06:45:21.032027+0000","last_peered":"2024-09-21T06:45:21.032027+0000","last_clean":"2024-09-21T06:45:21.032027+0000","last_became_active":"2024-09-21T06:45:14.466888+0000","last_became_peered":"2024-09-21T06:45:14.466888+0000","last_unstale":"2024-09-21T06:45:21.032027+0000","last_undegraded":"2024-09-21T06:45:21.032027+0000","last_fullsized":"2024-09-21T06:45:21.032027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:14.862437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507441+0000","last_change":"2024-09-21T06:45:19.502432+0000","last_active":"2024-09-21T06:45:20.507441+0000","last_peered":"2024-09-21T06:45:20.507441+0000","last_clean":"2024-09-21T06:45:20.507441+0000","last_became_active":"2024-09-21T06:45:19.501859+0000","last_became_peered":"2024-09-21T06:45:19.501859+0000","last_unstale":"2024-09-21T06:45:20.507441+0000","last_undegraded":"2024-09-21T06:45:20.507441+0000","last_fullsized":"2024-09-21T06:45:20.507441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.798057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507823+0000","last_change":"2024-09-21T06:45:19.500757+0000","last_active":"2024-09-21T06:45:20.507823+0000","last_peered":"2024-09-21T06:45:20.507823+0000","last_clean":"2024-09-21T06:45:20.507823+0000","last_became_active":"2024-09-21T06:45:19.500330+0000","last_became_peered":"2024-09-21T06:45:19.500330+0000","last_unstale":"2024-09-21T06:45:20.507823+0000","last_undegraded":"2024-09-21T06:45:20.507823+0000","last_fullsized":"2024-09-21T06:45:20.507823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:54.472367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507536+0000","last_change":"2024-09-21T06:45:15.468255+0000","last_active":"2024-09-21T06:45:20.507536+0000","last_peered":"2024-09-21T06:45:20.507536+0000","last_clean":"2024-09-21T06:45:20.507536+0000","last_became_active":"2024-09-21T06:45:15.467926+0000","last_became_peered":"2024-09-21T06:45:15.467926+0000","last_unstale":"2024-09-21T06:45:20.507536+0000","last_undegraded":"2024-09-21T06:45:20.507536+0000","last_fullsized":"2024-09-21T06:45:20.507536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:46.878776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506248+0000","last_change":"2024-09-21T06:45:14.469185+0000","last_active":"2024-09-21T06:45:20.506248+0000","last_peered":"2024-09-21T06:45:20.506248+0000","last_clean":"2024-09-21T06:45:20.506248+0000","last_became_active":"2024-09-21T06:45:14.468890+0000","last_became_peered":"2024-09-21T06:45:14.468890+0000","last_unstale":"2024-09-21T06:45:20.506248+0000","last_undegraded":"2024-09-21T06:45:20.506248+0000","last_fullsized":"2024-09-21T06:45:20.506248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:59.963412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506605+0000","last_change":"2024-09-21T06:45:19.499608+0000","last_active":"2024-09-21T06:45:20.506605+0000","last_peered":"2024-09-21T06:45:20.506605+0000","last_clean":"2024-09-21T06:45:20.506605+0000","last_became_active":"2024-09-21T06:45:19.498220+0000","last_became_peered":"2024-09-21T06:45:19.498220+0000","last_unstale":"2024-09-21T06:45:20.506605+0000","last_undegraded":"2024-09-21T06:45:20.506605+0000","last_fullsized":"2024-09-21T06:45:20.506605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:22.588015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030646+0000","last_change":"2024-09-21T06:45:15.470401+0000","last_active":"2024-09-21T06:45:21.030646+0000","last_peered":"2024-09-21T06:45:21.030646+0000","last_clean":"2024-09-21T06:45:21.030646+0000","last_became_active":"2024-09-21T06:45:15.469676+0000","last_became_peered":"2024-09-21T06:45:15.469676+0000","last_unstale":"2024-09-21T06:45:21.030646+0000","last_undegraded":"2024-09-21T06:45:21.030646+0000","last_fullsized":"2024-09-21T06:45:21.030646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:30.526703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506888+0000","last_change":"2024-09-21T06:45:14.468923+0000","last_active":"2024-09-21T06:45:20.506888+0000","last_peered":"2024-09-21T06:45:20.506888+0000","last_clean":"2024-09-21T06:45:20.506888+0000","last_became_active":"2024-09-21T06:45:14.468591+0000","last_became_peered":"2024-09-21T06:45:14.468591+0000","last_unstale":"2024-09-21T06:45:20.506888+0000","last_undegraded":"2024-09-21T06:45:20.506888+0000","last_fullsized":"2024-09-21T06:45:20.506888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:28:25.844164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506904+0000","last_change":"2024-09-21T06:45:14.466145+0000","last_active":"2024-09-21T06:45:20.506904+0000","last_peered":"2024-09-21T06:45:20.506904+0000","last_clean":"2024-09-21T06:45:20.506904+0000","last_became_active":"2024-09-21T06:45:14.465260+0000","last_became_peered":"2024-09-21T06:45:14.465260+0000","last_unstale":"2024-09-21T06:45:20.506904+0000","last_undegraded":"2024-09-21T06:45:20.506904+0000","last_fullsized":"2024-09-21T06:45:20.506904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:18.506269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507474+0000","last_change":"2024-09-21T06:45:15.479102+0000","last_active":"2024-09-21T06:45:20.507474+0000","last_peered":"2024-09-21T06:45:20.507474+0000","last_clean":"2024-09-21T06:45:20.507474+0000","last_became_active":"2024-09-21T06:45:15.477931+0000","last_became_peered":"2024-09-21T06:45:15.477931+0000","last_unstale":"2024-09-21T06:45:20.507474+0000","last_undegraded":"2024-09-21T06:45:20.507474+0000","last_fullsized":"2024-09-21T06:45:20.507474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:15.776123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508961+0000","last_change":"2024-09-21T06:45:19.496596+0000","last_active":"2024-09-21T06:45:20.508961+0000","last_peered":"2024-09-21T06:45:20.508961+0000","last_clean":"2024-09-21T06:45:20.508961+0000","last_became_active":"2024-09-21T06:45:19.496164+0000","last_became_peered":"2024-09-21T06:45:19.496164+0000","last_unstale":"2024-09-21T06:45:20.508961+0000","last_undegraded":"2024-09-21T06:45:20.508961+0000","last_fullsized":"2024-09-21T06:45:20.508961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:50.753263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031547+0000","last_change":"2024-09-21T06:45:14.465515+0000","last_active":"2024-09-21T06:45:21.031547+0000","last_peered":"2024-09-21T06:45:21.031547+0000","last_clean":"2024-09-21T06:45:21.031547+0000","last_became_active":"2024-09-21T06:45:14.464349+0000","last_became_peered":"2024-09-21T06:45:14.464349+0000","last_unstale":"2024-09-21T06:45:21.031547+0000","last_undegraded":"2024-09-21T06:45:21.031547+0000","last_fullsized":"2024-09-21T06:45:21.031547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:13.431554+0000","last_clean_scrub_stamp":"2024-09-21T06:45:13.431554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:52.209684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031752+0000","last_change":"2024-09-21T06:45:15.462226+0000","last_active":"2024-09-21T06:45:21.031752+0000","last_peered":"2024-09-21T06:45:21.031752+0000","last_clean":"2024-09-21T06:45:21.031752+0000","last_became_active":"2024-09-21T06:45:15.461939+0000","last_became_peered":"2024-09-21T06:45:15.461939+0000","last_unstale":"2024-09-21T06:45:21.031752+0000","last_undegraded":"2024-09-21T06:45:21.031752+0000","last_fullsized":"2024-09-21T06:45:21.031752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.032165+0000","last_change":"2024-09-21T06:45:19.503463+0000","last_active":"2024-09-21T06:45:21.032165+0000","last_peered":"2024-09-21T06:45:21.032165+0000","last_clean":"2024-09-21T06:45:21.032165+0000","last_became_active":"2024-09-21T06:45:19.502870+0000","last_became_peered":"2024-09-21T06:45:19.502870+0000","last_unstale":"2024-09-21T06:45:21.032165+0000","last_undegraded":"2024-09-21T06:45:21.032165+0000","last_fullsized":"2024-09-21T06:45:21.032165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:18.470612+0000","last_clean_scrub_stamp":"2024-09-21T06:45:18.470612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:24:41.524948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030040+0000","last_change":"2024-09-21T06:45:15.469971+0000","last_active":"2024-09-21T06:45:21.030040+0000","last_peered":"2024-09-21T06:45:21.030040+0000","last_clean":"2024-09-21T06:45:21.030040+0000","last_became_active":"2024-09-21T06:45:15.469549+0000","last_became_peered":"2024-09-21T06:45:15.469549+0000","last_unstale":"2024-09-21T06:45:21.030040+0000","last_undegraded":"2024-09-21T06:45:21.030040+0000","last_fullsized":"2024-09-21T06:45:21.030040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030790+0000","last_change":"2024-09-21T06:45:15.467015+0000","last_active":"2024-09-21T06:45:21.030790+0000","last_peered":"2024-09-21T06:45:21.030790+0000","last_clean":"2024-09-21T06:45:21.030790+0000","last_became_active":"2024-09-21T06:45:15.466693+0000","last_became_peered":"2024-09-21T06:45:15.466693+0000","last_unstale":"2024-09-21T06:45:21.030790+0000","last_undegraded":"2024-09-21T06:45:21.030790+0000","last_fullsized":"2024-09-21T06:45:21.030790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:18.412324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506161+0000","last_change":"2024-09-21T06:45:15.464050+0000","last_active":"2024-09-21T06:45:20.506161+0000","last_peered":"2024-09-21T06:45:20.506161+0000","last_clean":"2024-09-21T06:45:20.506161+0000","last_became_active":"2024-09-21T06:45:15.463716+0000","last_became_peered":"2024-09-21T06:45:15.463716+0000","last_unstale":"2024-09-21T06:45:20.506161+0000","last_undegraded":"2024-09-21T06:45:20.506161+0000","last_fullsized":"2024-09-21T06:45:20.506161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:06.081721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031406+0000","last_change":"2024-09-21T06:45:15.462023+0000","last_active":"2024-09-21T06:45:21.031406+0000","last_peered":"2024-09-21T06:45:21.031406+0000","last_clean":"2024-09-21T06:45:21.031406+0000","last_became_active":"2024-09-21T06:45:15.461673+0000","last_became_peered":"2024-09-21T06:45:15.461673+0000","last_unstale":"2024-09-21T06:45:21.031406+0000","last_undegraded":"2024-09-21T06:45:21.031406+0000","last_fullsized":"2024-09-21T06:45:21.031406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:34.273188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508975+0000","last_change":"2024-09-21T06:45:15.476773+0000","last_active":"2024-09-21T06:45:20.508975+0000","last_peered":"2024-09-21T06:45:20.508975+0000","last_clean":"2024-09-21T06:45:20.508975+0000","last_became_active":"2024-09-21T06:45:15.476452+0000","last_became_peered":"2024-09-21T06:45:15.476452+0000","last_unstale":"2024-09-21T06:45:20.508975+0000","last_undegraded":"2024-09-21T06:45:20.508975+0000","last_fullsized":"2024-09-21T06:45:20.508975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507490+0000","last_change":"2024-09-21T06:45:15.476075+0000","last_active":"2024-09-21T06:45:20.507490+0000","last_peered":"2024-09-21T06:45:20.507490+0000","last_clean":"2024-09-21T06:45:20.507490+0000","last_became_active":"2024-09-21T06:45:15.475645+0000","last_became_peered":"2024-09-21T06:45:15.475645+0000","last_unstale":"2024-09-21T06:45:20.507490+0000","last_undegraded":"2024-09-21T06:45:20.507490+0000","last_fullsized":"2024-09-21T06:45:20.507490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:11.856243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031037+0000","last_change":"2024-09-21T06:45:15.467350+0000","last_active":"2024-09-21T06:45:21.031037+0000","last_peered":"2024-09-21T06:45:21.031037+0000","last_clean":"2024-09-21T06:45:21.031037+0000","last_became_active":"2024-09-21T06:45:15.466738+0000","last_became_peered":"2024-09-21T06:45:15.466738+0000","last_unstale":"2024-09-21T06:45:21.031037+0000","last_undegraded":"2024-09-21T06:45:21.031037+0000","last_fullsized":"2024-09-21T06:45:21.031037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031917+0000","last_change":"2024-09-21T06:45:15.474042+0000","last_active":"2024-09-21T06:45:21.031917+0000","last_peered":"2024-09-21T06:45:21.031917+0000","last_clean":"2024-09-21T06:45:21.031917+0000","last_became_active":"2024-09-21T06:45:15.472921+0000","last_became_peered":"2024-09-21T06:45:15.472921+0000","last_unstale":"2024-09-21T06:45:21.031917+0000","last_undegraded":"2024-09-21T06:45:21.031917+0000","last_fullsized":"2024-09-21T06:45:21.031917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:55.714050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506242+0000","last_change":"2024-09-21T06:45:15.465615+0000","last_active":"2024-09-21T06:45:20.506242+0000","last_peered":"2024-09-21T06:45:20.506242+0000","last_clean":"2024-09-21T06:45:20.506242+0000","last_became_active":"2024-09-21T06:45:15.465295+0000","last_became_peered":"2024-09-21T06:45:15.465295+0000","last_unstale":"2024-09-21T06:45:20.506242+0000","last_undegraded":"2024-09-21T06:45:20.506242+0000","last_fullsized":"2024-09-21T06:45:20.506242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:49.579027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030830+0000","last_change":"2024-09-21T06:45:15.471829+0000","last_active":"2024-09-21T06:45:21.030830+0000","last_peered":"2024-09-21T06:45:21.030830+0000","last_clean":"2024-09-21T06:45:21.030830+0000","last_became_active":"2024-09-21T06:45:15.470063+0000","last_became_peered":"2024-09-21T06:45:15.470063+0000","last_unstale":"2024-09-21T06:45:21.030830+0000","last_undegraded":"2024-09-21T06:45:21.030830+0000","last_fullsized":"2024-09-21T06:45:21.030830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031632+0000","last_change":"2024-09-21T06:45:15.460833+0000","last_active":"2024-09-21T06:45:21.031632+0000","last_peered":"2024-09-21T06:45:21.031632+0000","last_clean":"2024-09-21T06:45:21.031632+0000","last_became_active":"2024-09-21T06:45:15.460524+0000","last_became_peered":"2024-09-21T06:45:15.460524+0000","last_unstale":"2024-09-21T06:45:21.031632+0000","last_undegraded":"2024-09-21T06:45:21.031632+0000","last_fullsized":"2024-09-21T06:45:21.031632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:46.796723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507357+0000","last_change":"2024-09-21T06:45:15.468655+0000","last_active":"2024-09-21T06:45:20.507357+0000","last_peered":"2024-09-21T06:45:20.507357+0000","last_clean":"2024-09-21T06:45:20.507357+0000","last_became_active":"2024-09-21T06:45:15.468310+0000","last_became_peered":"2024-09-21T06:45:15.468310+0000","last_unstale":"2024-09-21T06:45:20.507357+0000","last_undegraded":"2024-09-21T06:45:20.507357+0000","last_fullsized":"2024-09-21T06:45:20.507357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:04.753340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031414+0000","last_change":"2024-09-21T06:45:15.470151+0000","last_active":"2024-09-21T06:45:21.031414+0000","last_peered":"2024-09-21T06:45:21.031414+0000","last_clean":"2024-09-21T06:45:21.031414+0000","last_became_active":"2024-09-21T06:45:15.469649+0000","last_became_peered":"2024-09-21T06:45:15.469649+0000","last_unstale":"2024-09-21T06:45:21.031414+0000","last_undegraded":"2024-09-21T06:45:21.031414+0000","last_fullsized":"2024-09-21T06:45:21.031414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:37.996645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507052+0000","last_change":"2024-09-21T06:45:15.461412+0000","last_active":"2024-09-21T06:45:20.507052+0000","last_peered":"2024-09-21T06:45:20.507052+0000","last_clean":"2024-09-21T06:45:20.507052+0000","last_became_active":"2024-09-21T06:45:15.461063+0000","last_became_peered":"2024-09-21T06:45:15.461063+0000","last_unstale":"2024-09-21T06:45:20.507052+0000","last_undegraded":"2024-09-21T06:45:20.507052+0000","last_fullsized":"2024-09-21T06:45:20.507052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:15.663968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031669+0000","last_change":"2024-09-21T06:45:15.471096+0000","last_active":"2024-09-21T06:45:21.031669+0000","last_peered":"2024-09-21T06:45:21.031669+0000","last_clean":"2024-09-21T06:45:21.031669+0000","last_became_active":"2024-09-21T06:45:15.470745+0000","last_became_peered":"2024-09-21T06:45:15.470745+0000","last_unstale":"2024-09-21T06:45:21.031669+0000","last_undegraded":"2024-09-21T06:45:21.031669+0000","last_fullsized":"2024-09-21T06:45:21.031669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.506933+0000","last_change":"2024-09-21T06:45:15.471359+0000","last_active":"2024-09-21T06:45:20.506933+0000","last_peered":"2024-09-21T06:45:20.506933+0000","last_clean":"2024-09-21T06:45:20.506933+0000","last_became_active":"2024-09-21T06:45:15.471058+0000","last_became_peered":"2024-09-21T06:45:15.471058+0000","last_unstale":"2024-09-21T06:45:20.506933+0000","last_undegraded":"2024-09-21T06:45:20.506933+0000","last_fullsized":"2024-09-21T06:45:20.506933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:16.265829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.505982+0000","last_change":"2024-09-21T06:45:15.468454+0000","last_active":"2024-09-21T06:45:20.505982+0000","last_peered":"2024-09-21T06:45:20.505982+0000","last_clean":"2024-09-21T06:45:20.505982+0000","last_became_active":"2024-09-21T06:45:15.468156+0000","last_became_peered":"2024-09-21T06:45:15.468156+0000","last_unstale":"2024-09-21T06:45:20.505982+0000","last_undegraded":"2024-09-21T06:45:20.505982+0000","last_fullsized":"2024-09-21T06:45:20.505982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:15.219080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030537+0000","last_change":"2024-09-21T06:45:15.473222+0000","last_active":"2024-09-21T06:45:21.030537+0000","last_peered":"2024-09-21T06:45:21.030537+0000","last_clean":"2024-09-21T06:45:21.030537+0000","last_became_active":"2024-09-21T06:45:15.470238+0000","last_became_peered":"2024-09-21T06:45:15.470238+0000","last_unstale":"2024-09-21T06:45:21.030537+0000","last_undegraded":"2024-09-21T06:45:21.030537+0000","last_fullsized":"2024-09-21T06:45:21.030537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:15.814240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.507835+0000","last_change":"2024-09-21T06:45:15.469249+0000","last_active":"2024-09-21T06:45:20.507835+0000","last_peered":"2024-09-21T06:45:20.507835+0000","last_clean":"2024-09-21T06:45:20.507835+0000","last_became_active":"2024-09-21T06:45:15.468891+0000","last_became_peered":"2024-09-21T06:45:15.468891+0000","last_unstale":"2024-09-21T06:45:20.507835+0000","last_undegraded":"2024-09-21T06:45:20.507835+0000","last_fullsized":"2024-09-21T06:45:20.507835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:30.588823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:20.508365+0000","last_change":"2024-09-21T06:45:15.474819+0000","last_active":"2024-09-21T06:45:20.508365+0000","last_peered":"2024-09-21T06:45:20.508365+0000","last_clean":"2024-09-21T06:45:20.508365+0000","last_became_active":"2024-09-21T06:45:15.474480+0000","last_became_peered":"2024-09-21T06:45:15.474480+0000","last_unstale":"2024-09-21T06:45:20.508365+0000","last_undegraded":"2024-09-21T06:45:20.508365+0000","last_fullsized":"2024-09-21T06:45:20.508365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:33.846712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031351+0000","last_change":"2024-09-21T06:45:15.470503+0000","last_active":"2024-09-21T06:45:21.031351+0000","last_peered":"2024-09-21T06:45:21.031351+0000","last_clean":"2024-09-21T06:45:21.031351+0000","last_became_active":"2024-09-21T06:45:15.469857+0000","last_became_peered":"2024-09-21T06:45:15.469857+0000","last_unstale":"2024-09-21T06:45:21.031351+0000","last_undegraded":"2024-09-21T06:45:21.031351+0000","last_fullsized":"2024-09-21T06:45:21.031351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:34.105261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030846+0000","last_change":"2024-09-21T06:45:15.476713+0000","last_active":"2024-09-21T06:45:21.030846+0000","last_peered":"2024-09-21T06:45:21.030846+0000","last_clean":"2024-09-21T06:45:21.030846+0000","last_became_active":"2024-09-21T06:45:15.476116+0000","last_became_peered":"2024-09-21T06:45:15.476116+0000","last_unstale":"2024-09-21T06:45:21.030846+0000","last_undegraded":"2024-09-21T06:45:21.030846+0000","last_fullsized":"2024-09-21T06:45:21.030846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:23:38.613487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030607+0000","last_change":"2024-09-21T06:45:15.477443+0000","last_active":"2024-09-21T06:45:21.030607+0000","last_peered":"2024-09-21T06:45:21.030607+0000","last_clean":"2024-09-21T06:45:21.030607+0000","last_became_active":"2024-09-21T06:45:15.476960+0000","last_became_peered":"2024-09-21T06:45:15.476960+0000","last_unstale":"2024-09-21T06:45:21.030607+0000","last_undegraded":"2024-09-21T06:45:21.030607+0000","last_fullsized":"2024-09-21T06:45:21.030607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:20:43.798724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031952+0000","last_change":"2024-09-21T06:45:15.463639+0000","last_active":"2024-09-21T06:45:21.031952+0000","last_peered":"2024-09-21T06:45:21.031952+0000","last_clean":"2024-09-21T06:45:21.031952+0000","last_became_active":"2024-09-21T06:45:15.463208+0000","last_became_peered":"2024-09-21T06:45:15.463208+0000","last_unstale":"2024-09-21T06:45:21.031952+0000","last_undegraded":"2024-09-21T06:45:21.031952+0000","last_fullsized":"2024-09-21T06:45:21.031952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:42.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030528+0000","last_change":"2024-09-21T06:45:15.473790+0000","last_active":"2024-09-21T06:45:21.030528+0000","last_peered":"2024-09-21T06:45:21.030528+0000","last_clean":"2024-09-21T06:45:21.030528+0000","last_became_active":"2024-09-21T06:45:15.472962+0000","last_became_peered":"2024-09-21T06:45:15.472962+0000","last_unstale":"2024-09-21T06:45:21.030528+0000","last_undegraded":"2024-09-21T06:45:21.030528+0000","last_fullsized":"2024-09-21T06:45:21.030528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:47.239754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030418+0000","last_change":"2024-09-21T06:45:15.469545+0000","last_active":"2024-09-21T06:45:21.030418+0000","last_peered":"2024-09-21T06:45:21.030418+0000","last_clean":"2024-09-21T06:45:21.030418+0000","last_became_active":"2024-09-21T06:45:15.469169+0000","last_became_peered":"2024-09-21T06:45:15.469169+0000","last_unstale":"2024-09-21T06:45:21.030418+0000","last_undegraded":"2024-09-21T06:45:21.030418+0000","last_fullsized":"2024-09-21T06:45:21.030418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030577+0000","last_change":"2024-09-21T06:45:15.466759+0000","last_active":"2024-09-21T06:45:21.030577+0000","last_peered":"2024-09-21T06:45:21.030577+0000","last_clean":"2024-09-21T06:45:21.030577+0000","last_became_active":"2024-09-21T06:45:15.466478+0000","last_became_peered":"2024-09-21T06:45:15.466478+0000","last_unstale":"2024-09-21T06:45:21.030577+0000","last_undegraded":"2024-09-21T06:45:21.030577+0000","last_fullsized":"2024-09-21T06:45:21.030577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:00.968482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030244+0000","last_change":"2024-09-21T06:45:15.472637+0000","last_active":"2024-09-21T06:45:21.030244+0000","last_peered":"2024-09-21T06:45:21.030244+0000","last_clean":"2024-09-21T06:45:21.030244+0000","last_became_active":"2024-09-21T06:45:15.470326+0000","last_became_peered":"2024-09-21T06:45:15.470326+0000","last_unstale":"2024-09-21T06:45:21.030244+0000","last_undegraded":"2024-09-21T06:45:21.030244+0000","last_fullsized":"2024-09-21T06:45:21.030244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:20.637139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030961+0000","last_change":"2024-09-21T06:45:15.461625+0000","last_active":"2024-09-21T06:45:21.030961+0000","last_peered":"2024-09-21T06:45:21.030961+0000","last_clean":"2024-09-21T06:45:21.030961+0000","last_became_active":"2024-09-21T06:45:15.461296+0000","last_became_peered":"2024-09-21T06:45:15.461296+0000","last_unstale":"2024-09-21T06:45:21.030961+0000","last_undegraded":"2024-09-21T06:45:21.030961+0000","last_fullsized":"2024-09-21T06:45:21.030961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:36:19.511339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031625+0000","last_change":"2024-09-21T06:45:15.474538+0000","last_active":"2024-09-21T06:45:21.031625+0000","last_peered":"2024-09-21T06:45:21.031625+0000","last_clean":"2024-09-21T06:45:21.031625+0000","last_became_active":"2024-09-21T06:45:15.474164+0000","last_became_peered":"2024-09-21T06:45:15.474164+0000","last_unstale":"2024-09-21T06:45:21.031625+0000","last_undegraded":"2024-09-21T06:45:21.031625+0000","last_fullsized":"2024-09-21T06:45:21.031625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:08.489330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.031957+0000","last_change":"2024-09-21T06:45:15.475008+0000","last_active":"2024-09-21T06:45:21.031957+0000","last_peered":"2024-09-21T06:45:21.031957+0000","last_clean":"2024-09-21T06:45:21.031957+0000","last_became_active":"2024-09-21T06:45:15.474621+0000","last_became_peered":"2024-09-21T06:45:15.474621+0000","last_unstale":"2024-09-21T06:45:21.031957+0000","last_undegraded":"2024-09-21T06:45:21.031957+0000","last_fullsized":"2024-09-21T06:45:21.031957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:11.838541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-21T06:45:21.030146+0000","last_change":"2024-09-21T06:45:15.463461+0000","last_active":"2024-09-21T06:45:21.030146+0000","last_peered":"2024-09-21T06:45:21.030146+0000","last_clean":"2024-09-21T06:45:21.030146+0000","last_became_active":"2024-09-21T06:45:15.463156+0000","last_became_peered":"2024-09-21T06:45:15.463156+0000","last_unstale":"2024-09-21T06:45:21.030146+0000","last_undegraded":"2024-09-21T06:45:21.030146+0000","last_fullsized":"2024-09-21T06:45:21.030146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:14.436624+0000","last_clean_scrub_stamp":"2024-09-21T06:45:14.436624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:00.464870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":868352,"data_stored":696966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":106528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":872448,"data_stored":696988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:45:34.965 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:45:34.965 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T06:45:34.965 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T06:45:34.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T06:45:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 -- 172.21.15.81:0/3957783401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b415c450 msgr2=0x7f99b40d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 --2- 172.21.15.81:0/3957783401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b415c450 0x7f99b40d3220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99b40d3e70 tx=0x7f99b002a560 comp rx=0 tx=0).stop 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 -- 172.21.15.81:0/3957783401 shutdown_connections 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 --2- 172.21.15.81:0/3957783401 >> v2:172.21.15.89:3300/0 conn(0x7f99b40b9c00 0x7f99b40d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 --2- 172.21.15.81:0/3957783401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b415eda0 0x7f99b40b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 --2- 172.21.15.81:0/3957783401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b415c450 0x7f99b40d3220 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 -- 172.21.15.81:0/3957783401 >> 172.21.15.81:0/3957783401 conn(0x7f99b40b7330 msgr2=0x7f99b40b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 -- 172.21.15.81:0/3957783401 shutdown_connections 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.111+0000 7f99baab4640 1 -- 172.21.15.81:0/3957783401 wait complete. 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.113+0000 7f99baab4640 1 Processor -- start 2024-09-21T06:45:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.113+0000 7f99baab4640 1 -- start start 2024-09-21T06:45:35.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99baab4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b40b9c00 0x7f99b406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99baab4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b415c450 0x7f99b4158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99baab4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b415eda0 0x7f99b40d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99baab4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99b40b3230 con 0x7f99b40b9c00 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99baab4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f99b40d4ae0 con 0x7f99b415c450 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99baab4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f99b40b33b0 con 0x7f99b415eda0 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b40b9c00 0x7f99b406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b40b9c00 0x7f99b406f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55036/0 (socket says 172.21.15.81:55036) 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 -- 172.21.15.81:0/3640930951 learned_addr learned my addr 172.21.15.81:0/3640930951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99abfff640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b415c450 0x7f99b4158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b9051640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b415eda0 0x7f99b40d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 -- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b415eda0 msgr2=0x7f99b40d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b415eda0 0x7f99b40d0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 -- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b415c450 msgr2=0x7f99b4158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b415c450 0x7f99b4158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.114+0000 7f99b8850640 1 -- 172.21.15.81:0/3640930951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b41575b0 con 0x7f99b40b9c00 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.115+0000 7f99b8850640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b40b9c00 0x7f99b406f530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f99b0000c00 tx=0x7f99b00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.115+0000 7f99a97fa640 1 -- 172.21.15.81:0/3640930951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b003e030 con 0x7f99b40b9c00 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.115+0000 7f99a97fa640 1 -- 172.21.15.81:0/3640930951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99b00047a0 con 0x7f99b40b9c00 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.115+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b41593f0 con 0x7f99b40b9c00 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.115+0000 7f99a97fa640 1 -- 172.21.15.81:0/3640930951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0035040 con 0x7f99b40b9c00 2024-09-21T06:45:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.115+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b41f5880 con 0x7f99b40b9c00 2024-09-21T06:45:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.116+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b408d110 con 0x7f99b40b9c00 2024-09-21T06:45:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.117+0000 7f99a97fa640 1 -- 172.21.15.81:0/3640930951 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99b0041030 con 0x7f99b40b9c00 2024-09-21T06:45:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.117+0000 7f99a97fa640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f99a0078bc0 0x7f99a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.117+0000 7f99a97fa640 1 -- 172.21.15.81:0/3640930951 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f99b00bb950 con 0x7f99b40b9c00 2024-09-21T06:45:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.117+0000 7f99abfff640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f99a0078bc0 0x7f99a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.118+0000 7f99abfff640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f99a0078bc0 0x7f99a007b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99b41f9a60 tx=0x7f99a4005b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.122+0000 7f99a97fa640 1 -- 172.21.15.81:0/3640930951 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f99b408d110 con 0x7f99b40b9c00 2024-09-21T06:45:35.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.335+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f99b40b3870 con 0x7f99b40b9c00 2024-09-21T06:45:35.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.336+0000 7f99a97fa640 1 -- 172.21.15.81:0/3640930951 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f99b008c030 con 0x7f99b40b9c00 2024-09-21T06:45:35.337 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:35.337 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T06:45:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f99a0078bc0 msgr2=0x7f99a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f99a0078bc0 0x7f99a007b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99b41f9a60 tx=0x7f99a4005b60 comp rx=0 tx=0).stop 2024-09-21T06:45:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b40b9c00 msgr2=0x7f99b406f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b40b9c00 0x7f99b406f530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f99b0000c00 tx=0x7f99b00039e0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 shutdown_connections 2024-09-21T06:45:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f99a0078bc0 0x7f99a007b0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b415eda0 0x7f99b40d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b415c450 0x7f99b4158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 --2- 172.21.15.81:0/3640930951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b40b9c00 0x7f99b406f530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 >> 172.21.15.81:0/3640930951 conn(0x7f99b40b7330 msgr2=0x7f99b415c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 shutdown_connections 2024-09-21T06:45:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.338+0000 7f99baab4640 1 -- 172.21.15.81:0/3640930951 wait complete. 2024-09-21T06:45:35.351 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T06:45:35.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.463+0000 7f941f77b640 1 -- 172.21.15.81:0/2627728094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 msgr2=0x7f9400003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.463+0000 7f941f77b640 1 --2- 172.21.15.81:0/2627728094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f9400003ec0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9408001dc0 tx=0x7f9400005830 comp rx=0 tx=0).stop 2024-09-21T06:45:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.463+0000 7f941f77b640 1 -- 172.21.15.81:0/2627728094 shutdown_connections 2024-09-21T06:45:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.463+0000 7f941f77b640 1 --2- 172.21.15.81:0/2627728094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f9400003ec0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.463+0000 7f941f77b640 1 -- 172.21.15.81:0/2627728094 >> 172.21.15.81:0/2627728094 conn(0x7f94180d25e0 msgr2=0x7f94180d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.464+0000 7f941f77b640 1 -- 172.21.15.81:0/2627728094 shutdown_connections 2024-09-21T06:45:35.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.464+0000 7f941f77b640 1 -- 172.21.15.81:0/2627728094 wait complete. 2024-09-21T06:45:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.465+0000 7f941f77b640 1 Processor -- start 2024-09-21T06:45:35.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.465+0000 7f941f77b640 1 -- start start 2024-09-21T06:45:35.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941f77b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f94181f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941f77b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94180c5a90 0x7f94181f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941f77b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94181f6ac0 0x7f94181f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941f77b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94181601c0 con 0x7f9400003a50 2024-09-21T06:45:35.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941f77b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f941815dbb0 con 0x7f94180c5a90 2024-09-21T06:45:35.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941f77b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9418160340 con 0x7f94181f6ac0 2024-09-21T06:45:35.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f94181f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f94181f0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55048/0 (socket says 172.21.15.81:55048) 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 -- 172.21.15.81:0/2282706371 learned_addr learned my addr 172.21.15.81:0/2282706371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941dd18640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94181f6ac0 0x7f94181f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941cd16640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94180c5a90 0x7f94181f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 -- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94181f6ac0 msgr2=0x7f94181f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94181f6ac0 0x7f94181f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 -- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94180c5a90 msgr2=0x7f94181f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94180c5a90 0x7f94181f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 -- 172.21.15.81:0/2282706371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94180b5320 con 0x7f9400003a50 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941d517640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f94181f0340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9408001ee0 tx=0x7f9408003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f9415ffb640 1 -- 172.21.15.81:0/2282706371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9408006460 con 0x7f9400003a50 2024-09-21T06:45:35.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f9415ffb640 1 -- 172.21.15.81:0/2282706371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94080066f0 con 0x7f9400003a50 2024-09-21T06:45:35.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94180cb2e0 con 0x7f9400003a50 2024-09-21T06:45:35.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.467+0000 7f9415ffb640 1 -- 172.21.15.81:0/2282706371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94080068c0 con 0x7f9400003a50 2024-09-21T06:45:35.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.468+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94180cb8a0 con 0x7f9400003a50 2024-09-21T06:45:35.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.469+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94180b1be0 con 0x7f9400003a50 2024-09-21T06:45:35.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.469+0000 7f9415ffb640 1 -- 172.21.15.81:0/2282706371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94080336e0 con 0x7f9400003a50 2024-09-21T06:45:35.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.470+0000 7f9415ffb640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9404078bc0 0x7f940407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.470+0000 7f9415ffb640 1 -- 172.21.15.81:0/2282706371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f94080bb1e0 con 0x7f9400003a50 2024-09-21T06:45:35.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.470+0000 7f941cd16640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9404078bc0 0x7f940407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.471+0000 7f941cd16640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9404078bc0 0x7f940407b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f940c005eb0 tx=0x7f940c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.474+0000 7f9415ffb640 1 -- 172.21.15.81:0/2282706371 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f94080832e0 con 0x7f9400003a50 2024-09-21T06:45:35.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.690+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94180d1050 con 0x7f9400003a50 2024-09-21T06:45:35.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.691+0000 7f9415ffb640 1 -- 172.21.15.81:0/2282706371 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7f9408082be0 con 0x7f9400003a50 2024-09-21T06:45:35.692 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:35.692 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:35.693 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:35.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9404078bc0 msgr2=0x7f940407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9404078bc0 0x7f940407b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f940c005eb0 tx=0x7f940c005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 msgr2=0x7f94181f0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f94181f0340 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9408001ee0 tx=0x7f9408003aa0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 shutdown_connections 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9404078bc0 0x7f940407b0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94181f6ac0 0x7f94181f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94180c5a90 0x7f94181f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 --2- 172.21.15.81:0/2282706371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9400003a50 0x7f94181f0340 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 >> 172.21.15.81:0/2282706371 conn(0x7f94180d25e0 msgr2=0x7f941815aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 shutdown_connections 2024-09-21T06:45:35.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.693+0000 7f941f77b640 1 -- 172.21.15.81:0/2282706371 wait complete. 2024-09-21T06:45:35.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 -- 172.21.15.81:0/3392322996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee81601c0 msgr2=0x7f2ee80b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 --2- 172.21.15.81:0/3392322996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee81601c0 0x7f2ee80b1b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2edc005fd0 tx=0x7f2edc02a580 comp rx=0 tx=0).stop 2024-09-21T06:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 -- 172.21.15.81:0/3392322996 shutdown_connections 2024-09-21T06:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 --2- 172.21.15.81:0/3392322996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ee80b20d0 0x7f2ee815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 --2- 172.21.15.81:0/3392322996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee81601c0 0x7f2ee80b1b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 --2- 172.21.15.81:0/3392322996 >> v2:172.21.15.89:3300/0 conn(0x7f2ee80d19a0 0x7f2ee815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 -- 172.21.15.81:0/3392322996 >> 172.21.15.81:0/3392322996 conn(0x7f2ee80d25e0 msgr2=0x7f2ee80d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 -- 172.21.15.81:0/3392322996 shutdown_connections 2024-09-21T06:45:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.817+0000 7f2eef87f640 1 -- 172.21.15.81:0/3392322996 wait complete. 2024-09-21T06:45:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.819+0000 7f2eef87f640 1 Processor -- start 2024-09-21T06:45:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.819+0000 7f2eef87f640 1 -- start start 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.820+0000 7f2eef87f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee80b20d0 0x7f2ee81f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.820+0000 7f2eef87f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee80d19a0 0x7f2ee80715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.820+0000 7f2eef87f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ee81601c0 0x7f2ee80b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.820+0000 7f2eef87f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8072d40 con 0x7f2ee80d19a0 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.820+0000 7f2eef87f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee815da90 con 0x7f2ee80b20d0 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.820+0000 7f2eef87f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee8072ec0 con 0x7f2ee81601c0 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.820+0000 7f2eece1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee80d19a0 0x7f2ee80715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee80d19a0 0x7f2ee80715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55072/0 (socket says 172.21.15.81:55072) 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 -- 172.21.15.81:0/247786219 learned_addr learned my addr 172.21.15.81:0/247786219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eed61b640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee80b20d0 0x7f2ee81f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eede1c640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ee81601c0 0x7f2ee80b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 -- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ee81601c0 msgr2=0x7f2ee80b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ee81601c0 0x7f2ee80b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 -- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee80b20d0 msgr2=0x7f2ee81f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee80b20d0 0x7f2ee81f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 -- 172.21.15.81:0/247786219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee80c5d90 con 0x7f2ee80d19a0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eece1a640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee80d19a0 0x7f2ee80715c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2edc034040 tx=0x7f2edc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2ee5ffb640 1 -- 172.21.15.81:0/247786219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc03e030 con 0x7f2ee80d19a0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2ee5ffb640 1 -- 172.21.15.81:0/247786219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2edc003d90 con 0x7f2ee80d19a0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee80c6070 con 0x7f2ee80d19a0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.821+0000 7f2ee5ffb640 1 -- 172.21.15.81:0/247786219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc035040 con 0x7f2ee80d19a0 2024-09-21T06:45:35.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.822+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee80c6630 con 0x7f2ee80d19a0 2024-09-21T06:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.822+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee80733e0 con 0x7f2ee80d19a0 2024-09-21T06:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.823+0000 7f2ee5ffb640 1 -- 172.21.15.81:0/247786219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2edc041030 con 0x7f2ee80d19a0 2024-09-21T06:45:35.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.823+0000 7f2ee5ffb640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ed4078b90 0x7f2ed407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.824+0000 7f2ee5ffb640 1 -- 172.21.15.81:0/247786219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2edc0bb770 con 0x7f2ee80d19a0 2024-09-21T06:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.824+0000 7f2eed61b640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ed4078b90 0x7f2ed407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.824+0000 7f2eed61b640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ed4078b90 0x7f2ed407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0005fd0 tx=0x7f2ee000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:35.828+0000 7f2ee5ffb640 1 -- 172.21.15.81:0/247786219 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2edc0832b0 con 0x7f2ee80d19a0 2024-09-21T06:45:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.040+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ee81f7830 con 0x7f2ee80d19a0 2024-09-21T06:45:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.041+0000 7f2ee5ffb640 1 -- 172.21.15.81:0/247786219 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7f2edc087ce0 con 0x7f2ee80d19a0 2024-09-21T06:45:36.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:36.043 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ed4078b90 msgr2=0x7f2ed407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ed4078b90 0x7f2ed407b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0005fd0 tx=0x7f2ee000b2e0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee80d19a0 msgr2=0x7f2ee80715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee80d19a0 0x7f2ee80715c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2edc034040 tx=0x7f2edc0038a0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 shutdown_connections 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ed4078b90 0x7f2ed407b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ee81601c0 0x7f2ee80b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee80d19a0 0x7f2ee80715c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 --2- 172.21.15.81:0/247786219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ee80b20d0 0x7f2ee81f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 >> 172.21.15.81:0/247786219 conn(0x7f2ee80d25e0 msgr2=0x7f2ee815be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 shutdown_connections 2024-09-21T06:45:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.043+0000 7f2eef87f640 1 -- 172.21.15.81:0/247786219 wait complete. 2024-09-21T06:45:36.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.169+0000 7f0c1350b640 1 -- 172.21.15.81:0/1955543429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf8004800 msgr2=0x7f0bf8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.169+0000 7f0c1350b640 1 --2- 172.21.15.81:0/1955543429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bf8004800 0x7f0bf8004c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00c290 tx=0x7f0bf8005830 comp rx=0 tx=0).stop 2024-09-21T06:45:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.169+0000 7f0c11aa8640 1 -- 172.21.15.81:0/1955543429 reap_dead start 2024-09-21T06:45:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.169+0000 7f0c1350b640 1 -- 172.21.15.81:0/1955543429 shutdown_connections 2024-09-21T06:45:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.169+0000 7f0c1350b640 1 -- 172.21.15.81:0/1955543429 >> 172.21.15.81:0/1955543429 conn(0x7f0c0c0d25e0 msgr2=0x7f0c0c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.169+0000 7f0c1350b640 1 -- 172.21.15.81:0/1955543429 shutdown_connections 2024-09-21T06:45:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.169+0000 7f0c1350b640 1 -- 172.21.15.81:0/1955543429 wait complete. 2024-09-21T06:45:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.170+0000 7f0c1350b640 1 Processor -- start 2024-09-21T06:45:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.170+0000 7f0c1350b640 1 -- start start 2024-09-21T06:45:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c1350b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bf8004800 0x7f0c0c15f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c1350b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c0c1f3ce0 0x7f0c0c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c1350b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c0c0b60c0 0x7f0c0c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c1350b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c15da60 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c1350b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c15d8e0 con 0x7f0c0c0b60c0 2024-09-21T06:45:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c1350b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0c0b69a0 con 0x7f0bf8004800 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c0c1f3ce0 0x7f0c0c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c0c1f3ce0 0x7f0c0c0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55090/0 (socket says 172.21.15.81:55090) 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 -- 172.21.15.81:0/959254809 learned_addr learned my addr 172.21.15.81:0/959254809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c112a7640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bf8004800 0x7f0c0c15f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c11aa8640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c0c0b60c0 0x7f0c0c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 -- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bf8004800 msgr2=0x7f0c0c15f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bf8004800 0x7f0c0c15f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 -- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c0c0b60c0 msgr2=0x7f0c0c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c0c0b60c0 0x7f0c0c157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 -- 172.21.15.81:0/959254809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0c0c65c0 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c10aa6640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c0c1f3ce0 0x7f0c0c0b5b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc02b130 tx=0x7f0bfc006c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.172+0000 7f0c01ffb640 1 -- 172.21.15.81:0/959254809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc031040 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.173+0000 7f0c01ffb640 1 -- 172.21.15.81:0/959254809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bfc0035f0 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.173+0000 7f0c01ffb640 1 -- 172.21.15.81:0/959254809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc003a40 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.173+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0c1f3200 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.173+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c0c1f37c0 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.174+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0c15a290 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.174+0000 7f0c01ffb640 1 -- 172.21.15.81:0/959254809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bfc034070 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.175+0000 7f0c01ffb640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0bf0078b90 0x7f0bf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.175+0000 7f0c01ffb640 1 -- 172.21.15.81:0/959254809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0bfc0bb5f0 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.175+0000 7f0c112a7640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0bf0078b90 0x7f0bf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.176+0000 7f0c112a7640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0bf0078b90 0x7f0bf007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009c50 tx=0x7f0c08005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.179+0000 7f0c01ffb640 1 -- 172.21.15.81:0/959254809 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0bfc046060 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.358+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c0c159ad0 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.359+0000 7f0c01ffb640 1 -- 172.21.15.81:0/959254809 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f0bfc0837d0 con 0x7f0c0c1f3ce0 2024-09-21T06:45:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:36.361 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:36.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0bf0078b90 msgr2=0x7f0bf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0bf0078b90 0x7f0bf007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009c50 tx=0x7f0c08005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:36.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c0c1f3ce0 msgr2=0x7f0c0c0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c0c1f3ce0 0x7f0c0c0b5b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc02b130 tx=0x7f0bfc006c50 comp rx=0 tx=0).stop 2024-09-21T06:45:36.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 shutdown_connections 2024-09-21T06:45:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0bf0078b90 0x7f0bf007b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c0c0b60c0 0x7f0c0c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c0c1f3ce0 0x7f0c0c0b5b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 --2- 172.21.15.81:0/959254809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bf8004800 0x7f0c0c15f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 >> 172.21.15.81:0/959254809 conn(0x7f0c0c0d25e0 msgr2=0x7f0c0c0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 shutdown_connections 2024-09-21T06:45:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.362+0000 7f0c1350b640 1 -- 172.21.15.81:0/959254809 wait complete. 2024-09-21T06:45:36.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 -- 172.21.15.81:0/2879627529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 msgr2=0x7f716c15d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 --2- 172.21.15.81:0/2879627529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 0x7f716c15d6d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7164009ca0 tx=0x7f716402aac0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 -- 172.21.15.81:0/2879627529 shutdown_connections 2024-09-21T06:45:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 --2- 172.21.15.81:0/2879627529 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 0x7f716c15d6d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 --2- 172.21.15.81:0/2879627529 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f716c0d19a0 0x7f716c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 -- 172.21.15.81:0/2879627529 >> 172.21.15.81:0/2879627529 conn(0x7f716c0d25e0 msgr2=0x7f716c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 -- 172.21.15.81:0/2879627529 shutdown_connections 2024-09-21T06:45:36.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.487+0000 7f7173dba640 1 -- 172.21.15.81:0/2879627529 wait complete. 2024-09-21T06:45:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.488+0000 7f7173dba640 1 Processor -- start 2024-09-21T06:45:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.489+0000 7f7173dba640 1 -- start start 2024-09-21T06:45:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7173dba640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f716c0d19a0 0x7f716c1475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7173dba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 0x7f716c1f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7173dba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f716c1601c0 0x7f716c1f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7173dba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f716c072ec0 con 0x7f716c1601c0 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7173dba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f716c072d40 con 0x7f716c15d2c0 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7173dba640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f716c073040 con 0x7f716c0d19a0 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f716c1601c0 0x7f716c1f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f716c1601c0 0x7f716c1f72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55100/0 (socket says 172.21.15.81:55100) 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 -- 172.21.15.81:0/1159799750 learned_addr learned my addr 172.21.15.81:0/1159799750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7171b56640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f716c0d19a0 0x7f716c1475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7171355640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 0x7f716c1f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 -- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f716c0d19a0 msgr2=0x7f716c1475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f716c0d19a0 0x7f716c1475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 -- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 msgr2=0x7f716c1f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 0x7f716c1f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 -- 172.21.15.81:0/1159799750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c0b6d00 con 0x7f716c1601c0 2024-09-21T06:45:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7171355640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 0x7f716c1f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.490+0000 7f7172357640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f716c1601c0 0x7f716c1f72a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7164009bf0 tx=0x7f7164003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.491+0000 7f71627fc640 1 -- 172.21.15.81:0/1159799750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164044070 con 0x7f716c1601c0 2024-09-21T06:45:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.491+0000 7f71627fc640 1 -- 172.21.15.81:0/1159799750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7164003e00 con 0x7f716c1601c0 2024-09-21T06:45:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.491+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c0b6fe0 con 0x7f716c1601c0 2024-09-21T06:45:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.491+0000 7f71627fc640 1 -- 172.21.15.81:0/1159799750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71640044b0 con 0x7f716c1601c0 2024-09-21T06:45:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.491+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c0b75a0 con 0x7f716c1601c0 2024-09-21T06:45:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.492+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716c073590 con 0x7f716c1601c0 2024-09-21T06:45:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.492+0000 7f71627fc640 1 -- 172.21.15.81:0/1159799750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7164047070 con 0x7f716c1601c0 2024-09-21T06:45:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.493+0000 7f71627fc640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7150078bc0 0x7f715007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.493+0000 7f71627fc640 1 -- 172.21.15.81:0/1159799750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f71640bbd50 con 0x7f716c1601c0 2024-09-21T06:45:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.493+0000 7f7171b56640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7150078bc0 0x7f715007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.494+0000 7f7171b56640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7150078bc0 0x7f715007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7168009b30 tx=0x7f7168005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.498+0000 7f71627fc640 1 -- 172.21.15.81:0/1159799750 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71640bf030 con 0x7f716c1601c0 2024-09-21T06:45:36.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.708+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f716c15d9f0 con 0x7f716c1601c0 2024-09-21T06:45:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.709+0000 7f71627fc640 1 -- 172.21.15.81:0/1159799750 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7f7164032030 con 0x7f716c1601c0 2024-09-21T06:45:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:36.710 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:36.710 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7150078bc0 msgr2=0x7f715007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7150078bc0 0x7f715007b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7168009b30 tx=0x7f7168005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:36.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f716c1601c0 msgr2=0x7f716c1f72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f716c1601c0 0x7f716c1f72a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7164009bf0 tx=0x7f7164003c10 comp rx=0 tx=0).stop 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 shutdown_connections 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7150078bc0 0x7f715007b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f716c1601c0 0x7f716c1f72a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c15d2c0 0x7f716c1f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 --2- 172.21.15.81:0/1159799750 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f716c0d19a0 0x7f716c1475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 >> 172.21.15.81:0/1159799750 conn(0x7f716c0d25e0 msgr2=0x7f716c15ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 shutdown_connections 2024-09-21T06:45:36.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:36.711+0000 7f7173dba640 1 -- 172.21.15.81:0/1159799750 wait complete. 2024-09-21T06:45:37.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:45:14.810455+0000', 'modified': '2024-09-21T06:45:28.081395+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4377}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4377': {'gid': 4377, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/1093840929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 1093840929}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1093840929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4377, 'qdb_cluster': [4377]} 2024-09-21T06:45:37.127 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:45:37.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:45:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 -- 172.21.15.81:0/1991830867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 msgr2=0x7f932c0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 --2- 172.21.15.81:0/1991830867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c0cec90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9320005fd0 tx=0x7f932002a540 comp rx=0 tx=0).stop 2024-09-21T06:45:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 -- 172.21.15.81:0/1991830867 shutdown_connections 2024-09-21T06:45:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 --2- 172.21.15.81:0/1991830867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c0cec90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 --2- 172.21.15.81:0/1991830867 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f932c15c6d0 0x7f932c15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 -- 172.21.15.81:0/1991830867 >> 172.21.15.81:0/1991830867 conn(0x7f932c0cd370 msgr2=0x7f932c0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 -- 172.21.15.81:0/1991830867 shutdown_connections 2024-09-21T06:45:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.239+0000 7f9331b20640 1 -- 172.21.15.81:0/1991830867 wait complete. 2024-09-21T06:45:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.241+0000 7f9331b20640 1 Processor -- start 2024-09-21T06:45:37.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.241+0000 7f9331b20640 1 -- start start 2024-09-21T06:45:37.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f9331b20640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f932c0b6610 0x7f932c1f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f9331b20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f9331b20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f932c15c6d0 0x7f932c15fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f9331b20640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f932c15d3b0 con 0x7f932c0ce880 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f9331b20640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f932c15d230 con 0x7f932c15c6d0 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f9331b20640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f932c15d530 con 0x7f932c0b6610 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f932affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f932affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c15f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55126/0 (socket says 172.21.15.81:55126) 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f932affd640 1 -- 172.21.15.81:0/1515884730 learned_addr learned my addr 172.21.15.81:0/1515884730 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f932bfff640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f932c15c6d0 0x7f932c15fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.242+0000 7f932b7fe640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f932c0b6610 0x7f932c1f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f932affd640 1 -- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f932c0b6610 msgr2=0x7f932c1f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f932affd640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f932c0b6610 0x7f932c1f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f932affd640 1 -- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f932c15c6d0 msgr2=0x7f932c15fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f932affd640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f932c15c6d0 0x7f932c15fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f932affd640 1 -- 172.21.15.81:0/1515884730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932c1f7df0 con 0x7f932c0ce880 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f932affd640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c15f930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9320034040 tx=0x7f93200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f9313fff640 1 -- 172.21.15.81:0/1515884730 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932003e030 con 0x7f932c0ce880 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f9313fff640 1 -- 172.21.15.81:0/1515884730 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9320003d90 con 0x7f932c0ce880 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932c14b300 con 0x7f932c0ce880 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f9313fff640 1 -- 172.21.15.81:0/1515884730 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320035040 con 0x7f932c0ce880 2024-09-21T06:45:37.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.243+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932c14b810 con 0x7f932c0ce880 2024-09-21T06:45:37.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.245+0000 7f9313fff640 1 -- 172.21.15.81:0/1515884730 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9320041030 con 0x7f932c0ce880 2024-09-21T06:45:37.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.245+0000 7f9313fff640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9318078b90 0x7f931807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.245+0000 7f9313fff640 1 -- 172.21.15.81:0/1515884730 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f93200bbc70 con 0x7f932c0ce880 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.245+0000 7f932b7fe640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9318078b90 0x7f931807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.246+0000 7f932b7fe640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9318078b90 0x7f931807b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f931c001e20 tx=0x7f931c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.246+0000 7f9338a93740 1 Processor -- start 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.246+0000 7f9338a93740 1 -- start start 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.247+0000 7f9338a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d77fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d78500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d95400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f9338a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562712cc0820 con 0x5627129a6270 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562712cafc50 con 0x56271297d3b0 2024-09-21T06:45:37.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x562712cb3a60 con 0x562712985590 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d77fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d77fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55136/0 (socket says 172.21.15.81:55136) 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 -- 172.21.15.81:0/2695558946 learned_addr learned my addr 172.21.15.81:0/2695558946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932affd640 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d78500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932bfff640 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d95400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 -- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 msgr2=0x562712d95400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d95400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 -- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 msgr2=0x562712d78500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d78500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 -- 172.21.15.81:0/2695558946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562712a11850 con 0x5627129a6270 2024-09-21T06:45:37.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f932b7fe640 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d77fc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f931c00fd00 tx=0x7f931c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b287cebf1cf97b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f93117fa640 1 -- 172.21.15.81:0/2695558946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c025070 con 0x5627129a6270 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f93117fa640 1 -- 172.21.15.81:0/2695558946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f931c01b050 con 0x5627129a6270 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.248+0000 7f93117fa640 1 -- 172.21.15.81:0/2695558946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c020650 con 0x5627129a6270 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 -- 172.21.15.81:0/2695558946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 msgr2=0x562712d77fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d77fc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f931c00fd00 tx=0x7f931c012000 comp rx=0 tx=0).stop 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 -- 172.21.15.81:0/2695558946 shutdown_connections 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d95400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d78500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 --2- 172.21.15.81:0/2695558946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d77fc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 -- 172.21.15.81:0/2695558946 >> 172.21.15.81:0/2695558946 conn(0x56271299a3c0 msgr2=0x562712d4e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 -- 172.21.15.81:0/2695558946 shutdown_connections 2024-09-21T06:45:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.249+0000 7f9338a93740 1 -- 172.21.15.81:0/2695558946 wait complete. 2024-09-21T06:45:37.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.250+0000 7f9338a93740 1 -- start start 2024-09-21T06:45:37.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.250+0000 7f9338a93740 1 Processor -- start 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271297d3b0 0x562712d8b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562712985590 0x562712d66490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5627129a6270 0x562712d8a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562712a20620 con 0x56271297d3b0 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562712c555f0 con 0x562712985590 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x562712d78a40 con 0x5627129a6270 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 10 client.0 _ll_register_callbacks cb 0x562712c590a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271297d3b0 0x562712d8b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271297d3b0 0x562712d8b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55152/0 (socket says 172.21.15.81:55152) 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 -- 172.21.15.81:0/3958223819 learned_addr learned my addr 172.21.15.81:0/3958223819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:37.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 -- 172.21.15.81:0/3958223819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5627129a6270 msgr2=0x562712d8a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5627129a6270 0x562712d8a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 -- 172.21.15.81:0/3958223819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562712985590 msgr2=0x562712d66490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562712985590 0x562712d66490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 -- 172.21.15.81:0/3958223819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562712a886b0 con 0x56271297d3b0 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f932b7fe640 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271297d3b0 0x562712d8b380 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f931c000f80 tx=0x7f931c021880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e86bc9a05771c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f930a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f930a7fc640 1 -- 172.21.15.81:0/3958223819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c02e020 con 0x56271297d3b0 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f930a7fc640 1 -- 172.21.15.81:0/3958223819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f931c02a480 con 0x56271297d3b0 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f931c01b050 con 0x56271297d3b0 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f930a7fc640 1 -- 172.21.15.81:0/3958223819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f931c038050 con 0x56271297d3b0 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 10 client.4800 fetch_fsmap learned FSMap version 9 2024-09-21T06:45:37.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.252+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562712d8bad0 con 0x56271297d3b0 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f930a7fc640 1 -- 172.21.15.81:0/3958223819 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f931c01b050 con 0x56271297d3b0 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f930a7fc640 1 -- 172.21.15.81:0/3958223819 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f931c03b020 con 0x56271297d3b0 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f9338a93740 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f9338a93740 10 client.4800 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f9338a93740 20 client.4800 populate_metadata read hostname 'smithi081' 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f9338a93740 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712964e40 0x562712da5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f9338a93740 4 client.4800 mds_command: new command op to 4377 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 --> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562712cc2770 con 0x562712964e40 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f932affd640 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712964e40 0x562712da5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f930a7fc640 10 client.4800 ms_handle_connect on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.253+0000 7f932affd640 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712964e40 0x562712da5520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f9d06b2fdfa6f5 server_cookie=74b525126e56eece in_seq=0 out_seq=0 2024-09-21T06:45:37.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f930a7fc640 1 -- 172.21.15.81:0/3958223819 <== mds.0 v2:172.21.15.81:6833/1093840929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562712cc2770 con 0x562712964e40 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f930a7fc640 10 client.4800 handle_command_reply: tid=0 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 client.4800 shutdown 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271297d3b0 msgr2=0x562712d8b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271297d3b0 0x562712d8b380 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f931c000f80 tx=0x7f931c021880 comp rx=0 tx=0).stop 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 shutdown_connections 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712964e40 0x562712da5520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5627129a6270 0x562712d8a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562712985590 0x562712d66490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 --2- 172.21.15.81:0/3958223819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56271297d3b0 0x562712d8b380 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f930a7fc640 0 client.4800 ms_handle_reset on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 >> 172.21.15.81:0/3958223819 conn(0x56271299a3c0 msgr2=0x562712d949d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:37.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 shutdown_connections 2024-09-21T06:45:37.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 1 -- 172.21.15.81:0/3958223819 wait complete. 2024-09-21T06:45:37.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.254+0000 7f9338a93740 20 client.4800 trim_cache size 0 max 16384 2024-09-21T06:45:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.273+0000 7f9338a93740 1 Processor -- start 2024-09-21T06:45:37.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.273+0000 7f9338a93740 1 -- start start 2024-09-21T06:45:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56271297d3b0 0x562712d8eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f9338a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562712985590 0x562712db59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5627129a6270 0x562712db5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f9338a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f932c2003d0 con 0x562712985590 2024-09-21T06:45:37.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f932c0af160 con 0x5627129a6270 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f932c0c63b0 con 0x56271297d3b0 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f932affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562712985590 0x562712db59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f932affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562712985590 0x562712db59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55164/0 (socket says 172.21.15.81:55164) 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.274+0000 7f932affd640 1 -- 172.21.15.81:0/3787927813 learned_addr learned my addr 172.21.15.81:0/3787927813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932b7fe640 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56271297d3b0 0x562712d8eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932bfff640 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5627129a6270 0x562712db5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932affd640 1 -- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56271297d3b0 msgr2=0x562712d8eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932affd640 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56271297d3b0 0x562712d8eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932affd640 1 -- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5627129a6270 msgr2=0x562712db5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932affd640 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5627129a6270 0x562712db5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932affd640 1 -- 172.21.15.81:0/3787927813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562712d4e5f0 con 0x562712985590 2024-09-21T06:45:37.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f932affd640 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562712985590 0x562712db59e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f932002ab30 tx=0x7f932007fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1a0a5766d527b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f9310ff9640 1 -- 172.21.15.81:0/3787927813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93200a9070 con 0x562712985590 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f9310ff9640 1 -- 172.21.15.81:0/3787927813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f932008cf70 con 0x562712985590 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.275+0000 7f9310ff9640 1 -- 172.21.15.81:0/3787927813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320048040 con 0x562712985590 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 -- 172.21.15.81:0/3787927813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562712985590 msgr2=0x562712db59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562712985590 0x562712db59e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f932002ab30 tx=0x7f932007fdf0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 -- 172.21.15.81:0/3787927813 shutdown_connections 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5627129a6270 0x562712db5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562712985590 0x562712db59e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 --2- 172.21.15.81:0/3787927813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x56271297d3b0 0x562712d8eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 -- 172.21.15.81:0/3787927813 >> 172.21.15.81:0/3787927813 conn(0x56271299a3c0 msgr2=0x562712d8d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:37.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 -- 172.21.15.81:0/3787927813 shutdown_connections 2024-09-21T06:45:37.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.276+0000 7f9338a93740 1 -- 172.21.15.81:0/3787927813 wait complete. 2024-09-21T06:45:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.277+0000 7f9338a93740 1 -- start start 2024-09-21T06:45:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.277+0000 7f9338a93740 1 Processor -- start 2024-09-21T06:45:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d8bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f9338a93740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d8c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f9338a93740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d91a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f9338a93740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562712d66bb0 con 0x5627129a6270 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x562712d93a90 con 0x56271297d3b0 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f9338a93740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x562712da2a00 con 0x562712985590 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f9338a93740 10 client.0 _ll_register_callbacks cb 0x7f931c023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f932bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d91a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f932bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d91a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55168/0 (socket says 172.21.15.81:55168) 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f932bfff640 1 -- 172.21.15.81:0/2800652222 learned_addr learned my addr 172.21.15.81:0/2800652222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f932b7fe640 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d8bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.278+0000 7f932affd640 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d8c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f932bfff640 1 -- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 msgr2=0x562712d8c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f932bfff640 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d8c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f932bfff640 1 -- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 msgr2=0x562712d8bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:37.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f932bfff640 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d8bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f932bfff640 1 -- 172.21.15.81:0/2800652222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562712d66710 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f932bfff640 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d91a60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f93240038e0 tx=0x7f9324003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f407d5378c62d4fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f930a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f930a7fc640 1 -- 172.21.15.81:0/2800652222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324020060 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f930a7fc640 1 -- 172.21.15.81:0/2800652222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f932400bdd0 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f932008cf70 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f930a7fc640 1 -- 172.21.15.81:0/2800652222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9324026050 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 10 client.4806 fetch_fsmap learned FSMap version 9 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562712d8c780 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f930a7fc640 1 -- 172.21.15.81:0/2800652222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f932008cf70 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f930a7fc640 1 -- 172.21.15.81:0/2800652222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9324029020 con 0x5627129a6270 2024-09-21T06:45:37.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 10 client.4806 fetch_fsmap finished waiting for FSMap version 9 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 10 client.4806 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 20 client.4806 populate_metadata read hostname 'smithi081' 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712da8b20 0x562712da8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 4 client.4806 mds_command: new command op to 4377 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.279+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 --> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] -- command(tid 0: {"prefix": "status"}) -- 0x562712cbe220 con 0x562712da8b20 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f932b7fe640 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712da8b20 0x562712da8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f930a7fc640 10 client.4806 ms_handle_connect on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f932b7fe640 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712da8b20 0x562712da8f30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b3fdf18cfa1084d server_cookie=1ca8df30b306f637 in_seq=0 out_seq=0 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f930a7fc640 1 -- 172.21.15.81:0/2800652222 <== mds.0 v2:172.21.15.81:6833/1093840929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x562712cbe220 con 0x562712da8b20 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f930a7fc640 10 client.4806 handle_command_reply: tid=0 2024-09-21T06:45:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 client.4806 shutdown 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 msgr2=0x562712d91a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d91a60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f93240038e0 tx=0x7f9324003da0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 shutdown_connections 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:6833/1093840929,v1:172.21.15.81:6835/1093840929] conn(0x562712da8b20 0x562712da8f30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x562712985590 0x562712d8c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f930a7fc640 0 client.4806 ms_handle_reset on v2:172.21.15.81:6833/1093840929 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5627129a6270 0x562712d91a60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 --2- 172.21.15.81:0/2800652222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56271297d3b0 0x562712d8bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 >> 172.21.15.81:0/2800652222 conn(0x56271299a3c0 msgr2=0x562712d8eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 shutdown_connections 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.280+0000 7f9338a93740 1 -- 172.21.15.81:0/2800652222 wait complete. 2024-09-21T06:45:37.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9338a93740 20 client.4806 trim_cache size 0 max 16384 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "5acf265c-1f37-45bc-9438-eb9ad71b6190", 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4377, 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 21.816960379000001, 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 26, 2024-09-21T06:45:37.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 26, 2024-09-21T06:45:37.290 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 27.861675019 2024-09-21T06:45:37.290 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9318078b90 msgr2=0x7f931807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9318078b90 0x7f931807b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f931c001e20 tx=0x7f931c009040 comp rx=0 tx=0).stop 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 msgr2=0x7f932c15f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c15f930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9320034040 tx=0x7f93200038a0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 shutdown_connections 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9318078b90 0x7f931807b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f932c15c6d0 0x7f932c15fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f932c0ce880 0x7f932c15f930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 --2- 172.21.15.81:0/1515884730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f932c0b6610 0x7f932c1f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 >> 172.21.15.81:0/1515884730 conn(0x7f932c0cd370 msgr2=0x7f932c073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:37.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 shutdown_connections 2024-09-21T06:45:37.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.281+0000 7f9331b20640 1 -- 172.21.15.81:0/1515884730 wait complete. 2024-09-21T06:45:37.294 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T06:45:37.308 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T06:45:37.308 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T06:45:37.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.308 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:45:37.323 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T06:45:37.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T06:45:37.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-21T06:45:37.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.490 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:45:37.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-21T06:45:37.572 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-21T06:45:37.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:45:37.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.574 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-21T06:45:37.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-21T06:45:37.665 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2024-09-21T06:45:37.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:45:37.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.667 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-21T06:45:37.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:37.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-21T06:45:37.794 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2024-09-21T06:45:37.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:45:37.795 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-21T06:45:37.796 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:45:37.796 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:45:37.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:45:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.909+0000 7fe43da1d640 1 -- 172.21.15.81:0/2372719427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 msgr2=0x7fe424004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.909+0000 7fe43da1d640 1 --2- 172.21.15.81:0/2372719427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 0x7fe424004c10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe420009b50 tx=0x7fe424005830 comp rx=0 tx=0).stop 2024-09-21T06:45:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.909+0000 7fe4377fe640 1 -- 172.21.15.81:0/2372719427 reap_dead start 2024-09-21T06:45:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.909+0000 7fe43da1d640 1 -- 172.21.15.81:0/2372719427 shutdown_connections 2024-09-21T06:45:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.909+0000 7fe43da1d640 1 -- 172.21.15.81:0/2372719427 >> 172.21.15.81:0/2372719427 conn(0x7fe4380b2030 msgr2=0x7fe4380b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.909+0000 7fe43da1d640 1 -- 172.21.15.81:0/2372719427 shutdown_connections 2024-09-21T06:45:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.909+0000 7fe43da1d640 1 -- 172.21.15.81:0/2372719427 wait complete. 2024-09-21T06:45:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.911+0000 7fe43da1d640 1 Processor -- start 2024-09-21T06:45:37.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.911+0000 7fe43da1d640 1 -- start start 2024-09-21T06:45:37.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe43da1d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 0x7fe43809b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe43da1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe438156d10 0x7fe438149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe43da1d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe43809cbd0 0x7fe43809cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe43da1d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe43815cf00 con 0x7fe424004800 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe43da1d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe4380b32b0 con 0x7fe438156d10 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe43da1d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fe43815ec80 con 0x7fe43809cbd0 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 0x7fe43809b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 0x7fe43809b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55178/0 (socket says 172.21.15.81:55178) 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 -- 172.21.15.81:0/1728919935 learned_addr learned my addr 172.21.15.81:0/1728919935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe42ffff640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe438156d10 0x7fe438149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe4377fe640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe43809cbd0 0x7fe43809cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 -- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe43809cbd0 msgr2=0x7fe43809cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe43809cbd0 0x7fe43809cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 -- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe438156d10 msgr2=0x7fe438149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:37.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe438156d10 0x7fe438149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 -- 172.21.15.81:0/1728919935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43809d520 con 0x7fe424004800 2024-09-21T06:45:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.912+0000 7fe436ffd640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 0x7fe43809b440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe428006600 tx=0x7fe4280039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.913+0000 7fe434ff9640 1 -- 172.21.15.81:0/1728919935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428015070 con 0x7fe424004800 2024-09-21T06:45:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.913+0000 7fe434ff9640 1 -- 172.21.15.81:0/1728919935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe428011920 con 0x7fe424004800 2024-09-21T06:45:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.913+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43809bdb0 con 0x7fe424004800 2024-09-21T06:45:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.913+0000 7fe434ff9640 1 -- 172.21.15.81:0/1728919935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428011d70 con 0x7fe424004800 2024-09-21T06:45:37.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.913+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43809c370 con 0x7fe424004800 2024-09-21T06:45:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.914+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe43806ec90 con 0x7fe424004800 2024-09-21T06:45:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.914+0000 7fe434ff9640 1 -- 172.21.15.81:0/1728919935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe428018070 con 0x7fe424004800 2024-09-21T06:45:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.915+0000 7fe434ff9640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe418078b90 0x7fe41807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.915+0000 7fe434ff9640 1 -- 172.21.15.81:0/1728919935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe42809be70 con 0x7fe424004800 2024-09-21T06:45:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.915+0000 7fe42ffff640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe418078b90 0x7fe41807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.915+0000 7fe42ffff640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe418078b90 0x7fe41807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe420035000 tx=0x7fe42002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:37.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:37.919+0000 7fe434ff9640 1 -- 172.21.15.81:0/1728919935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe43809d520 con 0x7fe424004800 2024-09-21T06:45:38.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.130+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe4380b3e90 con 0x7fe424004800 2024-09-21T06:45:38.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.131+0000 7fe434ff9640 1 -- 172.21.15.81:0/1728919935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fe428064010 con 0x7fe424004800 2024-09-21T06:45:38.132 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T06:45:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe418078b90 msgr2=0x7fe41807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe418078b90 0x7fe41807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe420035000 tx=0x7fe42002d040 comp rx=0 tx=0).stop 2024-09-21T06:45:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 msgr2=0x7fe43809b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 0x7fe43809b440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe428006600 tx=0x7fe4280039c0 comp rx=0 tx=0).stop 2024-09-21T06:45:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 shutdown_connections 2024-09-21T06:45:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe418078b90 0x7fe41807b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe43809cbd0 0x7fe43809cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe438156d10 0x7fe438149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 --2- 172.21.15.81:0/1728919935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe424004800 0x7fe43809b440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 >> 172.21.15.81:0/1728919935 conn(0x7fe4380b2030 msgr2=0x7fe4380b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 shutdown_connections 2024-09-21T06:45:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38.133+0000 7fe43da1d640 1 -- 172.21.15.81:0/1728919935 wait complete. 2024-09-21T06:45:38.145 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:45:38.145 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:45:38.145 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:45:38.146 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:45:38.146 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:45:38.146 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:45:38.146 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:45:38.146 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:45:38.146 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:45:38.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:38.146 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:45:38.161 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:38.161 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:38.161 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:38.161 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-09-21T06:45:38.162 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:45:38.163 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:38.163 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:45:38.163 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:38.163 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:38.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:45:38.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-21T06:45:38.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-21T06:45:38.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:45:38.163 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:38.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:38.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:38.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:38.299 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:45:38.322 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:45:38.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:38.323 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:45:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:45:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:45:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:45:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:45:38.381 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:45:38.381 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:38.381 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:38.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:45:38.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:45:38.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:45:38.381 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:38.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:38.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:38.508 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:45:38.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:38.524 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-21T06:45:38.579 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:38.579 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:38.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:45:38.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T06:45:38.579 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:38.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:38.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:38.695 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T06:45:38.695 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:38.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:38.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:38.808 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:38.808 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:38.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:45:38.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:45:38.808 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:38.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:38.885 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:45:38.899 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:45:38.900 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:38.900 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:45:38.955 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:45:38.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:38.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:39.049 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:39.049 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:39.191 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:39.192 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:39.192 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:45:39.192 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:45:39.192 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:45:39.192 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:45:39.192 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:45:39.193 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:45:39.193 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:45:39.193 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:45:39.194 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:45:39.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:39.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:45:39.219 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:39.314 INFO:teuthology.orchestra.run.smithi081.stdout:client4571 2024-09-21T06:45:39.315 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:39.315 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:39.330 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:39.426 INFO:teuthology.orchestra.run.smithi081.stdout:client4571 2024-09-21T06:45:39.426 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:39.484 INFO:teuthology.orchestra.run.smithi081.stdout:client4571 2024-09-21T06:45:39.484 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5acf265c-1f37-45bc-9438-eb9ad71b6190.client4571/status') 2024-09-21T06:45:39.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:39.541 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4571 (3)172.21.15.81:0/2351501160 2024-09-21T06:45:39.541 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-21T06:45:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-21T06:45:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-21T06:45:39.541 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 2.1718e-05 s, 3.2 MB/s 2024-09-21T06:45:39.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:39.549 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-21T06:45:39.549 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:45:39.549 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T06:45:39.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:45:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.659+0000 7f8949113640 1 -- 172.21.15.81:0/3462120560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c004d40 msgr2=0x7f892c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.659+0000 7f8949113640 1 --2- 172.21.15.81:0/3462120560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892c004d40 0x7f892c005150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f89440d2050 tx=0x7f892c005830 comp rx=0 tx=0).stop 2024-09-21T06:45:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.659+0000 7f894359e640 1 -- 172.21.15.81:0/3462120560 reap_dead start 2024-09-21T06:45:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.659+0000 7f8949113640 1 -- 172.21.15.81:0/3462120560 shutdown_connections 2024-09-21T06:45:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.659+0000 7f8949113640 1 -- 172.21.15.81:0/3462120560 >> 172.21.15.81:0/3462120560 conn(0x7f89440d25e0 msgr2=0x7f89440d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.659+0000 7f8949113640 1 -- 172.21.15.81:0/3462120560 shutdown_connections 2024-09-21T06:45:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.660+0000 7f8949113640 1 -- 172.21.15.81:0/3462120560 wait complete. 2024-09-21T06:45:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.662+0000 7f8949113640 1 Processor -- start 2024-09-21T06:45:39.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.662+0000 7f8949113640 1 -- start start 2024-09-21T06:45:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8949113640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89440b6ef0 0x7f89440c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8949113640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8944158420 0x7f8944158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8949113640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89440b5050 0x7f89440b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8949113640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89440b1d10 con 0x7f89440b6ef0 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8949113640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89440b1b90 con 0x7f89440b5050 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8949113640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f89440b1e90 con 0x7f8944158420 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89440b6ef0 0x7f89440c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89440b6ef0 0x7f89440c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48284/0 (socket says 172.21.15.81:48284) 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 -- 172.21.15.81:0/2031230493 learned_addr learned my addr 172.21.15.81:0/2031230493 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f894359e640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89440b5050 0x7f89440b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f894259c640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8944158420 0x7f8944158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 -- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8944158420 msgr2=0x7f8944158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8944158420 0x7f8944158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 -- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89440b5050 msgr2=0x7f89440b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89440b5050 0x7f89440b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f8942d9d640 1 -- 172.21.15.81:0/2031230493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8944158d70 con 0x7f89440b6ef0 2024-09-21T06:45:39.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.663+0000 7f894359e640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89440b5050 0x7f89440b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.664+0000 7f8942d9d640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89440b6ef0 0x7f89440c9c80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8934011d40 tx=0x7f893400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.664+0000 7f892b7fe640 1 -- 172.21.15.81:0/2031230493 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934003d80 con 0x7f89440b6ef0 2024-09-21T06:45:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.664+0000 7f892b7fe640 1 -- 172.21.15.81:0/2031230493 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8934004b20 con 0x7f89440b6ef0 2024-09-21T06:45:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.664+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89440ca4d0 con 0x7f89440b6ef0 2024-09-21T06:45:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.664+0000 7f892b7fe640 1 -- 172.21.15.81:0/2031230493 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8934004050 con 0x7f89440b6ef0 2024-09-21T06:45:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.664+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89440caa90 con 0x7f89440b6ef0 2024-09-21T06:45:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.665+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894415a290 con 0x7f89440b6ef0 2024-09-21T06:45:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.666+0000 7f892b7fe640 1 -- 172.21.15.81:0/2031230493 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89340041f0 con 0x7f89440b6ef0 2024-09-21T06:45:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.666+0000 7f892b7fe640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8930078b90 0x7f893007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.666+0000 7f892b7fe640 1 -- 172.21.15.81:0/2031230493 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f893409c2e0 con 0x7f89440b6ef0 2024-09-21T06:45:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.666+0000 7f894259c640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8930078b90 0x7f893007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.667+0000 7f894259c640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8930078b90 0x7f893007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f89440b6980 tx=0x7f8938005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.671+0000 7f892b7fe640 1 -- 172.21.15.81:0/2031230493 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8944158d70 con 0x7f89440b6ef0 2024-09-21T06:45:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.886+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f89440d1450 con 0x7f89440b6ef0 2024-09-21T06:45:39.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.886+0000 7f892b7fe640 1 -- 172.21.15.81:0/2031230493 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f8934064470 con 0x7f89440b6ef0 2024-09-21T06:45:39.887 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T06:45:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8930078b90 msgr2=0x7f893007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8930078b90 0x7f893007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f89440b6980 tx=0x7f8938005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89440b6ef0 msgr2=0x7f89440c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89440b6ef0 0x7f89440c9c80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8934011d40 tx=0x7f893400f790 comp rx=0 tx=0).stop 2024-09-21T06:45:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 shutdown_connections 2024-09-21T06:45:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8930078b90 0x7f893007b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8944158420 0x7f8944158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89440b5050 0x7f89440b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 --2- 172.21.15.81:0/2031230493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89440b6ef0 0x7f89440c9c80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.888+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 >> 172.21.15.81:0/2031230493 conn(0x7f89440d25e0 msgr2=0x7f894415f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.889+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 shutdown_connections 2024-09-21T06:45:39.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:39.889+0000 7f8949113640 1 -- 172.21.15.81:0/2031230493 wait complete. 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:45:39.901 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T06:45:39.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:39.902 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:45:39.918 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:39.918 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:39.918 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:45:39.919 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5807:98ff:feed:57f8/64 scope link 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1029:45ff:fefa:d01b/64 scope link tentative 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:39.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:39.920 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:45:39.981 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:45:39.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:39.983 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:45:40.039 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:45:40.039 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:45:40.039 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:45:40.039 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:45:40.039 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:45:40.040 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:40.040 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:40.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:45:40.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:45:40.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:45:40.040 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:40.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:40.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:40.166 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:45:40.181 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:45:40.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:40.181 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-21T06:45:40.236 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T06:45:40.236 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:40.236 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:40.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:45:40.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T06:45:40.237 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:40.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:40.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:40.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T06:45:40.376 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:40.376 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:40.376 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ba:83:85:05:89:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::b883:85ff:fe05:891a/64 scope link tentative 2024-09-21T06:45:40.377 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:40.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T06:45:40.442 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.443 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:45:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ba:83:85:05:89:1a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:45:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:45:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::b883:85ff:fe05:891a/64 scope link tentative 2024-09-21T06:45:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:40.444 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T06:45:40.444 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:40.444 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:40.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T06:45:40.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T06:45:40.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T06:45:40.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T06:45:40.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T06:45:40.445 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:40.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:40.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:40.596 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:40.596 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:45:40.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2024-09-21T06:45:40.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T06:45:40.596 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:45:40.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:40.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:40.671 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T06:45:40.686 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T06:45:40.686 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:40.686 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T06:45:40.742 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-21T06:45:40.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:40.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:40.836 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:40.836 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 2@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:45:40.847 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:45:40.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:40.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T06:45:40.871 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:40.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:40.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:40.967 INFO:teuthology.orchestra.run.smithi081.stdout:client4580 2024-09-21T06:45:40.967 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:40.967 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:40.983 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:41.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:41.077 INFO:teuthology.orchestra.run.smithi081.stdout:client4580 2024-09-21T06:45:41.078 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:41.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:41.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:41.133 INFO:teuthology.orchestra.run.smithi081.stdout:client4580 2024-09-21T06:45:41.133 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5acf265c-1f37-45bc-9438-eb9ad71b6190.client4580/status') 2024-09-21T06:45:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:41.190 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4580 (3)172.21.15.81:0/3558377666 2024-09-21T06:45:41.191 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-21T06:45:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-21T06:45:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-21T06:45:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 3.1194e-05 s, 2.2 MB/s 2024-09-21T06:45:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:41.198 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-21T06:45:41.198 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:45:41.198 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:45:41.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:45:41.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 -- 172.21.15.81:0/1881198405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 msgr2=0x7fcfd015d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:41.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 --2- 172.21.15.81:0/1881198405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd015d6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00d2030 tx=0x7fcfc802a4a0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 -- 172.21.15.81:0/1881198405 shutdown_connections 2024-09-21T06:45:41.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 --2- 172.21.15.81:0/1881198405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd015d6d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 --2- 172.21.15.81:0/1881198405 >> v2:172.21.15.89:3300/0 conn(0x7fcfd015a290 0x7fcfd01601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 -- 172.21.15.81:0/1881198405 >> 172.21.15.81:0/1881198405 conn(0x7fcfd00d25e0 msgr2=0x7fcfd00d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 -- 172.21.15.81:0/1881198405 shutdown_connections 2024-09-21T06:45:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.310+0000 7fcfd8739640 1 -- 172.21.15.81:0/1881198405 wait complete. 2024-09-21T06:45:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.311+0000 7fcfd8739640 1 Processor -- start 2024-09-21T06:45:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.312+0000 7fcfd8739640 1 -- start start 2024-09-21T06:45:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd8739640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfd00d19a0 0x7fcfd0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd8739640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfd015a290 0x7fcfd00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd8739640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd00b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd8739640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd0072ec0 con 0x7fcfd015d2c0 2024-09-21T06:45:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd8739640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd0072d40 con 0x7fcfd00d19a0 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd8739640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd0073040 con 0x7fcfd015a290 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd00b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd00b66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48298/0 (socket says 172.21.15.81:48298) 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 -- 172.21.15.81:0/2935082699 learned_addr learned my addr 172.21.15.81:0/2935082699 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd64d5640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfd00d19a0 0x7fcfd0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd5cd4640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfd015a290 0x7fcfd00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 -- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfd015a290 msgr2=0x7fcfd00c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfd015a290 0x7fcfd00c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 -- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfd00d19a0 msgr2=0x7fcfd0150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfd00d19a0 0x7fcfd0150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 -- 172.21.15.81:0/2935082699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd00b7de0 con 0x7fcfd015d2c0 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd64d5640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfd00d19a0 0x7fcfd0150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.313+0000 7fcfd6cd6640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd00b66d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80098f0 tx=0x7fcfc8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.314+0000 7fcfceffd640 1 -- 172.21.15.81:0/2935082699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8031d60 con 0x7fcfd015d2c0 2024-09-21T06:45:41.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.314+0000 7fcfceffd640 1 -- 172.21.15.81:0/2935082699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfc8033e10 con 0x7fcfd015d2c0 2024-09-21T06:45:41.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.314+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd00c6380 con 0x7fcfd015d2c0 2024-09-21T06:45:41.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.314+0000 7fcfceffd640 1 -- 172.21.15.81:0/2935082699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8005260 con 0x7fcfd015d2c0 2024-09-21T06:45:41.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.314+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd00c6940 con 0x7fcfd015d2c0 2024-09-21T06:45:41.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.315+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd0073590 con 0x7fcfd015d2c0 2024-09-21T06:45:41.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.315+0000 7fcfceffd640 1 -- 172.21.15.81:0/2935082699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfc8005400 con 0x7fcfd015d2c0 2024-09-21T06:45:41.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.316+0000 7fcfceffd640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcfbc078bc0 0x7fcfbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:41.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.316+0000 7fcfceffd640 1 -- 172.21.15.81:0/2935082699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcfc80bc0f0 con 0x7fcfd015d2c0 2024-09-21T06:45:41.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.316+0000 7fcfd64d5640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcfbc078bc0 0x7fcfbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:41.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.317+0000 7fcfd64d5640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcfbc078bc0 0x7fcfbc07b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0007fd0 tx=0x7fcfc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:41.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.321+0000 7fcfceffd640 1 -- 172.21.15.81:0/2935082699 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcfc803f030 con 0x7fcfd015d2c0 2024-09-21T06:45:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.533+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcfd0160300 con 0x7fcfd015d2c0 2024-09-21T06:45:41.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.533+0000 7fcfceffd640 1 -- 172.21.15.81:0/2935082699 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fcfc8084310 con 0x7fcfd015d2c0 2024-09-21T06:45:41.535 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T06:45:41.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcfbc078bc0 msgr2=0x7fcfbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:41.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcfbc078bc0 0x7fcfbc07b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0007fd0 tx=0x7fcfc0009040 comp rx=0 tx=0).stop 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 msgr2=0x7fcfd00b66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd00b66d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80098f0 tx=0x7fcfc8033c20 comp rx=0 tx=0).stop 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 shutdown_connections 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcfbc078bc0 0x7fcfbc07b0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfd015a290 0x7fcfd00c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfd015d2c0 0x7fcfd00b66d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 --2- 172.21.15.81:0/2935082699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfd00d19a0 0x7fcfd0150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 >> 172.21.15.81:0/2935082699 conn(0x7fcfd00d25e0 msgr2=0x7fcfd015ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 shutdown_connections 2024-09-21T06:45:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:41.536+0000 7fcfd8739640 1 -- 172.21.15.81:0/2935082699 wait complete. 2024-09-21T06:45:41.548 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:45:41.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:45:41.548 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-09-21T06:45:41.549 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T06:45:41.549 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T06:45:41.549 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:45:41.549 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:45:41.549 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:45:41.549 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:45:41.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:41.549 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-09-21T06:45:41.568 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:41.568 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:41.568 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:41.568 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:41.569 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:45:41.570 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42753sec preferred_lft 42753sec 2024-09-21T06:45:41.570 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2024-09-21T06:45:41.570 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:41.570 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:45:41.570 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:41.570 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:41.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:45:41.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2024-09-21T06:45:41.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2024-09-21T06:45:41.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:45:41.570 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:41.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:41.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:41.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:41.849 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:45:41.873 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-09-21T06:45:41.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:41.875 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-09-21T06:45:41.952 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-09-21T06:45:41.952 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:45:41.952 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:45:41.952 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:45:41.952 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:45:41.952 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:41.952 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:41.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:45:41.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:45:41.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:45:41.953 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:42.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:42.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:42.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:42.255 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-21T06:45:42.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:42.271 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-09-21T06:45:42.326 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:42.326 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:42.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:45:42.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T06:45:42.326 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:42.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:42.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:42.445 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T06:45:42.445 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:42.446 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:42.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T06:45:42.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:45:42.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T06:45:42.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T06:45:42.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T06:45:42.446 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:42.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:42.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:42.578 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:42.579 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:42.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2024-09-21T06:45:42.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:45:42.579 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:42.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:42.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:42.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:42.655 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T06:45:42.670 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T06:45:42.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:42.671 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:45:42.725 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T06:45:42.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:42.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:42.836 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:42.836 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:42.972 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:42.972 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:42.972 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:45:42.973 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 1@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:45:42.973 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:45:42.973 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T06:45:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:45:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:45:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:45:42.973 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:45:42.975 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:45:42.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:42.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T06:45:42.999 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:43.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:43.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:43.096 INFO:teuthology.orchestra.run.smithi089.stdout:client4830 2024-09-21T06:45:43.096 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:43.096 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:43.111 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:43.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:43.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:43.207 INFO:teuthology.orchestra.run.smithi089.stdout:client4830 2024-09-21T06:45:43.207 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:43.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:43.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:43.263 INFO:teuthology.orchestra.run.smithi089.stdout:client4830 2024-09-21T06:45:43.263 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5acf265c-1f37-45bc-9438-eb9ad71b6190.client4830/status') 2024-09-21T06:45:43.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:43.321 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4830 (3)172.21.15.89:0/4111826011 2024-09-21T06:45:43.321 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2024-09-21T06:45:43.321 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2024-09-21T06:45:43.321 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2024-09-21T06:45:43.321 INFO:teuthology.orchestra.run.smithi089.stderr:70 bytes copied, 3.8249e-05 s, 1.8 MB/s 2024-09-21T06:45:43.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:43.328 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-21T06:45:43.328 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:45:43.329 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T06:45:43.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:45:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.451+0000 7f63f49ba640 1 -- 172.21.15.81:0/4075561740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f00d41a0 msgr2=0x7f63f00d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.451+0000 7f63f49ba640 1 --2- 172.21.15.81:0/4075561740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f00d41a0 0x7f63f00d45b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009830 tx=0x7f63e802a530 comp rx=0 tx=0).stop 2024-09-21T06:45:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.451+0000 7f63f49ba640 1 -- 172.21.15.81:0/4075561740 shutdown_connections 2024-09-21T06:45:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.451+0000 7f63f49ba640 1 --2- 172.21.15.81:0/4075561740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f00d41a0 0x7f63f00d45b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.451+0000 7f63f49ba640 1 -- 172.21.15.81:0/4075561740 >> 172.21.15.81:0/4075561740 conn(0x7f63f00b7330 msgr2=0x7f63f00b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.451+0000 7f63f49ba640 1 -- 172.21.15.81:0/4075561740 shutdown_connections 2024-09-21T06:45:43.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.451+0000 7f63f49ba640 1 -- 172.21.15.81:0/4075561740 wait complete. 2024-09-21T06:45:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.453+0000 7f63f49ba640 1 Processor -- start 2024-09-21T06:45:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.453+0000 7f63f49ba640 1 -- start start 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63f49ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00d3220 0x7f63f014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63f49ba640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63f00d41a0 0x7f63f00cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63f49ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f015c450 0x7f63f00b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63f49ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63f00b36d0 con 0x7f63f00d3220 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63f49ba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f63f00b3550 con 0x7f63f015c450 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63f49ba640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f63f00b3850 con 0x7f63f00d41a0 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00d3220 0x7f63f014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00d3220 0x7f63f014b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48310/0 (socket says 172.21.15.81:48310) 2024-09-21T06:45:43.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 -- 172.21.15.81:0/3031461518 learned_addr learned my addr 172.21.15.81:0/3031461518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63eed9d640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f015c450 0x7f63f00b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63edd9b640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63f00d41a0 0x7f63f00cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 -- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63f00d41a0 msgr2=0x7f63f00cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63f00d41a0 0x7f63f00cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 -- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f015c450 msgr2=0x7f63f00b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f015c450 0x7f63f00b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 -- 172.21.15.81:0/3031461518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f00cbe70 con 0x7f63f00d3220 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63ee59c640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00d3220 0x7f63f014b520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f63e000cb40 tx=0x7f63e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.455+0000 7f63deffd640 1 -- 172.21.15.81:0/3031461518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0016020 con 0x7f63f00d3220 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.456+0000 7f63deffd640 1 -- 172.21.15.81:0/3031461518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63e000ad90 con 0x7f63f00d3220 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.456+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f01f6740 con 0x7f63f00d3220 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.456+0000 7f63deffd640 1 -- 172.21.15.81:0/3031461518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0012680 con 0x7f63f00d3220 2024-09-21T06:45:43.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.456+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f00b5aa0 con 0x7f63f00d3220 2024-09-21T06:45:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.457+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f008d110 con 0x7f63f00d3220 2024-09-21T06:45:43.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.457+0000 7f63deffd640 1 -- 172.21.15.81:0/3031461518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63e0019020 con 0x7f63f00d3220 2024-09-21T06:45:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.458+0000 7f63deffd640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63d0078b90 0x7f63d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.458+0000 7f63deffd640 1 -- 172.21.15.81:0/3031461518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f63e009b230 con 0x7f63f00d3220 2024-09-21T06:45:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.458+0000 7f63edd9b640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63d0078b90 0x7f63d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.459+0000 7f63edd9b640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63d0078b90 0x7f63d007b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63f0068e40 tx=0x7f63e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.462+0000 7f63deffd640 1 -- 172.21.15.81:0/3031461518 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f63f008d110 con 0x7f63f00d3220 2024-09-21T06:45:43.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.678+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f63f00d45b0 con 0x7f63f00d3220 2024-09-21T06:45:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.678+0000 7f63deffd640 1 -- 172.21.15.81:0/3031461518 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f63e0020030 con 0x7f63f00d3220 2024-09-21T06:45:43.680 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.680+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63d0078b90 msgr2=0x7f63d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.680+0000 7f63f49ba640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63d0078b90 0x7f63d007b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63f0068e40 tx=0x7f63e4009040 comp rx=0 tx=0).stop 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.680+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00d3220 msgr2=0x7f63f014b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.680+0000 7f63f49ba640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00d3220 0x7f63f014b520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f63e000cb40 tx=0x7f63e000a060 comp rx=0 tx=0).stop 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 shutdown_connections 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f63d0078b90 0x7f63d007b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63f00d41a0 0x7f63f00cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63f015c450 0x7f63f00b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 --2- 172.21.15.81:0/3031461518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63f00d3220 0x7f63f014b520 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 >> 172.21.15.81:0/3031461518 conn(0x7f63f00b7330 msgr2=0x7f63f00d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 shutdown_connections 2024-09-21T06:45:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:43.681+0000 7f63f49ba640 1 -- 172.21.15.81:0/3031461518 wait complete. 2024-09-21T06:45:43.693 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:45:43.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:45:43.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-09-21T06:45:43.693 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T06:45:43.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T06:45:43.694 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:45:43.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:45:43.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:45:43.694 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T06:45:43.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:43.694 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:43.710 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42751sec preferred_lft 42751sec 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether fe:3b:4a:35:5c:81 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:45:43.711 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::24b6:cbff:fefa:7c4f/64 scope link 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether fe:3b:4a:35:5c:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::fc3b:4aff:fe35:5c81/64 scope link tentative 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:43.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:43.712 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:45:43.774 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-09-21T06:45:43.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:43.776 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:45:43.834 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:43.834 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:43.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:45:43.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:45:43.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:45:43.834 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:43.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:43.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:43.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:43.959 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-21T06:45:43.974 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:45:43.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:43.974 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-09-21T06:45:44.029 INFO:teuthology.orchestra.run.smithi089.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T06:45:44.030 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:44.030 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:44.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:45:44.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T06:45:44.030 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:44.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:44.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:44.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:44.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T06:45:44.169 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:44.169 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:44.169 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:44.169 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.169 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:44.170 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.170 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:45:44.170 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 22:98:ad:4b:9a:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:45:44.170 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:45:44.170 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.170 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2098:adff:fe4b:9afe/64 scope link tentative 2024-09-21T06:45:44.170 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:44.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 22:98:ad:4b:9a:fe brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T06:45:44.236 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.237 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::2098:adff:fe4b:9afe/64 scope link tentative 2024-09-21T06:45:44.237 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:45:44.237 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T06:45:44.238 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:44.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:44.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:44.389 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:45:44.389 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-21T06:45:44.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.1 up 2024-09-21T06:45:44.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T06:45:44.389 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-21T06:45:44.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:44.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:44.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:44.465 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T06:45:44.480 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T06:45:44.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:45:44.480 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T06:45:44.534 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-21T06:45:44.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:44.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:44.628 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:44.628 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:44.636 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:45:44.636 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:45:44.636 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:45:44.636 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with new device syntax: 3@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:45:44.636 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:45:44.637 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-21T06:45:44.637 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:45:44.637 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:45:44.637 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:45:44.637 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:45:44.639 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:45:44.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:44.639 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T06:45:44.663 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:44.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:44.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:44.759 INFO:teuthology.orchestra.run.smithi089.stdout:client4839 2024-09-21T06:45:44.759 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:44.759 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:44.774 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:44.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:44.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:44.870 INFO:teuthology.orchestra.run.smithi089.stdout:client4839 2024-09-21T06:45:44.870 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:45:44.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:45:44.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:44.925 INFO:teuthology.orchestra.run.smithi089.stdout:client4839 2024-09-21T06:45:44.925 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5acf265c-1f37-45bc-9438-eb9ad71b6190.client4839/status') 2024-09-21T06:45:44.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:45:44.983 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4839 (3)172.21.15.89:0/3625789149 2024-09-21T06:45:44.983 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2024-09-21T06:45:44.983 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2024-09-21T06:45:44.983 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2024-09-21T06:45:44.983 INFO:teuthology.orchestra.run.smithi089.stderr:70 bytes copied, 2.1441e-05 s, 3.3 MB/s 2024-09-21T06:45:44.984 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-21T06:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:45:44.990 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T06:45:45.312 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2024-09-21T06:45:45.312 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-09-21T06:45:45.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 -- 172.21.15.81:0/736254374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c15c450 msgr2=0x7f956c0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 --2- 172.21.15.81:0/736254374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c15c450 0x7f956c0d3220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f955c009830 tx=0x7f955c02a510 comp rx=0 tx=0).stop 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 -- 172.21.15.81:0/736254374 shutdown_connections 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 --2- 172.21.15.81:0/736254374 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f956c0d41a0 0x7f956c0d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 --2- 172.21.15.81:0/736254374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c15c450 0x7f956c0d3220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 -- 172.21.15.81:0/736254374 >> 172.21.15.81:0/736254374 conn(0x7f956c0b7330 msgr2=0x7f956c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 -- 172.21.15.81:0/736254374 shutdown_connections 2024-09-21T06:45:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.438+0000 7f957089b640 1 -- 172.21.15.81:0/736254374 wait complete. 2024-09-21T06:45:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.440+0000 7f957089b640 1 Processor -- start 2024-09-21T06:45:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.440+0000 7f957089b640 1 -- start start 2024-09-21T06:45:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f957089b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c0d41a0 0x7f956c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f957089b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f956c15c450 0x7f956c0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f957089b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f956c15eda0 0x7f956c1f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f957089b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0b35c0 con 0x7f956c15eda0 2024-09-21T06:45:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f957089b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f956c0b3440 con 0x7f956c0d41a0 2024-09-21T06:45:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f957089b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f956c0b3740 con 0x7f956c15c450 2024-09-21T06:45:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f956c15eda0 0x7f956c1f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f956c15eda0 0x7f956c1f9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48312/0 (socket says 172.21.15.81:48312) 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 -- 172.21.15.81:0/4236044328 learned_addr learned my addr 172.21.15.81:0/4236044328 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f9561d9b640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f956c15c450 0x7f956c0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956a59c640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c0d41a0 0x7f956c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 -- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f956c15c450 msgr2=0x7f956c0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f956c15c450 0x7f956c0c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 -- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c0d41a0 msgr2=0x7f956c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c0d41a0 0x7f956c0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 -- 172.21.15.81:0/4236044328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c0cabe0 con 0x7f956c15eda0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f956ad9d640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f956c15eda0 0x7f956c1f9010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f956400ea70 tx=0x7f956400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.442+0000 7f95637fe640 1 -- 172.21.15.81:0/4236044328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956400ce40 con 0x7f956c15eda0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.443+0000 7f95637fe640 1 -- 172.21.15.81:0/4236044328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9564004c10 con 0x7f956c15eda0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.443+0000 7f95637fe640 1 -- 172.21.15.81:0/4236044328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564005020 con 0x7f956c15eda0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.443+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c0caec0 con 0x7f956c15eda0 2024-09-21T06:45:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.443+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c0b4990 con 0x7f956c15eda0 2024-09-21T06:45:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.444+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956c08d110 con 0x7f956c15eda0 2024-09-21T06:45:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.444+0000 7f95637fe640 1 -- 172.21.15.81:0/4236044328 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95640051c0 con 0x7f956c15eda0 2024-09-21T06:45:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.445+0000 7f95637fe640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f954c078b90 0x7f954c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.445+0000 7f95637fe640 1 -- 172.21.15.81:0/4236044328 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f956409be30 con 0x7f956c15eda0 2024-09-21T06:45:45.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.445+0000 7f956a59c640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f954c078b90 0x7f954c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.446+0000 7f956a59c640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f954c078b90 0x7f954c07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f955c034000 tx=0x7f955c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.450+0000 7f95637fe640 1 -- 172.21.15.81:0/4236044328 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f956c08d110 con 0x7f956c15eda0 2024-09-21T06:45:45.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.626+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f956c0ca970 con 0x7f956c15eda0 2024-09-21T06:45:45.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.628+0000 7f95637fe640 1 -- 172.21.15.81:0/4236044328 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f9564063fc0 con 0x7f956c15eda0 2024-09-21T06:45:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:45.629 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:45.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f954c078b90 msgr2=0x7f954c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f954c078b90 0x7f954c07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f955c034000 tx=0x7f955c004730 comp rx=0 tx=0).stop 2024-09-21T06:45:45.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f956c15eda0 msgr2=0x7f956c1f9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f956c15eda0 0x7f956c1f9010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f956400ea70 tx=0x7f956400ef30 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 shutdown_connections 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f954c078b90 0x7f954c07b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f956c15c450 0x7f956c0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f956c15eda0 0x7f956c1f9010 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 --2- 172.21.15.81:0/4236044328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f956c0d41a0 0x7f956c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 >> 172.21.15.81:0/4236044328 conn(0x7f956c0b7330 msgr2=0x7f956c0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 shutdown_connections 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.630+0000 7f957089b640 1 -- 172.21.15.81:0/4236044328 wait complete. 2024-09-21T06:45:45.643 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:45:04.668203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:45:12.681285+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:45:13.771629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T06:45:17.477690+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T06:45:45.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:45:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.758+0000 7fae07d20640 1 -- 172.21.15.81:0/3234076728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadec0041c0 msgr2=0x7fadec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.758+0000 7fae07d20640 1 --2- 172.21.15.81:0/3234076728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadec0041c0 0x7fadec004800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fadf00017d0 tx=0x7fadec005830 comp rx=0 tx=0).stop 2024-09-21T06:45:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.758+0000 7fae062bd640 1 -- 172.21.15.81:0/3234076728 reap_dead start 2024-09-21T06:45:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.758+0000 7fae07d20640 1 -- 172.21.15.81:0/3234076728 shutdown_connections 2024-09-21T06:45:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.758+0000 7fae07d20640 1 -- 172.21.15.81:0/3234076728 >> 172.21.15.81:0/3234076728 conn(0x7fae000b4210 msgr2=0x7fae000b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.758+0000 7fae07d20640 1 -- 172.21.15.81:0/3234076728 shutdown_connections 2024-09-21T06:45:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.758+0000 7fae07d20640 1 -- 172.21.15.81:0/3234076728 wait complete. 2024-09-21T06:45:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.760+0000 7fae07d20640 1 Processor -- start 2024-09-21T06:45:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.760+0000 7fae07d20640 1 -- start start 2024-09-21T06:45:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.761+0000 7fae07d20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadec0041c0 0x7fae0015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.761+0000 7fae07d20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae00154ed0 0x7fae001546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.761+0000 7fae07d20640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae000cb430 0x7fae000cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.761+0000 7fae07d20640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae0015e940 con 0x7fae00154ed0 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.761+0000 7fae07d20640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fae0015e7c0 con 0x7fadec0041c0 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.761+0000 7fae07d20640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fae0015eac0 con 0x7fae000cb430 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.761+0000 7fae052bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae00154ed0 0x7fae001546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae00154ed0 0x7fae001546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48320/0 (socket says 172.21.15.81:48320) 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 -- 172.21.15.81:0/2092107957 learned_addr learned my addr 172.21.15.81:0/2092107957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae062bd640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae000cb430 0x7fae000cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae05abc640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadec0041c0 0x7fae0015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 -- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae000cb430 msgr2=0x7fae000cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae000cb430 0x7fae000cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 -- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadec0041c0 msgr2=0x7fae0015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadec0041c0 0x7fae0015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 -- 172.21.15.81:0/2092107957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae00154c20 con 0x7fae00154ed0 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae05abc640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadec0041c0 0x7fae0015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae052bb640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae00154ed0 0x7fae001546e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fadf00018f0 tx=0x7fadf00060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fadf67fc640 1 -- 172.21.15.81:0/2092107957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0043070 con 0x7fae00154ed0 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fadf67fc640 1 -- 172.21.15.81:0/2092107957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadf0003af0 con 0x7fae00154ed0 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fadf67fc640 1 -- 172.21.15.81:0/2092107957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00064c0 con 0x7fae00154ed0 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae000cbd80 con 0x7fae00154ed0 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.762+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae00157890 con 0x7fae00154ed0 2024-09-21T06:45:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.763+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0015efb0 con 0x7fae00154ed0 2024-09-21T06:45:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.764+0000 7fadf67fc640 1 -- 172.21.15.81:0/2092107957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fadf0046070 con 0x7fae00154ed0 2024-09-21T06:45:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.764+0000 7fadf67fc640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fade4078bc0 0x7fade407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.765+0000 7fadf67fc640 1 -- 172.21.15.81:0/2092107957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fadf00baf40 con 0x7fae00154ed0 2024-09-21T06:45:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.765+0000 7fae05abc640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fade4078bc0 0x7fade407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.765+0000 7fae05abc640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fade4078bc0 0x7fade407b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadfc000f60 tx=0x7fadfc000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.769+0000 7fadf67fc640 1 -- 172.21.15.81:0/2092107957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fae000cbd80 con 0x7fae00154ed0 2024-09-21T06:45:45.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.946+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fae00157320 con 0x7fae00154ed0 2024-09-21T06:45:45.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.946+0000 7fadf67fc640 1 -- 172.21.15.81:0/2092107957 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fae00154c20 con 0x7fae00154ed0 2024-09-21T06:45:45.947 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fade4078bc0 msgr2=0x7fade407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fade4078bc0 0x7fade407b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadfc000f60 tx=0x7fadfc000ed0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae00154ed0 msgr2=0x7fae001546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae00154ed0 0x7fae001546e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fadf00018f0 tx=0x7fadf00060e0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 shutdown_connections 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fade4078bc0 0x7fade407b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae000cb430 0x7fae000cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae00154ed0 0x7fae001546e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 --2- 172.21.15.81:0/2092107957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadec0041c0 0x7fae0015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 >> 172.21.15.81:0/2092107957 conn(0x7fae000b4210 msgr2=0x7fae00071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 shutdown_connections 2024-09-21T06:45:45.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:45.948+0000 7fae07d20640 1 -- 172.21.15.81:0/2092107957 wait complete. 2024-09-21T06:45:45.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 -- 172.21.15.81:0/4113438399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e01602a0 msgr2=0x7ff2e01606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 --2- 172.21.15.81:0/4113438399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e01602a0 0x7ff2e01606b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0073f20 tx=0x7ff2d802a560 comp rx=0 tx=0).stop 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 -- 172.21.15.81:0/4113438399 shutdown_connections 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 --2- 172.21.15.81:0/4113438399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e01602a0 0x7ff2e01606b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 --2- 172.21.15.81:0/4113438399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2e00d1340 0x7ff2e00d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 --2- 172.21.15.81:0/4113438399 >> v2:172.21.15.89:3300/0 conn(0x7ff2e00cfda0 0x7ff2e015d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 -- 172.21.15.81:0/4113438399 >> 172.21.15.81:0/4113438399 conn(0x7ff2e00b4210 msgr2=0x7ff2e00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 -- 172.21.15.81:0/4113438399 shutdown_connections 2024-09-21T06:45:46.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.074+0000 7ff2e717b640 1 -- 172.21.15.81:0/4113438399 wait complete. 2024-09-21T06:45:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.076+0000 7ff2e717b640 1 Processor -- start 2024-09-21T06:45:46.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.076+0000 7ff2e717b640 1 -- start start 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.077+0000 7ff2e717b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2e00cfda0 0x7ff2e01f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e717b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00d1340 0x7ff2e01f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e717b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2e01602a0 0x7ff2e0147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e717b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e0160bf0 con 0x7ff2e00d1340 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e717b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e01571c0 con 0x7ff2e00cfda0 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e717b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e0160d70 con 0x7ff2e01602a0 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00d1340 0x7ff2e01f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00d1340 0x7ff2e01f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48334/0 (socket says 172.21.15.81:48334) 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 -- 172.21.15.81:0/632661573 learned_addr learned my addr 172.21.15.81:0/632661573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e5718640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2e01602a0 0x7ff2e0147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e4f17640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2e00cfda0 0x7ff2e01f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 -- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2e01602a0 msgr2=0x7ff2e0147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2e01602a0 0x7ff2e0147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 -- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2e00cfda0 msgr2=0x7ff2e01f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2e00cfda0 0x7ff2e01f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 -- 172.21.15.81:0/632661573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e00cb210 con 0x7ff2e00d1340 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dffff640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00d1340 0x7ff2e01f5710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c970 tx=0x7ff2c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dd7fa640 1 -- 172.21.15.81:0/632661573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8007bb0 con 0x7ff2e00d1340 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dd7fa640 1 -- 172.21.15.81:0/632661573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2c8007d50 con 0x7ff2e00d1340 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e00cb4f0 con 0x7ff2e00d1340 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2dd7fa640 1 -- 172.21.15.81:0/632661573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8005280 con 0x7ff2e00d1340 2024-09-21T06:45:46.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.078+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e00cbab0 con 0x7ff2e00d1340 2024-09-21T06:45:46.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.079+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e00d1750 con 0x7ff2e00d1340 2024-09-21T06:45:46.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.080+0000 7ff2dd7fa640 1 -- 172.21.15.81:0/632661573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2c8005420 con 0x7ff2e00d1340 2024-09-21T06:45:46.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.080+0000 7ff2dd7fa640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2c0078bc0 0x7ff2c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.081+0000 7ff2dd7fa640 1 -- 172.21.15.81:0/632661573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff2c809b520 con 0x7ff2e00d1340 2024-09-21T06:45:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.081+0000 7ff2e4f17640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2c0078bc0 0x7ff2c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.081+0000 7ff2e4f17640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2c0078bc0 0x7ff2c007b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000a2e0 tx=0x7ff2d000a270 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:46.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.085+0000 7ff2dd7fa640 1 -- 172.21.15.81:0/632661573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff2c8014030 con 0x7ff2e00d1340 2024-09-21T06:45:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.262+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff2e0148be0 con 0x7ff2e00d1340 2024-09-21T06:45:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.263+0000 7ff2dd7fa640 1 -- 172.21.15.81:0/632661573 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff2c80635a0 con 0x7ff2e00d1340 2024-09-21T06:45:46.264 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-21T06:45:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2c0078bc0 msgr2=0x7ff2c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2c0078bc0 0x7ff2c007b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000a2e0 tx=0x7ff2d000a270 comp rx=0 tx=0).stop 2024-09-21T06:45:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00d1340 msgr2=0x7ff2e01f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00d1340 0x7ff2e01f5710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c970 tx=0x7ff2c800ce30 comp rx=0 tx=0).stop 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 shutdown_connections 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2c0078bc0 0x7ff2c007b0d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2e01602a0 0x7ff2e0147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2e00d1340 0x7ff2e01f5710 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 --2- 172.21.15.81:0/632661573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2e00cfda0 0x7ff2e01f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 >> 172.21.15.81:0/632661573 conn(0x7ff2e00b4210 msgr2=0x7ff2e00c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 shutdown_connections 2024-09-21T06:45:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.265+0000 7ff2e717b640 1 -- 172.21.15.81:0/632661573 wait complete. 2024-09-21T06:45:46.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 -- 172.21.15.81:0/2900306805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006dea0 msgr2=0x7f179006e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 --2- 172.21.15.81:0/2900306805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006dea0 0x7f179006e2b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1788005fd0 tx=0x7f178802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 -- 172.21.15.81:0/2900306805 shutdown_connections 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 --2- 172.21.15.81:0/2900306805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179006dea0 0x7f179006e2b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 --2- 172.21.15.81:0/2900306805 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179015f030 0x7f179015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 -- 172.21.15.81:0/2900306805 >> 172.21.15.81:0/2900306805 conn(0x7f17900d0ae0 msgr2=0x7f17900d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 -- 172.21.15.81:0/2900306805 shutdown_connections 2024-09-21T06:45:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.392+0000 7f17986b6640 1 -- 172.21.15.81:0/2900306805 wait complete. 2024-09-21T06:45:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.394+0000 7f17986b6640 1 Processor -- start 2024-09-21T06:45:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.394+0000 7f17986b6640 1 -- start start 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f17986b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006dea0 0x7f179014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f17986b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17901590f0 0x7f179006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f17986b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179015f030 0x7f179006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f17986b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17900cea60 con 0x7f179015f030 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f17986b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f17900ce8e0 con 0x7f17901590f0 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f17986b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f17900cebe0 con 0x7f179006dea0 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f1796c53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179015f030 0x7f179006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f1796c53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179015f030 0x7f179006d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48344/0 (socket says 172.21.15.81:48344) 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f1796c53640 1 -- 172.21.15.81:0/1266277567 learned_addr learned my addr 172.21.15.81:0/1266277567 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f1795c51640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17901590f0 0x7f179006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.395+0000 7f1796452640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006dea0 0x7f179014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1796c53640 1 -- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006dea0 msgr2=0x7f179014e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1796c53640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006dea0 0x7f179014e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1796c53640 1 -- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17901590f0 msgr2=0x7f179006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1796c53640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17901590f0 0x7f179006cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1796c53640 1 -- 172.21.15.81:0/1266277567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179014ea60 con 0x7f179015f030 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1796c53640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179015f030 0x7f179006d2d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1788006010 tx=0x7f1788003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1786ffd640 1 -- 172.21.15.81:0/1266277567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178803e030 con 0x7f179015f030 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1786ffd640 1 -- 172.21.15.81:0/1266277567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1788003c20 con 0x7f179015f030 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f1786ffd640 1 -- 172.21.15.81:0/1266277567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788035040 con 0x7f179015f030 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901f4060 con 0x7f179015f030 2024-09-21T06:45:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.396+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17900c5dd0 con 0x7f179015f030 2024-09-21T06:45:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.397+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f179014ec30 con 0x7f179015f030 2024-09-21T06:45:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.398+0000 7f1786ffd640 1 -- 172.21.15.81:0/1266277567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1788041030 con 0x7f179015f030 2024-09-21T06:45:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.398+0000 7f1786ffd640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.398+0000 7f1786ffd640 1 -- 172.21.15.81:0/1266277567 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f17880bb9c0 con 0x7f179015f030 2024-09-21T06:45:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.399+0000 7f1796452640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.399+0000 7f1796452640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f178c001e20 tx=0x7f178c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.402+0000 7f1786ffd640 1 -- 172.21.15.81:0/1266277567 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f179014ec30 con 0x7f179015f030 2024-09-21T06:45:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.581+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f17900cf090 con 0x7f179015f030 2024-09-21T06:45:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.582+0000 7f1786ffd640 1 -- 172.21.15.81:0/1266277567 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f1788083590 con 0x7f179015f030 2024-09-21T06:45:46.583 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-21T06:45:46.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 msgr2=0x7f177407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f178c001e20 tx=0x7f178c009040 comp rx=0 tx=0).stop 2024-09-21T06:45:46.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179015f030 msgr2=0x7f179006d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179015f030 0x7f179006d2d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1788006010 tx=0x7f1788003820 comp rx=0 tx=0).stop 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 shutdown_connections 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1774078b90 0x7f177407b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f179015f030 0x7f179006d2d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17901590f0 0x7f179006cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 --2- 172.21.15.81:0/1266277567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006dea0 0x7f179014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 >> 172.21.15.81:0/1266277567 conn(0x7f17900d0ae0 msgr2=0x7f179015e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 shutdown_connections 2024-09-21T06:45:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.584+0000 7f17986b6640 1 -- 172.21.15.81:0/1266277567 wait complete. 2024-09-21T06:45:46.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T06:45:46.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.710+0000 7f17b9fe6640 1 -- 172.21.15.81:0/1861320473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b415a290 msgr2=0x7f17b41601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.710+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/1861320473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b415a290 0x7f17b41601c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009830 tx=0x7f17a802a480 comp rx=0 tx=0).stop 2024-09-21T06:45:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.710+0000 7f17b9fe6640 1 -- 172.21.15.81:0/1861320473 shutdown_connections 2024-09-21T06:45:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.710+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/1861320473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b415a290 0x7f17b41601c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.710+0000 7f17b9fe6640 1 -- 172.21.15.81:0/1861320473 >> 172.21.15.81:0/1861320473 conn(0x7f17b40d25e0 msgr2=0x7f17b40d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.710+0000 7f17b9fe6640 1 -- 172.21.15.81:0/1861320473 shutdown_connections 2024-09-21T06:45:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.710+0000 7f17b9fe6640 1 -- 172.21.15.81:0/1861320473 wait complete. 2024-09-21T06:45:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.712+0000 7f17b9fe6640 1 Processor -- start 2024-09-21T06:45:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.712+0000 7f17b9fe6640 1 -- start start 2024-09-21T06:45:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b9fe6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b40d19a0 0x7f17b40c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b9fe6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b415a290 0x7f17b406f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b9fe6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b415d2c0 0x7f17b40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b9fe6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17b415d6d0 con 0x7f17b40d19a0 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b9fe6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f17b4073660 con 0x7f17b415a290 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b9fe6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f17b415d850 con 0x7f17b415d2c0 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b40d19a0 0x7f17b40c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b40d19a0 0x7f17b40c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48366/0 (socket says 172.21.15.81:48366) 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b37fe640 1 -- 172.21.15.81:0/2524892543 learned_addr learned my addr 172.21.15.81:0/2524892543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b2ffd640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b415a290 0x7f17b406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.713+0000 7f17b3fff640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b415d2c0 0x7f17b40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b37fe640 1 -- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b415d2c0 msgr2=0x7f17b40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b37fe640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b415d2c0 0x7f17b40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b37fe640 1 -- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b415a290 msgr2=0x7f17b406f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b37fe640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b415a290 0x7f17b406f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b37fe640 1 -- 172.21.15.81:0/2524892543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b40c5e90 con 0x7f17b40d19a0 2024-09-21T06:45:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b2ffd640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b415a290 0x7f17b406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b37fe640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b40d19a0 0x7f17b40c6700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17a400c3c0 tx=0x7f17a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f179bfff640 1 -- 172.21.15.81:0/2524892543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4017070 con 0x7f17b40d19a0 2024-09-21T06:45:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f179bfff640 1 -- 172.21.15.81:0/2524892543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17a40035f0 con 0x7f17b40d19a0 2024-09-21T06:45:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b40c6170 con 0x7f17b40d19a0 2024-09-21T06:45:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f179bfff640 1 -- 172.21.15.81:0/2524892543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4003a80 con 0x7f17b40d19a0 2024-09-21T06:45:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.714+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b406ed30 con 0x7f17b40d19a0 2024-09-21T06:45:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.715+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b40c63b0 con 0x7f17b40d19a0 2024-09-21T06:45:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.716+0000 7f179bfff640 1 -- 172.21.15.81:0/2524892543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f17a401a070 con 0x7f17b40d19a0 2024-09-21T06:45:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.716+0000 7f179bfff640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f17a0078b90 0x7f17a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.716+0000 7f179bfff640 1 -- 172.21.15.81:0/2524892543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f17a409a390 con 0x7f17b40d19a0 2024-09-21T06:45:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.716+0000 7f17b2ffd640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f17a0078b90 0x7f17a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:46.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.717+0000 7f17b2ffd640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f17a0078b90 0x7f17a007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17a8034000 tx=0x7f17a8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:46.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.721+0000 7f179bfff640 1 -- 172.21.15.81:0/2524892543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f17b40c63b0 con 0x7f17b40d19a0 2024-09-21T06:45:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.897+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f17b40ccd20 con 0x7f17b40d19a0 2024-09-21T06:45:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.897+0000 7f179bfff640 1 -- 172.21.15.81:0/2524892543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f17b40ccd20 con 0x7f17b40d19a0 2024-09-21T06:45:46.899 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f17a0078b90 msgr2=0x7f17a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f17a0078b90 0x7f17a007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17a8034000 tx=0x7f17a8004730 comp rx=0 tx=0).stop 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b40d19a0 msgr2=0x7f17b40c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b40d19a0 0x7f17b40c6700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f17a400c3c0 tx=0x7f17a400c880 comp rx=0 tx=0).stop 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 shutdown_connections 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f17a0078b90 0x7f17a007b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17b415d2c0 0x7f17b40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17b415a290 0x7f17b406f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 --2- 172.21.15.81:0/2524892543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b40d19a0 0x7f17b40c6700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 >> 172.21.15.81:0/2524892543 conn(0x7f17b40d25e0 msgr2=0x7f17b40d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:46.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.899+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 shutdown_connections 2024-09-21T06:45:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:46.900+0000 7f17b9fe6640 1 -- 172.21.15.81:0/2524892543 wait complete. 2024-09-21T06:45:46.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 -- 172.21.15.81:0/4213537553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1406f630 msgr2=0x7fbf140ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 --2- 172.21.15.81:0/4213537553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1406f630 0x7fbf140ada70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbf1406e100 tx=0x7fbf0802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 -- 172.21.15.81:0/4213537553 shutdown_connections 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 --2- 172.21.15.81:0/4213537553 >> v2:172.21.15.89:3300/0 conn(0x7fbf140adfb0 0x7fbf1406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 --2- 172.21.15.81:0/4213537553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1406f630 0x7fbf140ada70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 --2- 172.21.15.81:0/4213537553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf140b4c60 0x7fbf140b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 -- 172.21.15.81:0/4213537553 >> 172.21.15.81:0/4213537553 conn(0x7fbf140b2030 msgr2=0x7fbf140b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.022+0000 7fbf1a638640 1 -- 172.21.15.81:0/4213537553 shutdown_connections 2024-09-21T06:45:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.023+0000 7fbf1a638640 1 -- 172.21.15.81:0/4213537553 wait complete. 2024-09-21T06:45:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.024+0000 7fbf1a638640 1 Processor -- start 2024-09-21T06:45:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.024+0000 7fbf1a638640 1 -- start start 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf1a638640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf1406f630 0x7fbf1415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf1a638640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf140adfb0 0x7fbf1415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf1a638640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf140b4c60 0x7fbf1414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf1a638640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf14158c30 con 0x7fbf140adfb0 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf1a638640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbf14158ab0 con 0x7fbf140b4c60 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf1a638640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fbf140ad1e0 con 0x7fbf1406f630 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf140adfb0 0x7fbf1415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf140adfb0 0x7fbf1415cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48390/0 (socket says 172.21.15.81:48390) 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 -- 172.21.15.81:0/2251896297 learned_addr learned my addr 172.21.15.81:0/2251896297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 -- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf1406f630 msgr2=0x7fbf1415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf18bd5640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf140b4c60 0x7fbf1414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf1406f630 0x7fbf1415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 -- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf140b4c60 msgr2=0x7fbf1414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf140b4c60 0x7fbf1414baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 -- 172.21.15.81:0/2251896297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1414dd90 con 0x7fbf140adfb0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf137fe640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf140adfb0 0x7fbf1415cd90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf08034040 tx=0x7fbf080039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf10ff9640 1 -- 172.21.15.81:0/2251896297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0803e030 con 0x7fbf140adfb0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf10ff9640 1 -- 172.21.15.81:0/2251896297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf080047a0 con 0x7fbf140adfb0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf14153310 con 0x7fbf140adfb0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.026+0000 7fbf10ff9640 1 -- 172.21.15.81:0/2251896297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08035040 con 0x7fbf140adfb0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.027+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1415ee20 con 0x7fbf140adfb0 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.028+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf140b2550 con 0x7fbf140adfb0 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.028+0000 7fbf10ff9640 1 -- 172.21.15.81:0/2251896297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf08041030 con 0x7fbf140adfb0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.029+0000 7fbf10ff9640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf00078b90 0x7fbf0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.029+0000 7fbf10ff9640 1 -- 172.21.15.81:0/2251896297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbf080bb8c0 con 0x7fbf140adfb0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.029+0000 7fbf13fff640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf00078b90 0x7fbf0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.030+0000 7fbf13fff640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf00078b90 0x7fbf0007b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400a860 tx=0x7fbf04005b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.033+0000 7fbf10ff9640 1 -- 172.21.15.81:0/2251896297 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbf1414dd90 con 0x7fbf140adfb0 2024-09-21T06:45:47.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.277+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7fbf1415f190 con 0x7fbf140adfb0 2024-09-21T06:45:47.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.799+0000 7fbf10ff9640 1 -- 172.21.15.81:0/2251896297 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v54) ==== 150+0+0 (secure 0 0 0) 0x7fbf08083a50 con 0x7fbf140adfb0 2024-09-21T06:45:47.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf00078b90 msgr2=0x7fbf0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf00078b90 0x7fbf0007b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400a860 tx=0x7fbf04005b50 comp rx=0 tx=0).stop 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf140adfb0 msgr2=0x7fbf1415cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf140adfb0 0x7fbf1415cd90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf08034040 tx=0x7fbf080039e0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 shutdown_connections 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbf00078b90 0x7fbf0007b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf140b4c60 0x7fbf1414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf140adfb0 0x7fbf1415cd90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 --2- 172.21.15.81:0/2251896297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf1406f630 0x7fbf1415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 >> 172.21.15.81:0/2251896297 conn(0x7fbf140b2030 msgr2=0x7fbf14068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 shutdown_connections 2024-09-21T06:45:47.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.801+0000 7fbf1a638640 1 -- 172.21.15.81:0/2251896297 wait complete. 2024-09-21T06:45:47.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.926+0000 7f92b2acc640 1 -- 172.21.15.81:0/3114368401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac15c640 msgr2=0x7f92ac15ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.926+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3114368401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac15c640 0x7f92ac15ca50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f92a4005fd0 tx=0x7f92a402a820 comp rx=0 tx=0).stop 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.926+0000 7f92b2acc640 1 -- 172.21.15.81:0/3114368401 shutdown_connections 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.926+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3114368401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac15c640 0x7f92ac15ca50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.926+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3114368401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ac0b4b70 0x7f92ac06ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.926+0000 7f92b2acc640 1 -- 172.21.15.81:0/3114368401 >> 172.21.15.81:0/3114368401 conn(0x7f92ac0b2030 msgr2=0x7f92ac0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.926+0000 7f92b2acc640 1 -- 172.21.15.81:0/3114368401 shutdown_connections 2024-09-21T06:45:47.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.927+0000 7f92b2acc640 1 -- 172.21.15.81:0/3114368401 wait complete. 2024-09-21T06:45:47.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.928+0000 7f92b2acc640 1 Processor -- start 2024-09-21T06:45:47.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.928+0000 7f92b2acc640 1 -- start start 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ac0ad1a0 0x7f92ac072d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac0b4b70 0x7f92ac148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac15c640 0x7f92ac09d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac0b3780 con 0x7f92ac0b4b70 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f92ac0b3600 con 0x7f92ac15c640 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f92ac0b3900 con 0x7f92ac0ad1a0 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac0b4b70 0x7f92ac148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac0b4b70 0x7f92ac148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48412/0 (socket says 172.21.15.81:48412) 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 -- 172.21.15.81:0/3206538697 learned_addr learned my addr 172.21.15.81:0/3206538697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b0868640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ac0ad1a0 0x7f92ac072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b1069640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac15c640 0x7f92ac09d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 -- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ac0ad1a0 msgr2=0x7f92ac072d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ac0ad1a0 0x7f92ac072d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 -- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac15c640 msgr2=0x7f92ac09d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac15c640 0x7f92ac09d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 -- 172.21.15.81:0/3206538697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ac09d280 con 0x7f92ac0b4b70 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a3fff640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac0b4b70 0x7f92ac148120 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c430 tx=0x7f929c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a17fa640 1 -- 172.21.15.81:0/3206538697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c011790 con 0x7f92ac0b4b70 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a17fa640 1 -- 172.21.15.81:0/3206538697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f929c017070 con 0x7f92ac0b4b70 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ac09abb0 con 0x7f92ac0b4b70 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92a17fa640 1 -- 172.21.15.81:0/3206538697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c011ca0 con 0x7f92ac0b4b70 2024-09-21T06:45:47.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.930+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ac0c97a0 con 0x7f92ac0b4b70 2024-09-21T06:45:47.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.931+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92ac0c99d0 con 0x7f92ac0b4b70 2024-09-21T06:45:47.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.932+0000 7f92a17fa640 1 -- 172.21.15.81:0/3206538697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f929c01c460 con 0x7f92ac0b4b70 2024-09-21T06:45:47.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.933+0000 7f92a17fa640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9298078b90 0x7f929807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.933+0000 7f92a17fa640 1 -- 172.21.15.81:0/3206538697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f929c09ae50 con 0x7f92ac0b4b70 2024-09-21T06:45:47.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.933+0000 7f92b0868640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9298078b90 0x7f929807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.933+0000 7f92b0868640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9298078b90 0x7f929807b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f92a8005fd0 tx=0x7f92a8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:47.937+0000 7f92a17fa640 1 -- 172.21.15.81:0/3206538697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f929c062fe0 con 0x7f92ac0b4b70 2024-09-21T06:45:48.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.115+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f92ac0b3e60 con 0x7f92ac0b4b70 2024-09-21T06:45:48.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.115+0000 7f92a17fa640 1 -- 172.21.15.81:0/3206538697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f929c0628e0 con 0x7f92ac0b4b70 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_client 20/20 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3876.588034 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4115.510150 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3757.512442 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4044.560836 2024-09-21T06:45:48.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4228.192761 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6498.980548 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4050.688802 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 6012.152376 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:45:48.118 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-21T06:45:48.119 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-21T06:45:48.119 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-21T06:45:48.119 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:45:48.119 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9298078b90 msgr2=0x7f929807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9298078b90 0x7f929807b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f92a8005fd0 tx=0x7f92a8005850 comp rx=0 tx=0).stop 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac0b4b70 msgr2=0x7f92ac148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac0b4b70 0x7f92ac148120 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c430 tx=0x7f929c00c8f0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 shutdown_connections 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9298078b90 0x7f929807b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92ac15c640 0x7f92ac09d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92ac0b4b70 0x7f92ac148120 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 --2- 172.21.15.81:0/3206538697 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92ac0ad1a0 0x7f92ac072d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.117+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 >> 172.21.15.81:0/3206538697 conn(0x7f92ac0b2030 msgr2=0x7f92ac159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.118+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 shutdown_connections 2024-09-21T06:45:48.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.118+0000 7f92b2acc640 1 -- 172.21.15.81:0/3206538697 wait complete. 2024-09-21T06:45:48.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:45:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 -- 172.21.15.81:0/26868427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840b20d0 msgr2=0x7f858415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 --2- 172.21.15.81:0/26868427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840b20d0 0x7f858415d2c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f857c005fd0 tx=0x7f857c02aa50 comp rx=0 tx=0).stop 2024-09-21T06:45:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 -- 172.21.15.81:0/26868427 shutdown_connections 2024-09-21T06:45:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 --2- 172.21.15.81:0/26868427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840b20d0 0x7f858415d2c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 --2- 172.21.15.81:0/26868427 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85841601c0 0x7f85840b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 --2- 172.21.15.81:0/26868427 >> v2:172.21.15.89:3300/0 conn(0x7f85840d19a0 0x7f858415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 -- 172.21.15.81:0/26868427 >> 172.21.15.81:0/26868427 conn(0x7f85840d25e0 msgr2=0x7f85840d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 -- 172.21.15.81:0/26868427 shutdown_connections 2024-09-21T06:45:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.245+0000 7f8589d51640 1 -- 172.21.15.81:0/26868427 wait complete. 2024-09-21T06:45:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.247+0000 7f8589d51640 1 Processor -- start 2024-09-21T06:45:48.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.247+0000 7f8589d51640 1 -- start start 2024-09-21T06:45:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8589d51640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85840b20d0 0x7f85841f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8589d51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840d19a0 0x7f85840cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8589d51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85841601c0 0x7f85840cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8589d51640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8584072d40 con 0x7f85840d19a0 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8589d51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f858415db20 con 0x7f85841601c0 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8589d51640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8584072ec0 con 0x7f85840b20d0 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840d19a0 0x7f85840cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840d19a0 0x7f85840cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47104/0 (socket says 172.21.15.81:47104) 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 -- 172.21.15.81:0/2788997507 learned_addr learned my addr 172.21.15.81:0/2788997507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8583fff640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85841601c0 0x7f85840cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f85837fe640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85840b20d0 0x7f85841f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 -- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85840b20d0 msgr2=0x7f85841f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85840b20d0 0x7f85841f9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 -- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85841601c0 msgr2=0x7f85840cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85841601c0 0x7f85840cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f8582ffd640 1 -- 172.21.15.81:0/2788997507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85841f51f0 con 0x7f85840d19a0 2024-09-21T06:45:48.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.248+0000 7f85837fe640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85840b20d0 0x7f85841f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.249+0000 7f8582ffd640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840d19a0 0x7f85840cb790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f857800c9a0 tx=0x7f857800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.249+0000 7f856bfff640 1 -- 172.21.15.81:0/2788997507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578007bb0 con 0x7f85840d19a0 2024-09-21T06:45:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.249+0000 7f856bfff640 1 -- 172.21.15.81:0/2788997507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8578007e40 con 0x7f85840d19a0 2024-09-21T06:45:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.249+0000 7f856bfff640 1 -- 172.21.15.81:0/2788997507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578005280 con 0x7f85840d19a0 2024-09-21T06:45:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.249+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85841f54b0 con 0x7f85840d19a0 2024-09-21T06:45:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.249+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85841f5a70 con 0x7f85840d19a0 2024-09-21T06:45:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.250+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85840733e0 con 0x7f85840d19a0 2024-09-21T06:45:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.251+0000 7f856bfff640 1 -- 172.21.15.81:0/2788997507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8578005420 con 0x7f85840d19a0 2024-09-21T06:45:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.251+0000 7f856bfff640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8570078b90 0x7f857007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.251+0000 7f856bfff640 1 -- 172.21.15.81:0/2788997507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f857809b420 con 0x7f85840d19a0 2024-09-21T06:45:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.251+0000 7f85837fe640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8570078b90 0x7f857007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.252+0000 7f85837fe640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8570078b90 0x7f857007b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8574005940 tx=0x7f8574005e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.256+0000 7f856bfff640 1 -- 172.21.15.81:0/2788997507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8578014030 con 0x7f85840d19a0 2024-09-21T06:45:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.436+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f85841f9540 con 0x7f85840d19a0 2024-09-21T06:45:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.440+0000 7f856bfff640 1 -- 172.21.15.81:0/2788997507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f85841f9540 con 0x7f85840d19a0 2024-09-21T06:45:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8570078b90 msgr2=0x7f857007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8570078b90 0x7f857007b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8574005940 tx=0x7f8574005e30 comp rx=0 tx=0).stop 2024-09-21T06:45:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840d19a0 msgr2=0x7f85840cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840d19a0 0x7f85840cb790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f857800c9a0 tx=0x7f857800ce60 comp rx=0 tx=0).stop 2024-09-21T06:45:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 shutdown_connections 2024-09-21T06:45:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8570078b90 0x7f857007b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85841601c0 0x7f85840cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85840d19a0 0x7f85840cb790 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 --2- 172.21.15.81:0/2788997507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85840b20d0 0x7f85841f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 >> 172.21.15.81:0/2788997507 conn(0x7f85840d25e0 msgr2=0x7f85840d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 shutdown_connections 2024-09-21T06:45:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.442+0000 7f8589d51640 1 -- 172.21.15.81:0/2788997507 wait complete. 2024-09-21T06:45:48.454 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:45:48.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:45:48.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:45:48.556 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:45:48.557 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:48.557 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:48.573 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:48.573 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:48.629 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:48.629 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:48.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 -- 172.21.15.81:0/2976663150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15c450 msgr2=0x7fa0ac0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 --2- 172.21.15.81:0/2976663150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15c450 0x7fa0ac0d3220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009830 tx=0x7fa0a802a510 comp rx=0 tx=0).stop 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 -- 172.21.15.81:0/2976663150 shutdown_connections 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 --2- 172.21.15.81:0/2976663150 >> v2:172.21.15.89:3300/0 conn(0x7fa0ac15eda0 0x7fa0ac0b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 --2- 172.21.15.81:0/2976663150 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15c450 0x7fa0ac0d3220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 -- 172.21.15.81:0/2976663150 >> 172.21.15.81:0/2976663150 conn(0x7fa0ac0b7330 msgr2=0x7fa0ac0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 -- 172.21.15.81:0/2976663150 shutdown_connections 2024-09-21T06:45:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.840+0000 7fa0b468b640 1 -- 172.21.15.81:0/2976663150 wait complete. 2024-09-21T06:45:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.842+0000 7fa0b468b640 1 Processor -- start 2024-09-21T06:45:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.842+0000 7fa0b468b640 1 -- start start 2024-09-21T06:45:48.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b468b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0ac0b9c00 0x7fa0ac14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b468b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0ac15c450 0x7fa0ac0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b468b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15eda0 0x7fa0ac0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b468b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac0b35c0 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b468b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac0b3440 con 0x7fa0ac15c450 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b468b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ac0b3740 con 0x7fa0ac15eda0 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b2427640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0ac0b9c00 0x7fa0ac14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b2427640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0ac0b9c00 0x7fa0ac14eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47116/0 (socket says 172.21.15.81:47116) 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.843+0000 7fa0b2427640 1 -- 172.21.15.81:0/403195836 learned_addr learned my addr 172.21.15.81:0/403195836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b2c28640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15eda0 0x7fa0ac0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b1c26640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0ac15c450 0x7fa0ac0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b2427640 1 -- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15eda0 msgr2=0x7fa0ac0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b2427640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15eda0 0x7fa0ac0d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b2427640 1 -- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0ac15c450 msgr2=0x7fa0ac0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b2427640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0ac15c450 0x7fa0ac0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b2427640 1 -- 172.21.15.81:0/403195836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac0cb260 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b2427640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0ac0b9c00 0x7fa0ac14eaa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa0a802ab00 tx=0x7fa0a8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0a2ffd640 1 -- 172.21.15.81:0/403195836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8031d60 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0a2ffd640 1 -- 172.21.15.81:0/403195836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0a8033e10 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ac0c8840 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0a2ffd640 1 -- 172.21.15.81:0/403195836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8005260 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.844+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ac151d70 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.845+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ac08d110 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.847+0000 7fa0a2ffd640 1 -- 172.21.15.81:0/403195836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0a8005400 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.847+0000 7fa0a2ffd640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa090078b90 0x7fa09007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.847+0000 7fa0a2ffd640 1 -- 172.21.15.81:0/403195836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa0a80bc520 con 0x7fa0ac0b9c00 2024-09-21T06:45:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.847+0000 7fa0b1c26640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa090078b90 0x7fa09007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.848+0000 7fa0b1c26640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa090078b90 0x7fa09007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0095f0 tx=0x7fa09c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:48.851+0000 7fa0a2ffd640 1 -- 172.21.15.81:0/403195836 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa0ac08d110 con 0x7fa0ac0b9c00 2024-09-21T06:45:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.041+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0ac0d3220 con 0x7fa0ac0b9c00 2024-09-21T06:45:49.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.041+0000 7fa0a2ffd640 1 -- 172.21.15.81:0/403195836 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fa0ac0cb260 con 0x7fa0ac0b9c00 2024-09-21T06:45:49.043 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa090078b90 msgr2=0x7fa09007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa090078b90 0x7fa09007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0095f0 tx=0x7fa09c005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0ac0b9c00 msgr2=0x7fa0ac14eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0ac0b9c00 0x7fa0ac14eaa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa0a802ab00 tx=0x7fa0a8033c20 comp rx=0 tx=0).stop 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 shutdown_connections 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa090078b90 0x7fa09007b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0ac15eda0 0x7fa0ac0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0ac15c450 0x7fa0ac0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 --2- 172.21.15.81:0/403195836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0ac0b9c00 0x7fa0ac14eaa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 >> 172.21.15.81:0/403195836 conn(0x7fa0ac0b7330 msgr2=0x7fa0ac160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 shutdown_connections 2024-09-21T06:45:49.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.043+0000 7fa0b468b640 1 -- 172.21.15.81:0/403195836 wait complete. 2024-09-21T06:45:49.056 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:45:49.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:49.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T06:45:49.082 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:45:49.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:49.082 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:45:49.139 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:49.139 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:49.159 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:49.159 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:49.218 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:49.218 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:49.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:45:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 -- 172.21.15.81:0/25064640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 msgr2=0x7f07980b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 --2- 172.21.15.81:0/25064640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 0x7f07980b2130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0790005fd0 tx=0x7f079002a8a0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 -- 172.21.15.81:0/25064640 shutdown_connections 2024-09-21T06:45:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 --2- 172.21.15.81:0/25064640 >> v2:172.21.15.89:3300/0 conn(0x7f0798160840 0x7f07980b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 --2- 172.21.15.81:0/25064640 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 0x7f07980b2130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 -- 172.21.15.81:0/25064640 >> 172.21.15.81:0/25064640 conn(0x7f07980d21d0 msgr2=0x7f07980d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 -- 172.21.15.81:0/25064640 shutdown_connections 2024-09-21T06:45:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.391+0000 7f079fd94640 1 -- 172.21.15.81:0/25064640 wait complete. 2024-09-21T06:45:49.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.393+0000 7f079fd94640 1 Processor -- start 2024-09-21T06:45:49.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.393+0000 7f079fd94640 1 -- start start 2024-09-21T06:45:49.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079fd94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07980d18e0 0x7f079815f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079fd94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0798160840 0x7f07980b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079fd94640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 0x7f07981581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079fd94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07980b2670 con 0x7f07980d18e0 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079fd94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f07980b3b70 con 0x7f0798160840 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079fd94640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f07980b27f0 con 0x7f0798160c50 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07980d18e0 0x7f079815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07980d18e0 0x7f079815f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47120/0 (socket says 172.21.15.81:47120) 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 -- 172.21.15.81:0/3350146077 learned_addr learned my addr 172.21.15.81:0/3350146077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:49.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079d32f640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0798160840 0x7f07980b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079e331640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 0x7f07981581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 -- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 msgr2=0x7f07981581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 0x7f07981581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 -- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0798160840 msgr2=0x7f07980b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0798160840 0x7f07980b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 -- 172.21.15.81:0/3350146077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07980ca360 con 0x7f07980d18e0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.394+0000 7f079db30640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07980d18e0 0x7f079815f230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f078800c3a0 tx=0x7f078800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.395+0000 7f07967fc640 1 -- 172.21.15.81:0/3350146077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788011790 con 0x7f07980d18e0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.395+0000 7f07967fc640 1 -- 172.21.15.81:0/3350146077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0788017070 con 0x7f07980d18e0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.395+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07980ca640 con 0x7f07980d18e0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.395+0000 7f07967fc640 1 -- 172.21.15.81:0/3350146077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788011cc0 con 0x7f07980d18e0 2024-09-21T06:45:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.395+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07980cac00 con 0x7f07980d18e0 2024-09-21T06:45:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.396+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079815fc90 con 0x7f07980d18e0 2024-09-21T06:45:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.396+0000 7f07967fc640 1 -- 172.21.15.81:0/3350146077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f078801c460 con 0x7f07980d18e0 2024-09-21T06:45:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.397+0000 7f07967fc640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0784078b90 0x7f078407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.397+0000 7f07967fc640 1 -- 172.21.15.81:0/3350146077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f078809adb0 con 0x7f07980d18e0 2024-09-21T06:45:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.397+0000 7f079d32f640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0784078b90 0x7f078407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.398+0000 7f079d32f640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0784078b90 0x7f078407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f078c0095f0 tx=0x7f078c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.402+0000 7f07967fc640 1 -- 172.21.15.81:0/3350146077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f079815fc90 con 0x7f07980d18e0 2024-09-21T06:45:49.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.591+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07980b2d30 con 0x7f07980d18e0 2024-09-21T06:45:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.591+0000 7f07967fc640 1 -- 172.21.15.81:0/3350146077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f07880627e0 con 0x7f07980d18e0 2024-09-21T06:45:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:45:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.593+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0784078b90 msgr2=0x7f078407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.593+0000 7f079fd94640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0784078b90 0x7f078407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f078c0095f0 tx=0x7f078c005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.593+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07980d18e0 msgr2=0x7f079815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.593+0000 7f079fd94640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07980d18e0 0x7f079815f230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f078800c3a0 tx=0x7f078800c860 comp rx=0 tx=0).stop 2024-09-21T06:45:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 shutdown_connections 2024-09-21T06:45:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0784078b90 0x7f078407b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0798160c50 0x7f07981581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0798160840 0x7f07980b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 --2- 172.21.15.81:0/3350146077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07980d18e0 0x7f079815f230 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 >> 172.21.15.81:0/3350146077 conn(0x7f07980d21d0 msgr2=0x7f079815dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 shutdown_connections 2024-09-21T06:45:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.594+0000 7f079fd94640 1 -- 172.21.15.81:0/3350146077 wait complete. 2024-09-21T06:45:49.606 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T06:45:49.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:49.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T06:45:49.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:45:49.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:49.638 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T06:45:49.713 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:49.713 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:49.730 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:49.730 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:49.787 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:45:49.787 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:49.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 -- 172.21.15.81:0/2226522106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 msgr2=0x7f37e015d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 --2- 172.21.15.81:0/2226522106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e015d2c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f37d8005fd0 tx=0x7f37d802aa50 comp rx=0 tx=0).stop 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 -- 172.21.15.81:0/2226522106 shutdown_connections 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 --2- 172.21.15.81:0/2226522106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e015d2c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 --2- 172.21.15.81:0/2226522106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37e01601c0 0x7f37e00b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 --2- 172.21.15.81:0/2226522106 >> v2:172.21.15.89:3300/0 conn(0x7f37e00d19a0 0x7f37e015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 -- 172.21.15.81:0/2226522106 >> 172.21.15.81:0/2226522106 conn(0x7f37e00d25e0 msgr2=0x7f37e00d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 -- 172.21.15.81:0/2226522106 shutdown_connections 2024-09-21T06:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.996+0000 7f37e75c6640 1 -- 172.21.15.81:0/2226522106 wait complete. 2024-09-21T06:45:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.998+0000 7f37e75c6640 1 Processor -- start 2024-09-21T06:45:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.998+0000 7f37e75c6640 1 -- start start 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e75c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e014b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e75c6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37e00d19a0 0x7f37e0147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e75c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e01601c0 0x7f37e014a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e75c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0072d40 con 0x7f37e00b20d0 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e75c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f37e015db20 con 0x7f37e01601c0 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e75c6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f37e0072ec0 con 0x7f37e00d19a0 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e014b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e014b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47130/0 (socket says 172.21.15.81:47130) 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 -- 172.21.15.81:0/1503280249 learned_addr learned my addr 172.21.15.81:0/1503280249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e4b61640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37e00d19a0 0x7f37e0147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5b63640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e01601c0 0x7f37e014a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 -- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37e00d19a0 msgr2=0x7f37e0147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37e00d19a0 0x7f37e0147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 -- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e01601c0 msgr2=0x7f37e014a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e01601c0 0x7f37e014a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 -- 172.21.15.81:0/1503280249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e00cb980 con 0x7f37e00b20d0 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e4b61640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37e00d19a0 0x7f37e0147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5b63640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e01601c0 0x7f37e014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:49.999+0000 7f37e5362640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e014b430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c940 tx=0x7f37dc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.000+0000 7f37d5ffb640 1 -- 172.21.15.81:0/1503280249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc004220 con 0x7f37e00b20d0 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.000+0000 7f37d5ffb640 1 -- 172.21.15.81:0/1503280249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37dc0079b0 con 0x7f37e00b20d0 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.000+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e00cbc60 con 0x7f37e00b20d0 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.000+0000 7f37d5ffb640 1 -- 172.21.15.81:0/1503280249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc007e20 con 0x7f37e00b20d0 2024-09-21T06:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.000+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e00cc220 con 0x7f37e00b20d0 2024-09-21T06:45:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.001+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e00733e0 con 0x7f37e00b20d0 2024-09-21T06:45:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.001+0000 7f37d5ffb640 1 -- 172.21.15.81:0/1503280249 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37dc005020 con 0x7f37e00b20d0 2024-09-21T06:45:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.002+0000 7f37d5ffb640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f37c4078bc0 0x7f37c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.002+0000 7f37d5ffb640 1 -- 172.21.15.81:0/1503280249 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f37dc09b3b0 con 0x7f37e00b20d0 2024-09-21T06:45:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.002+0000 7f37e4b61640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f37c4078bc0 0x7f37c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.003+0000 7f37e4b61640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f37c4078bc0 0x7f37c407b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37e00b1990 tx=0x7f37d0005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.006+0000 7f37d5ffb640 1 -- 172.21.15.81:0/1503280249 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f37dc014030 con 0x7f37e00b20d0 2024-09-21T06:45:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.194+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f37e00d2bc0 con 0x7f37e00b20d0 2024-09-21T06:45:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.195+0000 7f37d5ffb640 1 -- 172.21.15.81:0/1503280249 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f37dc063540 con 0x7f37e00b20d0 2024-09-21T06:45:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:45:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f37c4078bc0 msgr2=0x7f37c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f37c4078bc0 0x7f37c407b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37e00b1990 tx=0x7f37d0005f10 comp rx=0 tx=0).stop 2024-09-21T06:45:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 msgr2=0x7f37e014b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e014b430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c940 tx=0x7f37dc00ce00 comp rx=0 tx=0).stop 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 shutdown_connections 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f37c4078bc0 0x7f37c407b0d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f37e00d19a0 0x7f37e0147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37e01601c0 0x7f37e014a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 --2- 172.21.15.81:0/1503280249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e00b20d0 0x7f37e014b430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 >> 172.21.15.81:0/1503280249 conn(0x7f37e00d25e0 msgr2=0x7f37e00cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 shutdown_connections 2024-09-21T06:45:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.197+0000 7f37e75c6640 1 -- 172.21.15.81:0/1503280249 wait complete. 2024-09-21T06:45:50.209 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T06:45:50.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:50.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T06:45:50.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:45:50.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:50.235 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T06:45:50.292 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:50.292 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:50.311 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:50.312 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:50.370 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:45:50.370 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:45:50.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:45:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.542+0000 7f007b771640 1 -- 172.21.15.81:0/4293745104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005c0053f0 msgr2=0x7f005c00ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.542+0000 7f007b771640 1 --2- 172.21.15.81:0/4293745104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005c0053f0 0x7f005c00ba80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c290 tx=0x7f005c005830 comp rx=0 tx=0).stop 2024-09-21T06:45:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.542+0000 7f007b771640 1 -- 172.21.15.81:0/4293745104 shutdown_connections 2024-09-21T06:45:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.542+0000 7f007b771640 1 --2- 172.21.15.81:0/4293745104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005c0053f0 0x7f005c00ba80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.542+0000 7f007b771640 1 -- 172.21.15.81:0/4293745104 >> 172.21.15.81:0/4293745104 conn(0x7f00740b7330 msgr2=0x7f00740b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.542+0000 7f007b771640 1 -- 172.21.15.81:0/4293745104 shutdown_connections 2024-09-21T06:45:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.542+0000 7f007b771640 1 -- 172.21.15.81:0/4293745104 wait complete. 2024-09-21T06:45:50.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.544+0000 7f007b771640 1 Processor -- start 2024-09-21T06:45:50.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.544+0000 7f007b771640 1 -- start start 2024-09-21T06:45:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f007b771640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00740b62b0 0x7f00740b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f007b771640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00740b53d0 0x7f00740b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f007b771640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f007406dff0 0x7f007406e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f007b771640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00740d4940 con 0x7f00740b53d0 2024-09-21T06:45:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f007b771640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f00740d47c0 con 0x7f00740b62b0 2024-09-21T06:45:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f007b771640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f00740d4ac0 con 0x7f007406dff0 2024-09-21T06:45:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00740b53d0 0x7f00740b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00740b53d0 0x7f00740b57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47140/0 (socket says 172.21.15.81:47140) 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 -- 172.21.15.81:0/3048584774 learned_addr learned my addr 172.21.15.81:0/3048584774 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0079d0e640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f007406dff0 0x7f007406e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f007950d640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00740b62b0 0x7f00740b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 -- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f007406dff0 msgr2=0x7f007406e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f007406dff0 0x7f007406e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 -- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00740b62b0 msgr2=0x7f00740b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00740b62b0 0x7f00740b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 -- 172.21.15.81:0/3048584774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007406cf50 con 0x7f00740b53d0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0078d0c640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00740b53d0 0x7f00740b57e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0068004d90 tx=0x7f0068001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.545+0000 7f0071ffb640 1 -- 172.21.15.81:0/3048584774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068001d40 con 0x7f00740b53d0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.546+0000 7f0071ffb640 1 -- 172.21.15.81:0/3048584774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0068016070 con 0x7f00740b53d0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.546+0000 7f0071ffb640 1 -- 172.21.15.81:0/3048584774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068010b40 con 0x7f00740b53d0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.546+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007406d230 con 0x7f00740b53d0 2024-09-21T06:45:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.546+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007406d7f0 con 0x7f00740b53d0 2024-09-21T06:45:50.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.547+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007408d110 con 0x7f00740b53d0 2024-09-21T06:45:50.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.547+0000 7f0071ffb640 1 -- 172.21.15.81:0/3048584774 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0068010ce0 con 0x7f00740b53d0 2024-09-21T06:45:50.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.548+0000 7f0071ffb640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0060078bc0 0x7f006007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.548+0000 7f0071ffb640 1 -- 172.21.15.81:0/3048584774 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f006809b7a0 con 0x7f00740b53d0 2024-09-21T06:45:50.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.548+0000 7f007950d640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0060078bc0 0x7f006007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.549+0000 7f007950d640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0060078bc0 0x7f006007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f00740d27e0 tx=0x7f0064009550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.553+0000 7f0071ffb640 1 -- 172.21.15.81:0/3048584774 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f007408d110 con 0x7f00740b53d0 2024-09-21T06:45:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.740+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f00740b9880 con 0x7f00740b53d0 2024-09-21T06:45:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.740+0000 7f0071ffb640 1 -- 172.21.15.81:0/3048584774 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f0068063930 con 0x7f00740b53d0 2024-09-21T06:45:50.743 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:45:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0060078bc0 msgr2=0x7f006007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0060078bc0 0x7f006007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f00740d27e0 tx=0x7f0064009550 comp rx=0 tx=0).stop 2024-09-21T06:45:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00740b53d0 msgr2=0x7f00740b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00740b53d0 0x7f00740b57e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0068004d90 tx=0x7f0068001630 comp rx=0 tx=0).stop 2024-09-21T06:45:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 shutdown_connections 2024-09-21T06:45:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0060078bc0 0x7f006007b0d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f007406dff0 0x7f007406e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00740b53d0 0x7f00740b57e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 --2- 172.21.15.81:0/3048584774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00740b62b0 0x7f00740b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 >> 172.21.15.81:0/3048584774 conn(0x7f00740b7330 msgr2=0x7f00740b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 shutdown_connections 2024-09-21T06:45:50.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.743+0000 7f007b771640 1 -- 172.21.15.81:0/3048584774 wait complete. 2024-09-21T06:45:50.756 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T06:45:50.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:50.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T06:45:50.788 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:45:50.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:45:50.788 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T06:45:50.846 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:45:50.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:50.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.957+0000 7f2958094640 1 -- 172.21.15.81:0/2043470672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293c004d40 msgr2=0x7f293c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.957+0000 7f2958094640 1 --2- 172.21.15.81:0/2043470672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293c004d40 0x7f293c005150 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2948009ed0 tx=0x7f293c005830 comp rx=0 tx=0).stop 2024-09-21T06:45:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.957+0000 7f2956631640 1 -- 172.21.15.81:0/2043470672 reap_dead start 2024-09-21T06:45:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.957+0000 7f2958094640 1 -- 172.21.15.81:0/2043470672 shutdown_connections 2024-09-21T06:45:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.957+0000 7f2958094640 1 -- 172.21.15.81:0/2043470672 >> 172.21.15.81:0/2043470672 conn(0x7f29500b7330 msgr2=0x7f29500b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.957+0000 7f2958094640 1 -- 172.21.15.81:0/2043470672 shutdown_connections 2024-09-21T06:45:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.957+0000 7f2958094640 1 -- 172.21.15.81:0/2043470672 wait complete. 2024-09-21T06:45:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.959+0000 7f2958094640 1 Processor -- start 2024-09-21T06:45:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.959+0000 7f2958094640 1 -- start start 2024-09-21T06:45:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2958094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295014fce0 0x7f295014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2958094640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500d0800 0x7f29500d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2958094640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29501f8d70 0x7f29501f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2958094640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29500d33a0 con 0x7f295014fce0 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2958094640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f29500d3220 con 0x7f29500d0800 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2958094640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f29500d3520 con 0x7f29501f8d70 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2955e30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295014fce0 0x7f295014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2955e30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295014fce0 0x7f295014c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47162/0 (socket says 172.21.15.81:47162) 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2955e30640 1 -- 172.21.15.81:0/3411695477 learned_addr learned my addr 172.21.15.81:0/3411695477 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f2956631640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29501f8d70 0x7f29501f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.960+0000 7f295562f640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500d0800 0x7f29500d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2955e30640 1 -- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29501f8d70 msgr2=0x7f29501f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2955e30640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29501f8d70 0x7f29501f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2955e30640 1 -- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500d0800 msgr2=0x7f29500d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2955e30640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500d0800 0x7f29500d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2955e30640 1 -- 172.21.15.81:0/3411695477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29500d1150 con 0x7f295014fce0 2024-09-21T06:45:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2955e30640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295014fce0 0x7f295014c750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f294c011a50 tx=0x7f294c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f29467fc640 1 -- 172.21.15.81:0/3411695477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c004460 con 0x7f295014fce0 2024-09-21T06:45:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f29467fc640 1 -- 172.21.15.81:0/3411695477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f294c016070 con 0x7f295014fce0 2024-09-21T06:45:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295014f220 con 0x7f295014fce0 2024-09-21T06:45:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f29467fc640 1 -- 172.21.15.81:0/3411695477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c005260 con 0x7f295014fce0 2024-09-21T06:45:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.961+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295014f4e0 con 0x7f295014fce0 2024-09-21T06:45:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.962+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295008d110 con 0x7f295014fce0 2024-09-21T06:45:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.963+0000 7f29467fc640 1 -- 172.21.15.81:0/3411695477 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f294c018030 con 0x7f295014fce0 2024-09-21T06:45:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.963+0000 7f29467fc640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2934078b90 0x7f293407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.963+0000 7f29467fc640 1 -- 172.21.15.81:0/3411695477 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f294c09b5b0 con 0x7f295014fce0 2024-09-21T06:45:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.963+0000 7f295562f640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2934078b90 0x7f293407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.964+0000 7f295562f640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2934078b90 0x7f293407b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2940000c00 tx=0x7f2940006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:50.968+0000 7f29467fc640 1 -- 172.21.15.81:0/3411695477 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f295008d110 con 0x7f295014fce0 2024-09-21T06:45:51.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.181+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29500d45b0 con 0x7f295014fce0 2024-09-21T06:45:51.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.182+0000 7f29467fc640 1 -- 172.21.15.81:0/3411695477 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7f29500d1150 con 0x7f295014fce0 2024-09-21T06:45:51.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:51.184 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:51.184 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2934078b90 msgr2=0x7f293407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2934078b90 0x7f293407b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2940000c00 tx=0x7f2940006040 comp rx=0 tx=0).stop 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295014fce0 msgr2=0x7f295014c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295014fce0 0x7f295014c750 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f294c011a50 tx=0x7f294c011f10 comp rx=0 tx=0).stop 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 shutdown_connections 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2934078b90 0x7f293407b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29501f8d70 0x7f29501f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500d0800 0x7f29500d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 --2- 172.21.15.81:0/3411695477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295014fce0 0x7f295014c750 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 >> 172.21.15.81:0/3411695477 conn(0x7f29500b7330 msgr2=0x7f295015c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 shutdown_connections 2024-09-21T06:45:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.184+0000 7f2958094640 1 -- 172.21.15.81:0/3411695477 wait complete. 2024-09-21T06:45:51.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 -- 172.21.15.81:0/263076794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 msgr2=0x7f9e84165720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/263076794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e84165720 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9e84070610 tx=0x7f9e7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 -- 172.21.15.81:0/263076794 shutdown_connections 2024-09-21T06:45:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/263076794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e84165720 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/263076794 >> v2:172.21.15.89:3300/0 conn(0x7f9e840afac0 0x7f9e8406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 -- 172.21.15.81:0/263076794 >> 172.21.15.81:0/263076794 conn(0x7f9e840740a0 msgr2=0x7f9e840b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 -- 172.21.15.81:0/263076794 shutdown_connections 2024-09-21T06:45:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.309+0000 7f9e8ad20640 1 -- 172.21.15.81:0/263076794 wait complete. 2024-09-21T06:45:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.311+0000 7f9e8ad20640 1 Processor -- start 2024-09-21T06:45:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.311+0000 7f9e8ad20640 1 -- start start 2024-09-21T06:45:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e8ad20640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e8406e6a0 0x7f9e84146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e8ad20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e840afac0 0x7f9e8414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e8ad20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e8414b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e8ad20640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8406f700 con 0x7f9e84163300 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e8ad20640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8409ac40 con 0x7f9e840afac0 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e8ad20640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8406f880 con 0x7f9e8406e6a0 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e892bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e8414b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e892bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e8414b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47180/0 (socket says 172.21.15.81:47180) 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e892bd640 1 -- 172.21.15.81:0/2392150484 learned_addr learned my addr 172.21.15.81:0/2392150484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e83fff640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e840afac0 0x7f9e8414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.312+0000 7f9e88abc640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e8406e6a0 0x7f9e84146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e892bd640 1 -- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e8406e6a0 msgr2=0x7f9e84146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e892bd640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e8406e6a0 0x7f9e84146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e892bd640 1 -- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e840afac0 msgr2=0x7f9e8414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e892bd640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e840afac0 0x7f9e8414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e892bd640 1 -- 172.21.15.81:0/2392150484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8414a5b0 con 0x7f9e84163300 2024-09-21T06:45:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e88abc640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e8406e6a0 0x7f9e84146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e892bd640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e8414b380 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0098f0 tx=0x7f9e7c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e817fa640 1 -- 172.21.15.81:0/2392150484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c031d60 con 0x7f9e84163300 2024-09-21T06:45:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e817fa640 1 -- 172.21.15.81:0/2392150484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e7c033e10 con 0x7f9e84163300 2024-09-21T06:45:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e817fa640 1 -- 172.21.15.81:0/2392150484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c005260 con 0x7f9e84163300 2024-09-21T06:45:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8414a890 con 0x7f9e84163300 2024-09-21T06:45:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.313+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e84153020 con 0x7f9e84163300 2024-09-21T06:45:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.314+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8406eab0 con 0x7f9e84163300 2024-09-21T06:45:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.315+0000 7f9e817fa640 1 -- 172.21.15.81:0/2392150484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e7c005400 con 0x7f9e84163300 2024-09-21T06:45:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.315+0000 7f9e817fa640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9e70078b90 0x7f9e7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.315+0000 7f9e817fa640 1 -- 172.21.15.81:0/2392150484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9e7c0bc110 con 0x7f9e84163300 2024-09-21T06:45:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.315+0000 7f9e88abc640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9e70078b90 0x7f9e7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.316+0000 7f9e88abc640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9e70078b90 0x7f9e7007b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000f60 tx=0x7f9e74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.320+0000 7f9e817fa640 1 -- 172.21.15.81:0/2392150484 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e7c03f030 con 0x7f9e84163300 2024-09-21T06:45:51.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.539+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e8414a340 con 0x7f9e84163300 2024-09-21T06:45:51.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.540+0000 7f9e817fa640 1 -- 172.21.15.81:0/2392150484 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7f9e7c084330 con 0x7f9e84163300 2024-09-21T06:45:51.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:51.542 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:51.543 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9e70078b90 msgr2=0x7f9e7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9e70078b90 0x7f9e7007b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000f60 tx=0x7f9e74009040 comp rx=0 tx=0).stop 2024-09-21T06:45:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 msgr2=0x7f9e8414b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e8414b380 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0098f0 tx=0x7f9e7c033c20 comp rx=0 tx=0).stop 2024-09-21T06:45:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 shutdown_connections 2024-09-21T06:45:51.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9e70078b90 0x7f9e7007b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e84163300 0x7f9e8414b380 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e840afac0 0x7f9e8414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 --2- 172.21.15.81:0/2392150484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9e8406e6a0 0x7f9e84146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 >> 172.21.15.81:0/2392150484 conn(0x7f9e840740a0 msgr2=0x7f9e840b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 shutdown_connections 2024-09-21T06:45:51.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.542+0000 7f9e8ad20640 1 -- 172.21.15.81:0/2392150484 wait complete. 2024-09-21T06:45:51.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.665+0000 7ff52704d640 1 -- 172.21.15.81:0/527289185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5200cfda0 msgr2=0x7ff52015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.665+0000 7ff52704d640 1 --2- 172.21.15.81:0/527289185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5200cfda0 0x7ff52015d730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff510009830 tx=0x7ff51002a510 comp rx=0 tx=0).stop 2024-09-21T06:45:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.665+0000 7ff52704d640 1 -- 172.21.15.81:0/527289185 shutdown_connections 2024-09-21T06:45:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.665+0000 7ff52704d640 1 --2- 172.21.15.81:0/527289185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5200cfda0 0x7ff52015d730 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.665+0000 7ff52704d640 1 -- 172.21.15.81:0/527289185 >> 172.21.15.81:0/527289185 conn(0x7ff5200b4210 msgr2=0x7ff5200b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.665+0000 7ff52704d640 1 -- 172.21.15.81:0/527289185 shutdown_connections 2024-09-21T06:45:51.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.665+0000 7ff52704d640 1 -- 172.21.15.81:0/527289185 wait complete. 2024-09-21T06:45:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.667+0000 7ff52704d640 1 Processor -- start 2024-09-21T06:45:51.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.667+0000 7ff52704d640 1 -- start start 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.668+0000 7ff52704d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5200cfda0 0x7ff5201f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.668+0000 7ff52704d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5200d1340 0x7ff520154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.668+0000 7ff52704d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff52015e0b0 0x7ff52015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff52704d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff52015ef60 con 0x7ff52015e0b0 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff52704d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff52015ede0 con 0x7ff5200cfda0 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff52704d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff52015f0e0 con 0x7ff5200d1340 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff52015e0b0 0x7ff52015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff52015e0b0 0x7ff52015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47206/0 (socket says 172.21.15.81:47206) 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 -- 172.21.15.81:0/4269733407 learned_addr learned my addr 172.21.15.81:0/4269733407 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff51ffff640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5200d1340 0x7ff520154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff524de9640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5200cfda0 0x7ff5201f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 -- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5200d1340 msgr2=0x7ff520154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5200d1340 0x7ff520154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 -- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5200cfda0 msgr2=0x7ff5201f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5200cfda0 0x7ff5201f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 -- 172.21.15.81:0/4269733407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5200c9180 con 0x7ff52015e0b0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff5255ea640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff52015e0b0 0x7ff52015b660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff51800b440 tx=0x7ff51800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff51d7fa640 1 -- 172.21.15.81:0/4269733407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518015020 con 0x7ff52015e0b0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff51d7fa640 1 -- 172.21.15.81:0/4269733407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff518011940 con 0x7ff52015e0b0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52006e060 con 0x7ff52015e0b0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff51d7fa640 1 -- 172.21.15.81:0/4269733407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518011d90 con 0x7ff52015e0b0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.669+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52006e620 con 0x7ff52015e0b0 2024-09-21T06:45:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.670+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52015d730 con 0x7ff52015e0b0 2024-09-21T06:45:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.671+0000 7ff51d7fa640 1 -- 172.21.15.81:0/4269733407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff518018020 con 0x7ff52015e0b0 2024-09-21T06:45:51.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.672+0000 7ff51d7fa640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff500078bc0 0x7ff50007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.672+0000 7ff51d7fa640 1 -- 172.21.15.81:0/4269733407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff51809a770 con 0x7ff52015e0b0 2024-09-21T06:45:51.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.672+0000 7ff524de9640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff500078bc0 0x7ff50007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.672+0000 7ff524de9640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff500078bc0 0x7ff50007b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff510034000 tx=0x7ff510004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.676+0000 7ff51d7fa640 1 -- 172.21.15.81:0/4269733407 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff51801f070 con 0x7ff52015e0b0 2024-09-21T06:45:51.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.855+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5200c6c60 con 0x7ff52015e0b0 2024-09-21T06:45:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.856+0000 7ff51d7fa640 1 -- 172.21.15.81:0/4269733407 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7ff518062220 con 0x7ff52015e0b0 2024-09-21T06:45:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:51.858 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff500078bc0 msgr2=0x7ff50007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff500078bc0 0x7ff50007b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff510034000 tx=0x7ff510004730 comp rx=0 tx=0).stop 2024-09-21T06:45:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff52015e0b0 msgr2=0x7ff52015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff52015e0b0 0x7ff52015b660 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff51800b440 tx=0x7ff51800b900 comp rx=0 tx=0).stop 2024-09-21T06:45:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 shutdown_connections 2024-09-21T06:45:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff500078bc0 0x7ff50007b0d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff5200d1340 0x7ff520154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff52015e0b0 0x7ff52015b660 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 --2- 172.21.15.81:0/4269733407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5200cfda0 0x7ff5201f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 >> 172.21.15.81:0/4269733407 conn(0x7ff5200b4210 msgr2=0x7ff5200b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 shutdown_connections 2024-09-21T06:45:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.858+0000 7ff52704d640 1 -- 172.21.15.81:0/4269733407 wait complete. 2024-09-21T06:45:51.872 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:45:51.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.981+0000 7f938fcbd640 1 -- 172.21.15.81:0/2049948538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815d730 msgr2=0x7f938815e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.981+0000 7f938fcbd640 1 --2- 172.21.15.81:0/2049948538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815d730 0x7f938815e7c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9380005fd0 tx=0x7f938002a8b0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.981+0000 7f938fcbd640 1 -- 172.21.15.81:0/2049948538 shutdown_connections 2024-09-21T06:45:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.981+0000 7f938fcbd640 1 --2- 172.21.15.81:0/2049948538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815d730 0x7f938815e7c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.981+0000 7f938fcbd640 1 -- 172.21.15.81:0/2049948538 >> 172.21.15.81:0/2049948538 conn(0x7f93880b4210 msgr2=0x7f93880b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.981+0000 7f938fcbd640 1 -- 172.21.15.81:0/2049948538 shutdown_connections 2024-09-21T06:45:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.981+0000 7f938fcbd640 1 -- 172.21.15.81:0/2049948538 wait complete. 2024-09-21T06:45:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.983+0000 7f938fcbd640 1 Processor -- start 2024-09-21T06:45:51.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.983+0000 7f938fcbd640 1 -- start start 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.984+0000 7f938fcbd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93880cfda0 0x7f938806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.984+0000 7f938fcbd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f938815d730 0x7f93881f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.984+0000 7f938fcbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9388154f90 0x7f93880c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.984+0000 7f938fcbd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f938815ee80 con 0x7f9388154f90 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.984+0000 7f938fcbd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f938815ed00 con 0x7f93880cfda0 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.984+0000 7f938fcbd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f938815f000 con 0x7f938815d730 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9388154f90 0x7f93880c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9388154f90 0x7f93880c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47224/0 (socket says 172.21.15.81:47224) 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 -- 172.21.15.81:0/583925188 learned_addr learned my addr 172.21.15.81:0/583925188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938d258640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f938815d730 0x7f93881f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938da59640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93880cfda0 0x7f938806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 -- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f938815d730 msgr2=0x7f93881f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f938815d730 0x7f93881f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 -- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93880cfda0 msgr2=0x7f938806dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93880cfda0 0x7f938806dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 -- 172.21.15.81:0/583925188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938806e3e0 con 0x7f9388154f90 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938e25a640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9388154f90 0x7f93880c9a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9380009cd0 tx=0x7f9380003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f937a7fc640 1 -- 172.21.15.81:0/583925188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380031da0 con 0x7f9388154f90 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f937a7fc640 1 -- 172.21.15.81:0/583925188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9380003e10 con 0x7f9388154f90 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938806e8f0 con 0x7f9388154f90 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f937a7fc640 1 -- 172.21.15.81:0/583925188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380033330 con 0x7f9388154f90 2024-09-21T06:45:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.985+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93880c9220 con 0x7f9388154f90 2024-09-21T06:45:51.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.986+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93880d1340 con 0x7f9388154f90 2024-09-21T06:45:51.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.987+0000 7f937a7fc640 1 -- 172.21.15.81:0/583925188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93800334d0 con 0x7f9388154f90 2024-09-21T06:45:51.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.987+0000 7f937a7fc640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f936c078b90 0x7f936c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.987+0000 7f937a7fc640 1 -- 172.21.15.81:0/583925188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f93800bc150 con 0x7f9388154f90 2024-09-21T06:45:51.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.988+0000 7f938da59640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f936c078b90 0x7f936c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.988+0000 7f938da59640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f936c078b90 0x7f936c07b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f93880cfd50 tx=0x7f9384009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:51.992+0000 7f937a7fc640 1 -- 172.21.15.81:0/583925188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f938004a070 con 0x7f9388154f90 2024-09-21T06:45:52.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.207+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f938806e680 con 0x7f9388154f90 2024-09-21T06:45:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.208+0000 7f937a7fc640 1 -- 172.21.15.81:0/583925188 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7f938003f030 con 0x7f9388154f90 2024-09-21T06:45:52.210 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:52.210 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f936c078b90 msgr2=0x7f936c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f936c078b90 0x7f936c07b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f93880cfd50 tx=0x7f9384009040 comp rx=0 tx=0).stop 2024-09-21T06:45:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9388154f90 msgr2=0x7f93880c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9388154f90 0x7f93880c9a20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9380009cd0 tx=0x7f9380003c20 comp rx=0 tx=0).stop 2024-09-21T06:45:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 shutdown_connections 2024-09-21T06:45:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f936c078b90 0x7f936c07b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f938815d730 0x7f93881f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9388154f90 0x7f93880c9a20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 --2- 172.21.15.81:0/583925188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93880cfda0 0x7f938806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 >> 172.21.15.81:0/583925188 conn(0x7f93880b4210 msgr2=0x7f93880b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 shutdown_connections 2024-09-21T06:45:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.210+0000 7f938fcbd640 1 -- 172.21.15.81:0/583925188 wait complete. 2024-09-21T06:45:52.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:45:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 -- 172.21.15.81:0/4041369065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22600d19a0 msgr2=0x7f226015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 --2- 172.21.15.81:0/4041369065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22600d19a0 0x7f226015a290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2250009860 tx=0x7f225002a540 comp rx=0 tx=0).stop 2024-09-21T06:45:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 -- 172.21.15.81:0/4041369065 shutdown_connections 2024-09-21T06:45:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 --2- 172.21.15.81:0/4041369065 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f226015d2c0 0x7f226015d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 --2- 172.21.15.81:0/4041369065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22600d19a0 0x7f226015a290 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 -- 172.21.15.81:0/4041369065 >> 172.21.15.81:0/4041369065 conn(0x7f22600d25e0 msgr2=0x7f22600d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 -- 172.21.15.81:0/4041369065 shutdown_connections 2024-09-21T06:45:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.334+0000 7f2266332640 1 -- 172.21.15.81:0/4041369065 wait complete. 2024-09-21T06:45:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.336+0000 7f2266332640 1 Processor -- start 2024-09-21T06:45:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.336+0000 7f2266332640 1 -- start start 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f2266332640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22600d19a0 0x7f2260159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f2266332640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f226015d2c0 0x7f2260156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f2266332640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22601601c0 0x7f22600c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f2266332640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2260072ec0 con 0x7f226015d2c0 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f2266332640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2260072d40 con 0x7f22601601c0 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f2266332640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f2260073040 con 0x7f22600d19a0 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f226015d2c0 0x7f2260156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f225f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f226015d2c0 0x7f2260156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47248/0 (socket says 172.21.15.81:47248) 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f225f7fe640 1 -- 172.21.15.81:0/861358524 learned_addr learned my addr 172.21.15.81:0/861358524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f225ffff640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22600d19a0 0x7f2260159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.337+0000 7f22648cf640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22601601c0 0x7f22600c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225f7fe640 1 -- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22600d19a0 msgr2=0x7f2260159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225f7fe640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22600d19a0 0x7f2260159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225f7fe640 1 -- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22601601c0 msgr2=0x7f22600c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225f7fe640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22601601c0 0x7f22600c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225f7fe640 1 -- 172.21.15.81:0/861358524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22600b5050 con 0x7f226015d2c0 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225f7fe640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f226015d2c0 0x7f2260156fa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f225400c430 tx=0x7f225400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225cff9640 1 -- 172.21.15.81:0/861358524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254011790 con 0x7f226015d2c0 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225cff9640 1 -- 172.21.15.81:0/861358524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2254017070 con 0x7f226015d2c0 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22600c5fd0 con 0x7f226015d2c0 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f225cff9640 1 -- 172.21.15.81:0/861358524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254011ca0 con 0x7f226015d2c0 2024-09-21T06:45:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.338+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22600c62b0 con 0x7f226015d2c0 2024-09-21T06:45:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.339+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2260069f10 con 0x7f226015d2c0 2024-09-21T06:45:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.340+0000 7f225cff9640 1 -- 172.21.15.81:0/861358524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f225401c460 con 0x7f226015d2c0 2024-09-21T06:45:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.340+0000 7f225cff9640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f224c078bc0 0x7f224c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.340+0000 7f225cff9640 1 -- 172.21.15.81:0/861358524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f225409adc0 con 0x7f226015d2c0 2024-09-21T06:45:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.340+0000 7f225ffff640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f224c078bc0 0x7f224c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.341+0000 7f225ffff640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f224c078bc0 0x7f224c07b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2250034000 tx=0x7f2250004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.345+0000 7f225cff9640 1 -- 172.21.15.81:0/861358524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2254062870 con 0x7f226015d2c0 2024-09-21T06:45:52.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.556+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2260073560 con 0x7f226015d2c0 2024-09-21T06:45:52.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.556+0000 7f225cff9640 1 -- 172.21.15.81:0/861358524 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5213 (secure 0 0 0) 0x7f22540672a0 con 0x7f226015d2c0 2024-09-21T06:45:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:52.559 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-21T06:45:28:724958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4360,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/571766397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":571766397},{"type":"v1","addr":"172.21.15.81:6834","nonce":571766397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/219531073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":219531073},{"type":"v1","addr":"172.21.15.89:6835","nonce":219531073}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1480648590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":1480648590},{"type":"v1","addr":"172.21.15.89:6837","nonce":1480648590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:45:14.810455+0000","modified":"2024-09-21T06:45:28.081395+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4377},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4377":{"gid":4377,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1093840929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1093840929},{"type":"v1","addr":"172.21.15.81:6835","nonce":1093840929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4377,"qdb_cluster":[4377]},"id":1}]} 2024-09-21T06:45:52.560 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-21T06:45:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f224c078bc0 msgr2=0x7f224c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f224c078bc0 0x7f224c07b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2250034000 tx=0x7f2250004730 comp rx=0 tx=0).stop 2024-09-21T06:45:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f226015d2c0 msgr2=0x7f2260156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f226015d2c0 0x7f2260156fa0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f225400c430 tx=0x7f225400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 shutdown_connections 2024-09-21T06:45:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f224c078bc0 0x7f224c07b0d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22601601c0 0x7f22600c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f226015d2c0 0x7f2260156fa0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 --2- 172.21.15.81:0/861358524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22600d19a0 0x7f2260159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 >> 172.21.15.81:0/861358524 conn(0x7f22600d25e0 msgr2=0x7f226015af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 shutdown_connections 2024-09-21T06:45:52.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.559+0000 7f2266332640 1 -- 172.21.15.81:0/861358524 wait complete. 2024-09-21T06:45:52.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:45:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 -- 172.21.15.81:0/1328130824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 msgr2=0x7f71f015d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 --2- 172.21.15.81:0/1328130824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f015d4e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f71e8005fd0 tx=0x7f71e802a530 comp rx=0 tx=0).stop 2024-09-21T06:45:52.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 -- 172.21.15.81:0/1328130824 shutdown_connections 2024-09-21T06:45:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 --2- 172.21.15.81:0/1328130824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f015d4e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 --2- 172.21.15.81:0/1328130824 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f00d1a00 0x7f71f0160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 -- 172.21.15.81:0/1328130824 >> 172.21.15.81:0/1328130824 conn(0x7f71f00cec40 msgr2=0x7f71f00cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 -- 172.21.15.81:0/1328130824 shutdown_connections 2024-09-21T06:45:52.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.689+0000 7f71f55da640 1 -- 172.21.15.81:0/1328130824 wait complete. 2024-09-21T06:45:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.691+0000 7f71f55da640 1 Processor -- start 2024-09-21T06:45:52.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.691+0000 7f71f55da640 1 -- start start 2024-09-21T06:45:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71f55da640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f00d1a00 0x7f71f01f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71f55da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f0160660 0x7f71f00b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71f55da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f00cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71f55da640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71f015e940 con 0x7f71f0160a70 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71f55da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f71f015e7c0 con 0x7f71f0160660 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71f55da640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f71f015eac0 con 0x7f71f00d1a00 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71ef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f00cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71ef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f00cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47262/0 (socket says 172.21.15.81:47262) 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71ef7fe640 1 -- 172.21.15.81:0/3022901835 learned_addr learned my addr 172.21.15.81:0/3022901835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71ee7fc640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f0160660 0x7f71f00b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.692+0000 7f71eeffd640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f00d1a00 0x7f71f01f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71ef7fe640 1 -- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f00d1a00 msgr2=0x7f71f01f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71ef7fe640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f00d1a00 0x7f71f01f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71ef7fe640 1 -- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f0160660 msgr2=0x7f71f00b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71ef7fe640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f0160660 0x7f71f00b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71ef7fe640 1 -- 172.21.15.81:0/3022901835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f01f7760 con 0x7f71f0160a70 2024-09-21T06:45:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71ef7fe640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f00cb900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f71e8006010 tx=0x7f71e8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71e77fe640 1 -- 172.21.15.81:0/3022901835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e803e030 con 0x7f71f0160a70 2024-09-21T06:45:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71e77fe640 1 -- 172.21.15.81:0/3022901835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71e8003e50 con 0x7f71f0160a70 2024-09-21T06:45:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f0143970 con 0x7f71f0160a70 2024-09-21T06:45:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71e77fe640 1 -- 172.21.15.81:0/3022901835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8035040 con 0x7f71f0160a70 2024-09-21T06:45:52.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.693+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f0143f30 con 0x7f71f0160a70 2024-09-21T06:45:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.694+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f01436e0 con 0x7f71f0160a70 2024-09-21T06:45:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.695+0000 7f71e77fe640 1 -- 172.21.15.81:0/3022901835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71e8041030 con 0x7f71f0160a70 2024-09-21T06:45:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.695+0000 7f71e77fe640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f71d0078bc0 0x7f71d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.695+0000 7f71e77fe640 1 -- 172.21.15.81:0/3022901835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f71e80bb8c0 con 0x7f71f0160a70 2024-09-21T06:45:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.695+0000 7f71eeffd640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f71d0078bc0 0x7f71d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.696+0000 7f71eeffd640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f71d0078bc0 0x7f71d007b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005c40 tx=0x7f71e000a530 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.700+0000 7f71e77fe640 1 -- 172.21.15.81:0/3022901835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71f01f7760 con 0x7f71f0160a70 2024-09-21T06:45:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.877+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71f015f7e0 con 0x7f71f0160a70 2024-09-21T06:45:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.878+0000 7f71e77fe640 1 -- 172.21.15.81:0/3022901835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18566 (secure 0 0 0) 0x7f71e8083370 con 0x7f71f0160a70 2024-09-21T06:45:52.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:52.881 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:45:19.855542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:45:12.681285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:45:13.771629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T06:45:17.477690+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:45:52.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f71d0078bc0 msgr2=0x7f71d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f71d0078bc0 0x7f71d007b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005c40 tx=0x7f71e000a530 comp rx=0 tx=0).stop 2024-09-21T06:45:52.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 msgr2=0x7f71f00cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f00cb900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f71e8006010 tx=0x7f71e8003960 comp rx=0 tx=0).stop 2024-09-21T06:45:52.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 shutdown_connections 2024-09-21T06:45:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f71d0078bc0 0x7f71d007b0d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71f0160a70 0x7f71f00cb900 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71f0160660 0x7f71f00b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 --2- 172.21.15.81:0/3022901835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71f00d1a00 0x7f71f01f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 >> 172.21.15.81:0/3022901835 conn(0x7f71f00cec40 msgr2=0x7f71f0071680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 shutdown_connections 2024-09-21T06:45:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:52.881+0000 7f71f55da640 1 -- 172.21.15.81:0/3022901835 wait complete. 2024-09-21T06:45:52.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:45:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 -- 172.21.15.81:0/668994918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240d19a0 msgr2=0x7ff72415a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 --2- 172.21.15.81:0/668994918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240d19a0 0x7ff72415a290 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff714009860 tx=0x7ff71402a540 comp rx=0 tx=0).stop 2024-09-21T06:45:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 -- 172.21.15.81:0/668994918 shutdown_connections 2024-09-21T06:45:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 --2- 172.21.15.81:0/668994918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff72415d2c0 0x7ff72415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 --2- 172.21.15.81:0/668994918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7240d19a0 0x7ff72415a290 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 -- 172.21.15.81:0/668994918 >> 172.21.15.81:0/668994918 conn(0x7ff7240d25e0 msgr2=0x7ff7240d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 -- 172.21.15.81:0/668994918 shutdown_connections 2024-09-21T06:45:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.006+0000 7ff72aa38640 1 -- 172.21.15.81:0/668994918 wait complete. 2024-09-21T06:45:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.007+0000 7ff72aa38640 1 Processor -- start 2024-09-21T06:45:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.008+0000 7ff72aa38640 1 -- start start 2024-09-21T06:45:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff72aa38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7240d19a0 0x7ff7240c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff72aa38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff72415d2c0 0x7ff72414a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff72aa38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7241601c0 0x7ff72414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff72aa38640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff724072ec0 con 0x7ff7240d19a0 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff72aa38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff724072d40 con 0x7ff72415d2c0 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff72aa38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff724073040 con 0x7ff7241601c0 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7240d19a0 0x7ff7240c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7240d19a0 0x7ff7240c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47272/0 (socket says 172.21.15.81:47272) 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 -- 172.21.15.81:0/2637432050 learned_addr learned my addr 172.21.15.81:0/2637432050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff728fd5640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7241601c0 0x7ff72414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff7237fe640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff72415d2c0 0x7ff72414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 -- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7241601c0 msgr2=0x7ff72414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7241601c0 0x7ff72414abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 -- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff72415d2c0 msgr2=0x7ff72414a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff72415d2c0 0x7ff72414a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.009+0000 7ff723fff640 1 -- 172.21.15.81:0/2637432050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72414e490 con 0x7ff7240d19a0 2024-09-21T06:45:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.010+0000 7ff723fff640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7240d19a0 0x7ff7240c5cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff714009980 tx=0x7ff714033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.010+0000 7ff720ff9640 1 -- 172.21.15.81:0/2637432050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714005c90 con 0x7ff7240d19a0 2024-09-21T06:45:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.010+0000 7ff720ff9640 1 -- 172.21.15.81:0/2637432050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff714031e50 con 0x7ff7240d19a0 2024-09-21T06:45:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.010+0000 7ff720ff9640 1 -- 172.21.15.81:0/2637432050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714005260 con 0x7ff7240d19a0 2024-09-21T06:45:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.010+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7240c8fd0 con 0x7ff7240d19a0 2024-09-21T06:45:53.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.010+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7240c8730 con 0x7ff7240d19a0 2024-09-21T06:45:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.011+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff724073560 con 0x7ff7240d19a0 2024-09-21T06:45:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.012+0000 7ff720ff9640 1 -- 172.21.15.81:0/2637432050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff714005400 con 0x7ff7240d19a0 2024-09-21T06:45:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.012+0000 7ff720ff9640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff710078b90 0x7ff71007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.012+0000 7ff720ff9640 1 -- 172.21.15.81:0/2637432050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff7140bc1c0 con 0x7ff7240d19a0 2024-09-21T06:45:53.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.012+0000 7ff7237fe640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff710078b90 0x7ff71007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.013+0000 7ff7237fe640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff710078b90 0x7ff71007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff7240b8050 tx=0x7ff718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.017+0000 7ff720ff9640 1 -- 172.21.15.81:0/2637432050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff71403f030 con 0x7ff7240d19a0 2024-09-21T06:45:53.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.229+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff72415d8e0 con 0x7ff7240d19a0 2024-09-21T06:45:53.232 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-21T06:45:53.230+0000 7ffaf0bb2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:45:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.231+0000 7ff720ff9640 1 -- 172.21.15.81:0/2637432050 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7ff7140842d0 con 0x7ff7240d19a0 2024-09-21T06:45:53.233 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:45:53.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.234+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff710078b90 msgr2=0x7ff71007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.234+0000 7ff72aa38640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff710078b90 0x7ff71007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff7240b8050 tx=0x7ff718009040 comp rx=0 tx=0).stop 2024-09-21T06:45:53.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.234+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7240d19a0 msgr2=0x7ff7240c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.234+0000 7ff72aa38640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7240d19a0 0x7ff7240c5cf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff714009980 tx=0x7ff714033c20 comp rx=0 tx=0).stop 2024-09-21T06:45:53.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 shutdown_connections 2024-09-21T06:45:53.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff710078b90 0x7ff71007b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7241601c0 0x7ff72414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff72415d2c0 0x7ff72414a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 --2- 172.21.15.81:0/2637432050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7240d19a0 0x7ff7240c5cf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 >> 172.21.15.81:0/2637432050 conn(0x7ff7240d25e0 msgr2=0x7ff7240b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:53.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 shutdown_connections 2024-09-21T06:45:53.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.235+0000 7ff72aa38640 1 -- 172.21.15.81:0/2637432050 wait complete. 2024-09-21T06:45:53.239 INFO:tasks.ceph.mds.c.smithi081.stderr: -4266> 2024-09-21T06:45:20.428+0000 7f1d2e63d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:45:53.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:45:53.294 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-21T06:45:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.365+0000 7f32a0add640 1 -- 172.21.15.81:0/2647790398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c0d15b0 msgr2=0x7f329c06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.365+0000 7f32a0add640 1 --2- 172.21.15.81:0/2647790398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c0d15b0 0x7f329c06eac0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3284009830 tx=0x7f328402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.365+0000 7f32a0add640 1 -- 172.21.15.81:0/2647790398 shutdown_connections 2024-09-21T06:45:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.365+0000 7f32a0add640 1 --2- 172.21.15.81:0/2647790398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c0d15b0 0x7f329c06eac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.365+0000 7f32a0add640 1 -- 172.21.15.81:0/2647790398 >> 172.21.15.81:0/2647790398 conn(0x7f329c0740a0 msgr2=0x7f329c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.365+0000 7f32a0add640 1 -- 172.21.15.81:0/2647790398 shutdown_connections 2024-09-21T06:45:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.365+0000 7f32a0add640 1 -- 172.21.15.81:0/2647790398 wait complete. 2024-09-21T06:45:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.367+0000 7f32a0add640 1 Processor -- start 2024-09-21T06:45:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.367+0000 7f32a0add640 1 -- start start 2024-09-21T06:45:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.368+0000 7f32a0add640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c06f000 0x7f329c149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.368+0000 7f32a0add640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f329c0d15b0 0x7f329c0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.368+0000 7f32a0add640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f329c1539d0 0x7f329c0ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32a0add640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f329c167c10 con 0x7f329c0d15b0 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32a0add640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f329c167a90 con 0x7f329c06f000 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32a0add640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f329c167d90 con 0x7f329c1539d0 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f329c0d15b0 0x7f329c0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f329c0d15b0 0x7f329c0ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47298/0 (socket says 172.21.15.81:47298) 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 -- 172.21.15.81:0/2640657655 learned_addr learned my addr 172.21.15.81:0/2640657655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f329a59c640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c06f000 0x7f329c149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f329ad9d640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f329c1539d0 0x7f329c0ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 -- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f329c1539d0 msgr2=0x7f329c0ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f329c1539d0 0x7f329c0ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 -- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c06f000 msgr2=0x7f329c149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c06f000 0x7f329c149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 -- 172.21.15.81:0/2640657655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329c0afde0 con 0x7f329c0d15b0 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f3291d9b640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f329c0d15b0 0x7f329c0ae030 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f328402aa90 tx=0x7f3284033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32937fe640 1 -- 172.21.15.81:0/2640657655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284005c90 con 0x7f329c0d15b0 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32937fe640 1 -- 172.21.15.81:0/2640657655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3284031e50 con 0x7f329c0d15b0 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329c14a2b0 con 0x7f329c0d15b0 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32937fe640 1 -- 172.21.15.81:0/2640657655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284005260 con 0x7f329c0d15b0 2024-09-21T06:45:53.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.369+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f329c0af020 con 0x7f329c0d15b0 2024-09-21T06:45:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.370+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329c06eac0 con 0x7f329c0d15b0 2024-09-21T06:45:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.371+0000 7f32937fe640 1 -- 172.21.15.81:0/2640657655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3284005400 con 0x7f329c0d15b0 2024-09-21T06:45:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.372+0000 7f32937fe640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f327c078bc0 0x7f327c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.372+0000 7f32937fe640 1 -- 172.21.15.81:0/2640657655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6618+0+0 (secure 0 0 0) 0x7f32840bc560 con 0x7f329c0d15b0 2024-09-21T06:45:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.372+0000 7f329a59c640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f327c078bc0 0x7f327c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.373+0000 7f329a59c640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f327c078bc0 0x7f327c07b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f328c001140 tx=0x7f328c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.376+0000 7f32937fe640 1 -- 172.21.15.81:0/2640657655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f328403f030 con 0x7f329c0d15b0 2024-09-21T06:45:53.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:53.590+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f329c0aead0 con 0x7f329c0d15b0 2024-09-21T06:45:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.232+0000 7f32937fe640 1 -- 172.21.15.81:0/2640657655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f3284083fa0 con 0x7f329c0d15b0 2024-09-21T06:45:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f327c078bc0 msgr2=0x7f327c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f327c078bc0 0x7f327c07b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f328c001140 tx=0x7f328c009040 comp rx=0 tx=0).stop 2024-09-21T06:45:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f329c0d15b0 msgr2=0x7f329c0ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f329c0d15b0 0x7f329c0ae030 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f328402aa90 tx=0x7f3284033c20 comp rx=0 tx=0).stop 2024-09-21T06:45:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 shutdown_connections 2024-09-21T06:45:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f327c078bc0 0x7f327c07b0d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f329c1539d0 0x7f329c0ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f329c0d15b0 0x7f329c0ae030 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 --2- 172.21.15.81:0/2640657655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f329c06f000 0x7f329c149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 >> 172.21.15.81:0/2640657655 conn(0x7f329c0740a0 msgr2=0x7f329c15eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 shutdown_connections 2024-09-21T06:45:54.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.235+0000 7f32a0add640 1 -- 172.21.15.81:0/2640657655 wait complete. 2024-09-21T06:45:54.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:45:54.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.403+0000 7f98b7025640 1 -- 172.21.15.81:0/2166708182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b00d1890 msgr2=0x7f98b015ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.403+0000 7f98b7025640 1 --2- 172.21.15.81:0/2166708182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b00d1890 0x7f98b015ce60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98a8005fd0 tx=0x7f98a802a820 comp rx=0 tx=0).stop 2024-09-21T06:45:54.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.403+0000 7f98b7025640 1 -- 172.21.15.81:0/2166708182 shutdown_connections 2024-09-21T06:45:54.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.403+0000 7f98b7025640 1 --2- 172.21.15.81:0/2166708182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b00d1890 0x7f98b015ce60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.403+0000 7f98b7025640 1 -- 172.21.15.81:0/2166708182 >> 172.21.15.81:0/2166708182 conn(0x7f98b009aa30 msgr2=0x7f98b00b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.403+0000 7f98b7025640 1 -- 172.21.15.81:0/2166708182 shutdown_connections 2024-09-21T06:45:54.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.403+0000 7f98b7025640 1 -- 172.21.15.81:0/2166708182 wait complete. 2024-09-21T06:45:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.405+0000 7f98b7025640 1 Processor -- start 2024-09-21T06:45:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.405+0000 7f98b7025640 1 -- start start 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.406+0000 7f98b7025640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b006f200 0x7f98b01f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.406+0000 7f98b7025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b00718f0 0x7f98b01f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.406+0000 7f98b7025640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b00b2320 0x7f98b01f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.406+0000 7f98b7025640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98b015d3a0 con 0x7f98b006f200 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.406+0000 7f98b7025640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f98b00cd880 con 0x7f98b00718f0 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.406+0000 7f98b7025640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f98b015d520 con 0x7f98b00b2320 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b006f200 0x7f98b01f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b006f200 0x7f98b01f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47306/0 (socket says 172.21.15.81:47306) 2024-09-21T06:45:54.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 -- 172.21.15.81:0/825170985 learned_addr learned my addr 172.21.15.81:0/825170985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b55c2640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b00b2320 0x7f98b01f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98affff640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b00718f0 0x7f98b01f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 -- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b00b2320 msgr2=0x7f98b01f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b00b2320 0x7f98b01f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 -- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b00718f0 msgr2=0x7f98b01f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b00718f0 0x7f98b01f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 -- 172.21.15.81:0/825170985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b00b3b40 con 0x7f98b006f200 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98affff640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b00718f0 0x7f98b01f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b4dc1640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b006f200 0x7f98b01f0800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c3a0 tx=0x7f98a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98ad7fa640 1 -- 172.21.15.81:0/825170985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011790 con 0x7f98b006f200 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98ad7fa640 1 -- 172.21.15.81:0/825170985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98a4017070 con 0x7f98b006f200 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b00b1280 con 0x7f98b006f200 2024-09-21T06:45:54.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98ad7fa640 1 -- 172.21.15.81:0/825170985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011cc0 con 0x7f98b006f200 2024-09-21T06:45:54.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.407+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b00b1840 con 0x7f98b006f200 2024-09-21T06:45:54.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.409+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b0160c50 con 0x7f98b006f200 2024-09-21T06:45:54.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.409+0000 7f98ad7fa640 1 -- 172.21.15.81:0/825170985 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98a401c460 con 0x7f98b006f200 2024-09-21T06:45:54.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.410+0000 7f98ad7fa640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9894078b90 0x7f989407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.410+0000 7f98ad7fa640 1 -- 172.21.15.81:0/825170985 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6618+0+0 (secure 0 0 0) 0x7f98a409ad60 con 0x7f98b006f200 2024-09-21T06:45:54.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.410+0000 7f98affff640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9894078b90 0x7f989407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.410+0000 7f98affff640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9894078b90 0x7f989407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f989c006fd0 tx=0x7f989c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.414+0000 7f98ad7fa640 1 -- 172.21.15.81:0/825170985 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f98a4062ea0 con 0x7f98b006f200 2024-09-21T06:45:54.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:54.593+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f98b006eda0 con 0x7f98b006f200 2024-09-21T06:45:55.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.244+0000 7f98ad7fa640 1 -- 172.21.15.81:0/825170985 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f98a40627a0 con 0x7f98b006f200 2024-09-21T06:45:55.246 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:45:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9894078b90 msgr2=0x7f989407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9894078b90 0x7f989407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f989c006fd0 tx=0x7f989c008040 comp rx=0 tx=0).stop 2024-09-21T06:45:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b006f200 msgr2=0x7f98b01f0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b006f200 0x7f98b01f0800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c3a0 tx=0x7f98a400c860 comp rx=0 tx=0).stop 2024-09-21T06:45:55.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 shutdown_connections 2024-09-21T06:45:55.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9894078b90 0x7f989407b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98b00b2320 0x7f98b01f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98b00718f0 0x7f98b01f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 --2- 172.21.15.81:0/825170985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98b006f200 0x7f98b01f0800 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 >> 172.21.15.81:0/825170985 conn(0x7f98b009aa30 msgr2=0x7f98b015e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:55.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 shutdown_connections 2024-09-21T06:45:55.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.247+0000 7f98b7025640 1 -- 172.21.15.81:0/825170985 wait complete. 2024-09-21T06:45:55.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.382+0000 7f8a3efc6640 1 -- 172.21.15.81:0/2822340099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380d1a50 msgr2=0x7f8a3815d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.382+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/2822340099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380d1a50 0x7f8a3815d730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8a380d1030 tx=0x7f8a2402a510 comp rx=0 tx=0).stop 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.383+0000 7f8a3efc6640 1 -- 172.21.15.81:0/2822340099 shutdown_connections 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.383+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/2822340099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380d1a50 0x7f8a3815d730 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.383+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/2822340099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a3815e0b0 0x7f8a3815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.383+0000 7f8a3efc6640 1 -- 172.21.15.81:0/2822340099 >> 172.21.15.81:0/2822340099 conn(0x7f8a380b4210 msgr2=0x7f8a380b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.383+0000 7f8a3efc6640 1 -- 172.21.15.81:0/2822340099 shutdown_connections 2024-09-21T06:45:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.383+0000 7f8a3efc6640 1 -- 172.21.15.81:0/2822340099 wait complete. 2024-09-21T06:45:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.384+0000 7f8a3efc6640 1 Processor -- start 2024-09-21T06:45:55.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.384+0000 7f8a3efc6640 1 -- start start 2024-09-21T06:45:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3efc6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380cfda0 0x7f8a380caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3efc6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a3815e0b0 0x7f8a381f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3efc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3815c4d0 0x7f8a38154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3efc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3815ed90 con 0x7f8a3815c4d0 2024-09-21T06:45:55.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3efc6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3815ec10 con 0x7f8a380cfda0 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3efc6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3815ef10 con 0x7f8a3815e0b0 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3815c4d0 0x7f8a38154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3815c4d0 0x7f8a38154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47308/0 (socket says 172.21.15.81:47308) 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 -- 172.21.15.81:0/3252959151 learned_addr learned my addr 172.21.15.81:0/3252959151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a37fff640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a3815e0b0 0x7f8a381f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3cd62640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380cfda0 0x7f8a380caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 -- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a3815e0b0 msgr2=0x7f8a381f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a3815e0b0 0x7f8a381f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 -- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380cfda0 msgr2=0x7f8a380caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380cfda0 0x7f8a380caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 -- 172.21.15.81:0/3252959151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a380cb770 con 0x7f8a3815c4d0 2024-09-21T06:45:55.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a37fff640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a3815e0b0 0x7f8a381f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.386+0000 7f8a3d563640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3815c4d0 0x7f8a38154f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000efc0 tx=0x7f8a3000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.387+0000 7f8a357fa640 1 -- 172.21.15.81:0/3252959151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3001b070 con 0x7f8a3815c4d0 2024-09-21T06:45:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.387+0000 7f8a357fa640 1 -- 172.21.15.81:0/3252959151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a30003b80 con 0x7f8a3815c4d0 2024-09-21T06:45:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.387+0000 7f8a357fa640 1 -- 172.21.15.81:0/3252959151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004030 con 0x7f8a3815c4d0 2024-09-21T06:45:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.387+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a380cba50 con 0x7f8a3815c4d0 2024-09-21T06:45:55.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.387+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a381f6d70 con 0x7f8a3815c4d0 2024-09-21T06:45:55.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.388+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a381f68b0 con 0x7f8a3815c4d0 2024-09-21T06:45:55.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.388+0000 7f8a357fa640 1 -- 172.21.15.81:0/3252959151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a3001e070 con 0x7f8a3815c4d0 2024-09-21T06:45:55.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.389+0000 7f8a357fa640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a1c078b90 0x7f8a1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:55.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.389+0000 7f8a357fa640 1 -- 172.21.15.81:0/3252959151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6238+0+0 (secure 0 0 0) 0x7f8a3009b520 con 0x7f8a3815c4d0 2024-09-21T06:45:55.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.389+0000 7f8a3cd62640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a1c078b90 0x7f8a1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:55.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.390+0000 7f8a3cd62640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a1c078b90 0x7f8a1c07b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0015e0 tx=0x7f8a2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:55.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.394+0000 7f8a357fa640 1 -- 172.21.15.81:0/3252959151 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8a381f68b0 con 0x7f8a3815c4d0 2024-09-21T06:45:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:55.573+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8a380cb500 con 0x7f8a3815c4d0 2024-09-21T06:45:56.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.252+0000 7f8a357fa640 1 -- 172.21.15.81:0/3252959151 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f8a300631a0 con 0x7f8a3815c4d0 2024-09-21T06:45:56.254 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-21T06:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a1c078b90 msgr2=0x7f8a1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a1c078b90 0x7f8a1c07b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0015e0 tx=0x7f8a2c009040 comp rx=0 tx=0).stop 2024-09-21T06:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3815c4d0 msgr2=0x7f8a38154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3815c4d0 0x7f8a38154f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000efc0 tx=0x7f8a3000c800 comp rx=0 tx=0).stop 2024-09-21T06:45:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 shutdown_connections 2024-09-21T06:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a1c078b90 0x7f8a1c07b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8a3815e0b0 0x7f8a381f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3815c4d0 0x7f8a38154f90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 --2- 172.21.15.81:0/3252959151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8a380cfda0 0x7f8a380caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 >> 172.21.15.81:0/3252959151 conn(0x7f8a380b4210 msgr2=0x7f8a380b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 shutdown_connections 2024-09-21T06:45:56.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.255+0000 7f8a3efc6640 1 -- 172.21.15.81:0/3252959151 wait complete. 2024-09-21T06:45:56.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T06:45:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.396+0000 7f3205982640 1 -- 172.21.15.81:0/3576546359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 msgr2=0x7f31e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.396+0000 7f3205982640 1 --2- 172.21.15.81:0/3576546359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 0x7f31e8003e70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f320006ffd0 tx=0x7f31e8005830 comp rx=0 tx=0).stop 2024-09-21T06:45:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.397+0000 7f31ff7fe640 1 -- 172.21.15.81:0/3576546359 reap_dead start 2024-09-21T06:45:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.397+0000 7f3205982640 1 -- 172.21.15.81:0/3576546359 shutdown_connections 2024-09-21T06:45:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.397+0000 7f3205982640 1 -- 172.21.15.81:0/3576546359 >> 172.21.15.81:0/3576546359 conn(0x7f320009d770 msgr2=0x7f32000b92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.397+0000 7f3205982640 1 -- 172.21.15.81:0/3576546359 shutdown_connections 2024-09-21T06:45:56.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.397+0000 7f3205982640 1 -- 172.21.15.81:0/3576546359 wait complete. 2024-09-21T06:45:56.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.398+0000 7f3205982640 1 Processor -- start 2024-09-21T06:45:56.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.399+0000 7f3205982640 1 -- start start 2024-09-21T06:45:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f3205982640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 0x7f32001f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f3205982640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32000b5f00 0x7f32000b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f3205982640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3200159f20 0x7f320015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f3205982640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32000b3ae0 con 0x7f31e8003a00 2024-09-21T06:45:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f3205982640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f32000b3960 con 0x7f3200159f20 2024-09-21T06:45:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f3205982640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f32000d1500 con 0x7f32000b5f00 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 0x7f32001f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 0x7f32001f9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47318/0 (socket says 172.21.15.81:47318) 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 -- 172.21.15.81:0/2823902220 learned_addr learned my addr 172.21.15.81:0/2823902220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 -- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32000b5f00 msgr2=0x7f32000b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32000b5f00 0x7f32000b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 -- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3200159f20 msgr2=0x7f320015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3200159f20 0x7f320015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 -- 172.21.15.81:0/2823902220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320015a870 con 0x7f31e8003a00 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31feffd640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 0x7f32001f9310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f31f0035040 tx=0x7f31f0005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.400+0000 7f31e7fff640 1 -- 172.21.15.81:0/2823902220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0042020 con 0x7f31e8003a00 2024-09-21T06:45:56.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.401+0000 7f31e7fff640 1 -- 172.21.15.81:0/2823902220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31f00047a0 con 0x7f31e8003a00 2024-09-21T06:45:56.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.401+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32001f60b0 con 0x7f31e8003a00 2024-09-21T06:45:56.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.401+0000 7f31e7fff640 1 -- 172.21.15.81:0/2823902220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f00049d0 con 0x7f31e8003a00 2024-09-21T06:45:56.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.401+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32001f55d0 con 0x7f31e8003a00 2024-09-21T06:45:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.402+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32000d0df0 con 0x7f31e8003a00 2024-09-21T06:45:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.402+0000 7f31e7fff640 1 -- 172.21.15.81:0/2823902220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31f0045020 con 0x7f31e8003a00 2024-09-21T06:45:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.403+0000 7f31e7fff640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f31ec078b90 0x7f31ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.403+0000 7f31e7fff640 1 -- 172.21.15.81:0/2823902220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5795+0+0 (secure 0 0 0) 0x7f31f00bb8f0 con 0x7f31e8003a00 2024-09-21T06:45:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.403+0000 7f31fe7fc640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f31ec078b90 0x7f31ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.404+0000 7f31fe7fc640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f31ec078b90 0x7f31ec07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f320008d0e0 tx=0x7f31f4004120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.407+0000 7f31e7fff640 1 -- 172.21.15.81:0/2823902220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f31f004c030 con 0x7f31e8003a00 2024-09-21T06:45:56.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:56.587+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f32000b1a60 con 0x7f31e8003a00 2024-09-21T06:45:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.258+0000 7f31e7fff640 1 -- 172.21.15.81:0/2823902220 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f320015a870 con 0x7f31e8003a00 2024-09-21T06:45:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f31ec078b90 msgr2=0x7f31ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f31ec078b90 0x7f31ec07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f320008d0e0 tx=0x7f31f4004120 comp rx=0 tx=0).stop 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 msgr2=0x7f32001f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 0x7f32001f9310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f31f0035040 tx=0x7f31f0005400 comp rx=0 tx=0).stop 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 shutdown_connections 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f31ec078b90 0x7f31ec07b0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32000b5f00 0x7f32000b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3200159f20 0x7f320015a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 --2- 172.21.15.81:0/2823902220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31e8003a00 0x7f32001f9310 secure :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f31f0035040 tx=0x7f31f0005400 comp rx=0 tx=0).stop 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.261+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 >> 172.21.15.81:0/2823902220 conn(0x7f320009d770 msgr2=0x7f32000b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.262+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 shutdown_connections 2024-09-21T06:45:57.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.262+0000 7f3205982640 1 -- 172.21.15.81:0/2823902220 wait complete. 2024-09-21T06:45:57.277 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:45:57.277 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:45:57.277 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:45:57.277 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:45:57.277 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:45:57.277 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:45:57.277 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:45:57.278 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:45:57.278 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:45:57.278 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:45:57.278 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:45:57.278 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:45:57.278 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:45:57.278 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:45:57.279 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:45:57.279 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:45:57.287 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:45:57.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:45:57.290 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:45:57.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:45:57.291 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:45:57.291 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:45:57.292 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:45:57.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:45:57.333 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:45:57.333 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:57.334 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:45:57.334 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:45:57.335 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:57.335 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:57.335 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:45:57.336 DEBUG:teuthology.parallel:result is None 2024-09-21T06:45:57.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:45:57.421 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-21T06:45:57.421 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-21T06:45:57.429 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2024-09-21T06:45:57.430 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2024-09-21T06:45:57.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.454+0000 7ffa0e313640 1 -- 172.21.15.81:0/246468426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f0005250 msgr2=0x7ff9f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:57.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.454+0000 7ffa0e313640 1 --2- 172.21.15.81:0/246468426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f0005250 0x7ff9f000b9c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009ed0 tx=0x7ff9f0005830 comp rx=0 tx=0).stop 2024-09-21T06:45:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.454+0000 7ffa0e313640 1 -- 172.21.15.81:0/246468426 shutdown_connections 2024-09-21T06:45:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.454+0000 7ffa0e313640 1 --2- 172.21.15.81:0/246468426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9f0005250 0x7ff9f000b9c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.454+0000 7ffa0e313640 1 -- 172.21.15.81:0/246468426 >> 172.21.15.81:0/246468426 conn(0x7ffa080740a0 msgr2=0x7ffa080b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.454+0000 7ffa0e313640 1 -- 172.21.15.81:0/246468426 shutdown_connections 2024-09-21T06:45:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.454+0000 7ffa0e313640 1 -- 172.21.15.81:0/246468426 wait complete. 2024-09-21T06:45:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.456+0000 7ffa0e313640 1 Processor -- start 2024-09-21T06:45:57.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.456+0000 7ffa0e313640 1 -- start start 2024-09-21T06:45:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa0e313640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9f0005250 0x7ffa081f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa0e313640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa0809bc10 0x7ffa0814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa0e313640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa080d06e0 0x7ffa080d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa0e313640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0809ad70 con 0x7ffa080d06e0 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa0e313640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0809abf0 con 0x7ff9f0005250 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa0e313640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0815cf70 con 0x7ffa0809bc10 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa0c8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa080d06e0 0x7ffa080d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa07fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9f0005250 0x7ffa081f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa077fe640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa0809bc10 0x7ffa0814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa07fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9f0005250 0x7ffa081f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:38076/0 (socket says 172.21.15.81:38076) 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.457+0000 7ffa07fff640 1 -- 172.21.15.81:0/4139107358 learned_addr learned my addr 172.21.15.81:0/4139107358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa07fff640 1 -- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa0809bc10 msgr2=0x7ffa0814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa07fff640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa0809bc10 0x7ffa0814dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa07fff640 1 -- 172.21.15.81:0/4139107358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa080d06e0 msgr2=0x7ffa080d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa07fff640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa080d06e0 0x7ffa080d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa07fff640 1 -- 172.21.15.81:0/4139107358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa080d1030 con 0x7ff9f0005250 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa0c8b0640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa080d06e0 0x7ffa080d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa07fff640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9f0005250 0x7ffa081f6140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8001310 tx=0x7ff9f80017d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa04ff9640 1 -- 172.21.15.81:0/4139107358 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8013720 con 0x7ff9f0005250 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa04ff9640 1 -- 172.21.15.81:0/4139107358 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9f8018020 con 0x7ff9f0005250 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa081f2350 con 0x7ff9f0005250 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa04ff9640 1 -- 172.21.15.81:0/4139107358 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f8013b40 con 0x7ff9f0005250 2024-09-21T06:45:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.458+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa081f2910 con 0x7ff9f0005250 2024-09-21T06:45:57.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.459+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa0815bf20 con 0x7ff9f0005250 2024-09-21T06:45:57.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.460+0000 7ffa04ff9640 1 -- 172.21.15.81:0/4139107358 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9f8013ce0 con 0x7ff9f0005250 2024-09-21T06:45:57.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.460+0000 7ffa04ff9640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff9f4078b90 0x7ff9f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:57.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.460+0000 7ffa04ff9640 1 -- 172.21.15.81:0/4139107358 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7ff9f809df00 con 0x7ff9f0005250 2024-09-21T06:45:57.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.461+0000 7ffa077fe640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff9f4078b90 0x7ff9f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:57.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.461+0000 7ffa077fe640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff9f4078b90 0x7ff9f407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa0806f1a0 tx=0x7ff9fc006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.465+0000 7ffa04ff9640 1 -- 172.21.15.81:0/4139107358 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff9f8022020 con 0x7ff9f0005250 2024-09-21T06:45:57.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:57.653+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ffa080ce2b0 con 0x7ff9f0005250 2024-09-21T06:45:58.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.275+0000 7ffa04ff9640 1 -- 172.21.15.81:0/4139107358 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7ff9f8065fe0 con 0x7ff9f0005250 2024-09-21T06:45:58.277 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff9f4078b90 msgr2=0x7ff9f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff9f4078b90 0x7ff9f407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa0806f1a0 tx=0x7ff9fc006720 comp rx=0 tx=0).stop 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9f0005250 msgr2=0x7ffa081f6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9f0005250 0x7ffa081f6140 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8001310 tx=0x7ff9f80017d0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 shutdown_connections 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff9f4078b90 0x7ff9f407b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa0809bc10 0x7ffa0814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa080d06e0 0x7ffa080d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 --2- 172.21.15.81:0/4139107358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9f0005250 0x7ffa081f6140 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.278+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 >> 172.21.15.81:0/4139107358 conn(0x7ffa080740a0 msgr2=0x7ffa08151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.279+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 shutdown_connections 2024-09-21T06:45:58.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.279+0000 7ffa0e313640 1 -- 172.21.15.81:0/4139107358 wait complete. 2024-09-21T06:45:58.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:45:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.406+0000 7fb4131a1640 1 -- 172.21.15.81:0/2848800385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 msgr2=0x7fb3f4005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.406+0000 7fb4131a1640 1 --2- 172.21.15.81:0/2848800385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 0x7fb3f4005220 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb404009b50 tx=0x7fb3f4005830 comp rx=0 tx=0).stop 2024-09-21T06:45:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.406+0000 7fb41173e640 1 -- 172.21.15.81:0/2848800385 reap_dead start 2024-09-21T06:45:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.406+0000 7fb4131a1640 1 -- 172.21.15.81:0/2848800385 shutdown_connections 2024-09-21T06:45:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.406+0000 7fb4131a1640 1 -- 172.21.15.81:0/2848800385 >> 172.21.15.81:0/2848800385 conn(0x7fb40c0740a0 msgr2=0x7fb40c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:58.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.406+0000 7fb4131a1640 1 -- 172.21.15.81:0/2848800385 shutdown_connections 2024-09-21T06:45:58.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.406+0000 7fb4131a1640 1 -- 172.21.15.81:0/2848800385 wait complete. 2024-09-21T06:45:58.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.407+0000 7fb4131a1640 1 Processor -- start 2024-09-21T06:45:58.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.408+0000 7fb4131a1640 1 -- start start 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb4131a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 0x7fb40c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb4131a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb40c155e90 0x7fb40c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb4131a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb40c14d5d0 0x7fb40c14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb4131a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c09abb0 con 0x7fb3f4004d90 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb4131a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c09aa30 con 0x7fb40c155e90 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb4131a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fb40c164720 con 0x7fb40c14d5d0 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 0x7fb40c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 0x7fb40c1563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39566/0 (socket says 172.21.15.81:39566) 2024-09-21T06:45:58.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 -- 172.21.15.81:0/2284204309 learned_addr learned my addr 172.21.15.81:0/2284204309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb403fff640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb40c155e90 0x7fb40c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb41173e640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb40c14d5d0 0x7fb40c14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 -- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb40c14d5d0 msgr2=0x7fb40c14d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb40c14d5d0 0x7fb40c14d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 -- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb40c155e90 msgr2=0x7fb40c13cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb40c155e90 0x7fb40c13cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb410f3d640 1 -- 172.21.15.81:0/2284204309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40c13d260 con 0x7fb3f4004d90 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.409+0000 7fb403fff640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb40c155e90 0x7fb40c13cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.410+0000 7fb410f3d640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 0x7fb40c1563c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb408006110 tx=0x7fb4080021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.410+0000 7fb4017fa640 1 -- 172.21.15.81:0/2284204309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408015070 con 0x7fb3f4004d90 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.410+0000 7fb4017fa640 1 -- 172.21.15.81:0/2284204309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb40800fb30 con 0x7fb3f4004d90 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.410+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40c155670 con 0x7fb3f4004d90 2024-09-21T06:45:58.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.410+0000 7fb4017fa640 1 -- 172.21.15.81:0/2284204309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408011430 con 0x7fb3f4004d90 2024-09-21T06:45:58.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.410+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40c155c30 con 0x7fb3f4004d90 2024-09-21T06:45:58.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.411+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb40c06eab0 con 0x7fb3f4004d90 2024-09-21T06:45:58.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.412+0000 7fb4017fa640 1 -- 172.21.15.81:0/2284204309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4080115d0 con 0x7fb3f4004d90 2024-09-21T06:45:58.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.412+0000 7fb4017fa640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb3f8078b90 0x7fb3f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.412+0000 7fb4017fa640 1 -- 172.21.15.81:0/2284204309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb40809ba90 con 0x7fb3f4004d90 2024-09-21T06:45:58.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.412+0000 7fb403fff640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb3f8078b90 0x7fb3f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.413+0000 7fb403fff640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb3f8078b90 0x7fb3f807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001240 tx=0x7fb3fc001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.417+0000 7fb4017fa640 1 -- 172.21.15.81:0/2284204309 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb4080641b0 con 0x7fb3f4004d90 2024-09-21T06:45:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.665+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb40c06d1d0 con 0x7fb3f4004d90 2024-09-21T06:45:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.665+0000 7fb4017fa640 1 -- 172.21.15.81:0/2284204309 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+6645 (secure 0 0 0) 0x7fb408063ab0 con 0x7fb3f4004d90 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mUzW5KhAAlWe3DNGFhoHzcZKVslgilw==", 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mrJ6iNxAAYlPzreZVfOBq8uNON7qX6A==", 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mb9hZMhAAHLZ7d0T548EPhF3/h33DeA==", 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5mRC+TAxAAZBxHrZ/8fkiTV5/jI/qPig==", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:45:58.670 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA3a+5m2fjqHRAAP178PuV9yiw9cbo7/1OoVg==", 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-21T06:45:58.671 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA6a+5mIe4HIRAAPkD3C92LH25iaPoKrs66uQ==", 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA9a+5meEnSMRAAf4QZAj2WcogUBB1Y8efOtQ==", 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBBa+5m93HXFRAAAJCY+KY0MQuETBmI44+aNw==", 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBIa+5mo5JTDxAAHWKo3EJWBUAbC8e4WHWQgw==", 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBLa+5mNKVNEhAAdCjnmKVY9GyFjHe+EPqc1Q==", 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBOa+5mdT3YMhAAr7AtNX9uM2SjgIbXyNJvtg==", 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBRa+5mqwVtNRAA2qzg3e3lxipuLSGdwaDlAQ==", 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg==", 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5mA3XZDxAA2aiJXqyvv25Mz518UE+Efg==", 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5mniEcDBAAKVy0qqJUGtHC9okai+CUlQ==", 2024-09-21T06:45:58.677 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5m3tqhExAAfa2YN4jeUlT9G43v8YOo4w==", 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-21T06:45:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5m/Q+kDRAA2/OGarZVfV+FnuCEht6dsw==", 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBia+5mAmA5EBAAqINrIBscFes5I5uPaf6dVw==", 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBia+5mamg5EBAAAPiaoo/uWvcvw8+UNDx7Hg==", 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBia+5mLHE5EBAA1MOhnYT5gwm869p5iyiVYw==", 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBia+5mbHk5EBAA9SJlkKARFoTNxfBf83JIWA==", 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBia+5m/YA5EBAAHQtrPo5MADg4N7FDJDj6Bg==", 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBia+5mZog5EBAAVzhu1FQ/UEvI1J+W3C3JeA==", 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mMvfYJhAAvcvg+BqxohgSrYZxnsWkgw==", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mVfC1IhAAasTz1gRrzWOb3hWmXUQmdw==", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-21T06:45:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:45:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:45:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T06:45:58.684 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:45:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb3f8078b90 msgr2=0x7fb3f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb3f8078b90 0x7fb3f807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001240 tx=0x7fb3fc001190 comp rx=0 tx=0).stop 2024-09-21T06:45:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 msgr2=0x7fb40c1563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 0x7fb40c1563c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb408006110 tx=0x7fb4080021f0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 shutdown_connections 2024-09-21T06:45:58.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb3f8078b90 0x7fb3f807b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb40c14d5d0 0x7fb40c14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb40c155e90 0x7fb40c13cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 --2- 172.21.15.81:0/2284204309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3f4004d90 0x7fb40c1563c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 >> 172.21.15.81:0/2284204309 conn(0x7fb40c0740a0 msgr2=0x7fb40c0cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 shutdown_connections 2024-09-21T06:45:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.668+0000 7fb4131a1640 1 -- 172.21.15.81:0/2284204309 wait complete. 2024-09-21T06:45:58.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 -- 172.21.15.81:0/1754262730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 msgr2=0x7faa1415a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 --2- 172.21.15.81:0/1754262730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 0x7faa1415a290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faa04009be0 tx=0x7faa0402a870 comp rx=0 tx=0).stop 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 -- 172.21.15.81:0/1754262730 shutdown_connections 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 --2- 172.21.15.81:0/1754262730 >> v2:172.21.15.89:3300/0 conn(0x7faa141601c0 0x7faa140b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 --2- 172.21.15.81:0/1754262730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 0x7faa1415a290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 -- 172.21.15.81:0/1754262730 >> 172.21.15.81:0/1754262730 conn(0x7faa140d25e0 msgr2=0x7faa140d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 -- 172.21.15.81:0/1754262730 shutdown_connections 2024-09-21T06:45:58.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.797+0000 7faa18e5c640 1 -- 172.21.15.81:0/1754262730 wait complete. 2024-09-21T06:45:58.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.799+0000 7faa18e5c640 1 Processor -- start 2024-09-21T06:45:58.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.799+0000 7faa18e5c640 1 -- start start 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa140b20d0 0x7faa1414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 0x7faa140b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa141601c0 0x7faa140b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa14072ec0 con 0x7faa140b20d0 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7faa14072d40 con 0x7faa141601c0 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7faa14073040 con 0x7faa140d19a0 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa140b20d0 0x7faa1414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa140b20d0 0x7faa1414d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39568/0 (socket says 172.21.15.81:39568) 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 -- 172.21.15.81:0/3732142063 learned_addr learned my addr 172.21.15.81:0/3732142063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:58.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa11d9b640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 0x7faa140b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa12d9d640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa141601c0 0x7faa140b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 -- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 msgr2=0x7faa140b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 0x7faa140b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 -- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa141601c0 msgr2=0x7faa140b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa141601c0 0x7faa140b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 -- 172.21.15.81:0/3732142063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa140ca3b0 con 0x7faa140b20d0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa12d9d640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa141601c0 0x7faa140b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa1259c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa140b20d0 0x7faa1414d050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faa04009b30 tx=0x7faa04033c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa02ffd640 1 -- 172.21.15.81:0/3732142063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0403f020 con 0x7faa140b20d0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa140ca690 con 0x7faa140b20d0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa02ffd640 1 -- 172.21.15.81:0/3732142063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa040330d0 con 0x7faa140b20d0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa02ffd640 1 -- 172.21.15.81:0/3732142063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04036040 con 0x7faa140b20d0 2024-09-21T06:45:58.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.801+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa140b64b0 con 0x7faa140b20d0 2024-09-21T06:45:58.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.802+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa140b6710 con 0x7faa140b20d0 2024-09-21T06:45:58.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.803+0000 7faa02ffd640 1 -- 172.21.15.81:0/3732142063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa04042020 con 0x7faa140b20d0 2024-09-21T06:45:58.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.803+0000 7faa02ffd640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa9f4078b90 0x7fa9f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:58.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.804+0000 7faa02ffd640 1 -- 172.21.15.81:0/3732142063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7faa040bb340 con 0x7faa140b20d0 2024-09-21T06:45:58.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.804+0000 7faa11d9b640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa9f4078b90 0x7fa9f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:58.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.804+0000 7faa11d9b640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa9f4078b90 0x7fa9f407b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa140c91f0 tx=0x7faa08005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:58.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:58.808+0000 7faa02ffd640 1 -- 172.21.15.81:0/3732142063 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faa04049030 con 0x7faa140b20d0 2024-09-21T06:45:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.054+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7faa140735a0 con 0x7faa140b20d0 2024-09-21T06:45:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.056+0000 7faa02ffd640 1 -- 172.21.15.81:0/3732142063 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v27) ==== 90+0+0 (secure 0 0 0) 0x7faa04083950 con 0x7faa140b20d0 2024-09-21T06:45:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa9f4078b90 msgr2=0x7fa9f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa9f4078b90 0x7fa9f407b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa140c91f0 tx=0x7faa08005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa140b20d0 msgr2=0x7faa1414d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa140b20d0 0x7faa1414d050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faa04009b30 tx=0x7faa04033c70 comp rx=0 tx=0).stop 2024-09-21T06:45:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 shutdown_connections 2024-09-21T06:45:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa9f4078b90 0x7fa9f407b0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faa140d19a0 0x7faa140b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faa141601c0 0x7faa140b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 --2- 172.21.15.81:0/3732142063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa140b20d0 0x7faa1414d050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 >> 172.21.15.81:0/3732142063 conn(0x7faa140d25e0 msgr2=0x7faa1415dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 shutdown_connections 2024-09-21T06:45:59.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.059+0000 7faa18e5c640 1 -- 172.21.15.81:0/3732142063 wait complete. 2024-09-21T06:45:59.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T06:45:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 -- 172.21.15.81:0/3780597008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415eda0 msgr2=0x7fce140b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 --2- 172.21.15.81:0/3780597008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415eda0 0x7fce140b96c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fce08005fd0 tx=0x7fce0802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 -- 172.21.15.81:0/3780597008 shutdown_connections 2024-09-21T06:45:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 --2- 172.21.15.81:0/3780597008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415eda0 0x7fce140b96c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 --2- 172.21.15.81:0/3780597008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1415c450 0x7fce140d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 -- 172.21.15.81:0/3780597008 >> 172.21.15.81:0/3780597008 conn(0x7fce140b7330 msgr2=0x7fce140b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 -- 172.21.15.81:0/3780597008 shutdown_connections 2024-09-21T06:45:59.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.185+0000 7fce1a58a640 1 -- 172.21.15.81:0/3780597008 wait complete. 2024-09-21T06:45:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.187+0000 7fce1a58a640 1 Processor -- start 2024-09-21T06:45:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.187+0000 7fce1a58a640 1 -- start start 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce1a58a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce140b9c00 0x7fce141f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce1a58a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415c450 0x7fce141f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce1a58a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1415eda0 0x7fce141f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce1a58a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce140b35c0 con 0x7fce1415c450 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce1a58a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fce140b3440 con 0x7fce140b9c00 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce1a58a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fce140b3740 con 0x7fce1415eda0 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415c450 0x7fce141f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415c450 0x7fce141f93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39574/0 (socket says 172.21.15.81:39574) 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 -- 172.21.15.81:0/2164148266 learned_addr learned my addr 172.21.15.81:0/2164148266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce13fff640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce140b9c00 0x7fce141f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce18b27640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1415eda0 0x7fce141f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 -- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1415eda0 msgr2=0x7fce141f98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1415eda0 0x7fce141f98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 -- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce140b9c00 msgr2=0x7fce141f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce140b9c00 0x7fce141f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.188+0000 7fce137fe640 1 -- 172.21.15.81:0/2164148266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce140ca4e0 con 0x7fce1415c450 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.189+0000 7fce137fe640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415c450 0x7fce141f93b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce08034040 tx=0x7fce080035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.189+0000 7fce10ff9640 1 -- 172.21.15.81:0/2164148266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0803e030 con 0x7fce1415c450 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.189+0000 7fce10ff9640 1 -- 172.21.15.81:0/2164148266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce08003ae0 con 0x7fce1415c450 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.189+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce140ca7c0 con 0x7fce1415c450 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.189+0000 7fce10ff9640 1 -- 172.21.15.81:0/2164148266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08035040 con 0x7fce1415c450 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.189+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce140cad80 con 0x7fce1415c450 2024-09-21T06:45:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.190+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce140c8440 con 0x7fce1415c450 2024-09-21T06:45:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.190+0000 7fce10ff9640 1 -- 172.21.15.81:0/2164148266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce08041030 con 0x7fce1415c450 2024-09-21T06:45:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.191+0000 7fce10ff9640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fce00078b90 0x7fce0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.191+0000 7fce10ff9640 1 -- 172.21.15.81:0/2164148266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fce080bb310 con 0x7fce1415c450 2024-09-21T06:45:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.191+0000 7fce13fff640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fce00078b90 0x7fce0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.192+0000 7fce13fff640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fce00078b90 0x7fce0007b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce1408c9c0 tx=0x7fce04005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:59.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.195+0000 7fce10ff9640 1 -- 172.21.15.81:0/2164148266 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fce08083350 con 0x7fce1415c450 2024-09-21T06:45:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.447+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fce140d5160 con 0x7fce1415c450 2024-09-21T06:45:59.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.451+0000 7fce10ff9640 1 -- 172.21.15.81:0/2164148266 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v28) ==== 90+0+0 (secure 0 0 0) 0x7fce140d5160 con 0x7fce1415c450 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fce00078b90 msgr2=0x7fce0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fce00078b90 0x7fce0007b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce1408c9c0 tx=0x7fce04005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415c450 msgr2=0x7fce141f93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415c450 0x7fce141f93b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fce08034040 tx=0x7fce080035f0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 shutdown_connections 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fce00078b90 0x7fce0007b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce1415eda0 0x7fce141f98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1415c450 0x7fce141f93b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 --2- 172.21.15.81:0/2164148266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce140b9c00 0x7fce141f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 >> 172.21.15.81:0/2164148266 conn(0x7fce140b7330 msgr2=0x7fce14160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 shutdown_connections 2024-09-21T06:45:59.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.453+0000 7fce1a58a640 1 -- 172.21.15.81:0/2164148266 wait complete. 2024-09-21T06:45:59.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 -- 172.21.15.81:0/1718427667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 msgr2=0x7fbb3415bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 --2- 172.21.15.81:0/1718427667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb3415bdb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb24005fd0 tx=0x7fbb2402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 -- 172.21.15.81:0/1718427667 shutdown_connections 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 --2- 172.21.15.81:0/1718427667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb341633c0 0x7fbb341657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 --2- 172.21.15.81:0/1718427667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb3415bdb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 -- 172.21.15.81:0/1718427667 >> 172.21.15.81:0/1718427667 conn(0x7fbb340740a0 msgr2=0x7fbb340b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 -- 172.21.15.81:0/1718427667 shutdown_connections 2024-09-21T06:45:59.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.578+0000 7fbb3b507640 1 -- 172.21.15.81:0/1718427667 wait complete. 2024-09-21T06:45:59.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.580+0000 7fbb3b507640 1 Processor -- start 2024-09-21T06:45:59.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.580+0000 7fbb3b507640 1 -- start start 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.581+0000 7fbb3b507640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb34158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.581+0000 7fbb3b507640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb3415c2f0 0x7fbb3414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.581+0000 7fbb3b507640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb341633c0 0x7fbb34159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.581+0000 7fbb3b507640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3415d0f0 con 0x7fbb3406f510 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.581+0000 7fbb3b507640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3415cf70 con 0x7fbb341633c0 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.581+0000 7fbb3b507640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fbb34165d20 con 0x7fbb3415c2f0 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.581+0000 7fbb392a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb34158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb34158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39592/0 (socket says 172.21.15.81:39592) 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 -- 172.21.15.81:0/3132668262 learned_addr learned my addr 172.21.15.81:0/3132668262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb38aa2640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb3415c2f0 0x7fbb3414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb39aa4640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb341633c0 0x7fbb34159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 -- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb3415c2f0 msgr2=0x7fbb3414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb3415c2f0 0x7fbb3414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 -- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb341633c0 msgr2=0x7fbb34159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb341633c0 0x7fbb34159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 -- 172.21.15.81:0/3132668262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb341f6f90 con 0x7fbb3406f510 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb392a3640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb34158fc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb2402aea0 tx=0x7fbb24003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb31ffb640 1 -- 172.21.15.81:0/3132668262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24031b90 con 0x7fbb3406f510 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb31ffb640 1 -- 172.21.15.81:0/3132668262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb24031e20 con 0x7fbb3406f510 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb341f7270 con 0x7fbb3406f510 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.582+0000 7fbb31ffb640 1 -- 172.21.15.81:0/3132668262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24033330 con 0x7fbb3406f510 2024-09-21T06:45:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.583+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb340b3700 con 0x7fbb3406f510 2024-09-21T06:45:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.584+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb340b39c0 con 0x7fbb3406f510 2024-09-21T06:45:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.584+0000 7fbb31ffb640 1 -- 172.21.15.81:0/3132668262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb240334d0 con 0x7fbb3406f510 2024-09-21T06:45:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.585+0000 7fbb31ffb640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbb20078b90 0x7fbb2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.585+0000 7fbb31ffb640 1 -- 172.21.15.81:0/3132668262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fbb240bbee0 con 0x7fbb3406f510 2024-09-21T06:45:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.585+0000 7fbb38aa2640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbb20078b90 0x7fbb2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.586+0000 7fbb38aa2640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbb20078b90 0x7fbb2007b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb341503e0 tx=0x7fbb28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.589+0000 7fbb31ffb640 1 -- 172.21.15.81:0/3132668262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbb340b39c0 con 0x7fbb3406f510 2024-09-21T06:45:59.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.834+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fbb3415bdb0 con 0x7fbb3406f510 2024-09-21T06:45:59.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.838+0000 7fbb31ffb640 1 -- 172.21.15.81:0/3132668262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v29) ==== 90+0+0 (secure 0 0 0) 0x7fbb2403f030 con 0x7fbb3406f510 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbb20078b90 msgr2=0x7fbb2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbb20078b90 0x7fbb2007b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbb341503e0 tx=0x7fbb28009040 comp rx=0 tx=0).stop 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 msgr2=0x7fbb34158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb34158fc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb2402aea0 tx=0x7fbb24003970 comp rx=0 tx=0).stop 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 shutdown_connections 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbb20078b90 0x7fbb2007b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbb3415c2f0 0x7fbb3414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbb341633c0 0x7fbb34159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 --2- 172.21.15.81:0/3132668262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb3406f510 0x7fbb34158fc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 >> 172.21.15.81:0/3132668262 conn(0x7fbb340740a0 msgr2=0x7fbb3415c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:59.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 shutdown_connections 2024-09-21T06:45:59.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.840+0000 7fbb3b507640 1 -- 172.21.15.81:0/3132668262 wait complete. 2024-09-21T06:45:59.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 -- 172.21.15.81:0/2197164321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 msgr2=0x7ff0840af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/2197164321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 0x7ff0840af1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff07c005fd0 tx=0x7ff07c02aa10 comp rx=0 tx=0).stop 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 -- 172.21.15.81:0/2197164321 shutdown_connections 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/2197164321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 0x7ff0840af1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/2197164321 >> v2:172.21.15.89:3300/0 conn(0x7ff08406e6a0 0x7ff08406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 -- 172.21.15.81:0/2197164321 >> 172.21.15.81:0/2197164321 conn(0x7ff0840740a0 msgr2=0x7ff0840b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 -- 172.21.15.81:0/2197164321 shutdown_connections 2024-09-21T06:45:59.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.965+0000 7ff08b0d3640 1 -- 172.21.15.81:0/2197164321 wait complete. 2024-09-21T06:45:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.967+0000 7ff08b0d3640 1 Processor -- start 2024-09-21T06:45:59.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.967+0000 7ff08b0d3640 1 -- start start 2024-09-21T06:45:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff08b0d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406e6a0 0x7ff0841e6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff08b0d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff08406eff0 0x7ff08415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff08b0d3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 0x7ff0841f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff08b0d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0840af700 con 0x7ff08406eff0 2024-09-21T06:45:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff08b0d3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff08409ac40 con 0x7ff08406e6a0 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff08b0d3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff0840af880 con 0x7ff08406f400 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff08406eff0 0x7ff08415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff08406eff0 0x7ff08415eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39596/0 (socket says 172.21.15.81:39596) 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 -- 172.21.15.81:0/897262575 learned_addr learned my addr 172.21.15.81:0/897262575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff088e6f640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406e6a0 0x7ff0841e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff089670640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 0x7ff0841f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 -- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 msgr2=0x7ff0841f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 0x7ff0841f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 -- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406e6a0 msgr2=0x7ff0841e6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406e6a0 0x7ff0841e6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 -- 172.21.15.81:0/897262575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0841e6350 con 0x7ff08406eff0 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff083fff640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff08406eff0 0x7ff08415eb50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff07800c400 tx=0x7ff07800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.969+0000 7ff0817fa640 1 -- 172.21.15.81:0/897262575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078017070 con 0x7ff08406eff0 2024-09-21T06:45:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.970+0000 7ff0817fa640 1 -- 172.21.15.81:0/897262575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0780053c0 con 0x7ff08406eff0 2024-09-21T06:45:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.970+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0841e8540 con 0x7ff08406eff0 2024-09-21T06:45:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.970+0000 7ff0817fa640 1 -- 172.21.15.81:0/897262575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078003850 con 0x7ff08406eff0 2024-09-21T06:45:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.970+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0841e8b00 con 0x7ff08406eff0 2024-09-21T06:45:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.970+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0841f3520 con 0x7ff08406eff0 2024-09-21T06:45:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.971+0000 7ff0817fa640 1 -- 172.21.15.81:0/897262575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff07801a070 con 0x7ff08406eff0 2024-09-21T06:45:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.972+0000 7ff0817fa640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff070078bc0 0x7ff07007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.972+0000 7ff0817fa640 1 -- 172.21.15.81:0/897262575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7ff078099ed0 con 0x7ff08406eff0 2024-09-21T06:45:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.972+0000 7ff088e6f640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff070078bc0 0x7ff07007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.972+0000 7ff088e6f640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff070078bc0 0x7ff07007b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff074009b30 tx=0x7ff074005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:59.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:45:59.976+0000 7ff0817fa640 1 -- 172.21.15.81:0/897262575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff078061e80 con 0x7ff08406eff0 2024-09-21T06:46:00.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.221+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff0841f7940 con 0x7ff08406eff0 2024-09-21T06:46:00.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.224+0000 7ff0817fa640 1 -- 172.21.15.81:0/897262575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v30) ==== 90+0+0 (secure 0 0 0) 0x7ff0780668b0 con 0x7ff08406eff0 2024-09-21T06:46:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff070078bc0 msgr2=0x7ff07007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff070078bc0 0x7ff07007b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff074009b30 tx=0x7ff074005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff08406eff0 msgr2=0x7ff08415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff08406eff0 0x7ff08415eb50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff07800c400 tx=0x7ff07800c8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 shutdown_connections 2024-09-21T06:46:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff070078bc0 0x7ff07007b0d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff08406f400 0x7ff0841f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff08406eff0 0x7ff08415eb50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 --2- 172.21.15.81:0/897262575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff08406e6a0 0x7ff0841e6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 >> 172.21.15.81:0/897262575 conn(0x7ff0840740a0 msgr2=0x7ff0840b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 shutdown_connections 2024-09-21T06:46:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.227+0000 7ff08b0d3640 1 -- 172.21.15.81:0/897262575 wait complete. 2024-09-21T06:46:00.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T06:46:00.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 -- 172.21.15.81:0/2850843700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c0cfe20 msgr2=0x7fc37c15d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 --2- 172.21.15.81:0/2850843700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c0cfe20 0x7fc37c15d590 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009830 tx=0x7fc36c02a510 comp rx=0 tx=0).stop 2024-09-21T06:46:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 -- 172.21.15.81:0/2850843700 shutdown_connections 2024-09-21T06:46:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 --2- 172.21.15.81:0/2850843700 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc37c15dd10 0x7fc37c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 --2- 172.21.15.81:0/2850843700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c0cfe20 0x7fc37c15d590 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 -- 172.21.15.81:0/2850843700 >> 172.21.15.81:0/2850843700 conn(0x7fc37c0d2250 msgr2=0x7fc37c0d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 -- 172.21.15.81:0/2850843700 shutdown_connections 2024-09-21T06:46:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.352+0000 7fc38108b640 1 -- 172.21.15.81:0/2850843700 wait complete. 2024-09-21T06:46:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.354+0000 7fc38108b640 1 Processor -- start 2024-09-21T06:46:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.354+0000 7fc38108b640 1 -- start start 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.355+0000 7fc38108b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc37c0cd1d0 0x7fc37c1485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.355+0000 7fc38108b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc37c0cfe20 0x7fc37c1f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc38108b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c15dd10 0x7fc37c155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc38108b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c0d1eb0 con 0x7fc37c15dd10 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc38108b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c0d1d30 con 0x7fc37c0cd1d0 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc38108b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fc37c1607c0 con 0x7fc37c0cfe20 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c15dd10 0x7fc37c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c15dd10 0x7fc37c155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39606/0 (socket says 172.21.15.81:39606) 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 -- 172.21.15.81:0/283684348 learned_addr learned my addr 172.21.15.81:0/283684348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37a59c640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc37c0cfe20 0x7fc37c1f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37ad9d640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc37c0cd1d0 0x7fc37c1485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 -- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc37c0cfe20 msgr2=0x7fc37c1f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc37c0cfe20 0x7fc37c1f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 -- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc37c0cd1d0 msgr2=0x7fc37c1485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc37c0cd1d0 0x7fc37c1485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 -- 172.21.15.81:0/283684348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c1f42e0 con 0x7fc37c15dd10 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc37b59e640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c15dd10 0x7fc37c155920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c730 tx=0x7fc37400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc3637fe640 1 -- 172.21.15.81:0/283684348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374003b70 con 0x7fc37c15dd10 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc3637fe640 1 -- 172.21.15.81:0/283684348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc374003d30 con 0x7fc37c15dd10 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c1f45c0 con 0x7fc37c15dd10 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc3637fe640 1 -- 172.21.15.81:0/283684348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3740052d0 con 0x7fc37c15dd10 2024-09-21T06:46:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.356+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c148b00 con 0x7fc37c15dd10 2024-09-21T06:46:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.358+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c0ccc90 con 0x7fc37c15dd10 2024-09-21T06:46:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.358+0000 7fc3637fe640 1 -- 172.21.15.81:0/283684348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc374005470 con 0x7fc37c15dd10 2024-09-21T06:46:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.359+0000 7fc3637fe640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc368078b90 0x7fc36807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.359+0000 7fc3637fe640 1 -- 172.21.15.81:0/283684348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fc37409a720 con 0x7fc37c15dd10 2024-09-21T06:46:00.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.359+0000 7fc37ad9d640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc368078b90 0x7fc36807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.359+0000 7fc37ad9d640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc368078b90 0x7fc36807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc36c034000 tx=0x7fc36c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:00.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.363+0000 7fc3637fe640 1 -- 172.21.15.81:0/283684348 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc3740627f0 con 0x7fc37c15dd10 2024-09-21T06:46:00.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.612+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fc37c1f4070 con 0x7fc37c15dd10 2024-09-21T06:46:00.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.615+0000 7fc3637fe640 1 -- 172.21.15.81:0/283684348 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v31) ==== 97+0+0 (secure 0 0 0) 0x7fc374067220 con 0x7fc37c15dd10 2024-09-21T06:46:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc368078b90 msgr2=0x7fc36807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc368078b90 0x7fc36807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc36c034000 tx=0x7fc36c004730 comp rx=0 tx=0).stop 2024-09-21T06:46:00.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c15dd10 msgr2=0x7fc37c155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c15dd10 0x7fc37c155920 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c730 tx=0x7fc37400cbf0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 shutdown_connections 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc368078b90 0x7fc36807b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc37c0cfe20 0x7fc37c1f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37c15dd10 0x7fc37c155920 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 --2- 172.21.15.81:0/283684348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc37c0cd1d0 0x7fc37c1485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 >> 172.21.15.81:0/283684348 conn(0x7fc37c0d2250 msgr2=0x7fc37c15fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 shutdown_connections 2024-09-21T06:46:00.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.618+0000 7fc38108b640 1 -- 172.21.15.81:0/283684348 wait complete. 2024-09-21T06:46:00.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T06:46:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.742+0000 7f5bb7332640 1 -- 172.21.15.81:0/1494207454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 msgr2=0x7f5bb015ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.742+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1494207454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb015ea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009830 tx=0x7f5bac02a510 comp rx=0 tx=0).stop 2024-09-21T06:46:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.742+0000 7f5bb7332640 1 -- 172.21.15.81:0/1494207454 shutdown_connections 2024-09-21T06:46:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.742+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1494207454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb015ea50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.742+0000 7f5bb7332640 1 -- 172.21.15.81:0/1494207454 >> 172.21.15.81:0/1494207454 conn(0x7f5bb00b4210 msgr2=0x7f5bb00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.743+0000 7f5bb7332640 1 -- 172.21.15.81:0/1494207454 shutdown_connections 2024-09-21T06:46:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.743+0000 7f5bb7332640 1 -- 172.21.15.81:0/1494207454 wait complete. 2024-09-21T06:46:00.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.744+0000 7f5bb7332640 1 Processor -- start 2024-09-21T06:46:00.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.744+0000 7f5bb7332640 1 -- start start 2024-09-21T06:46:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.745+0000 7f5bb7332640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb006dea0 0x7f5bb01f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.745+0000 7f5bb7332640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.745+0000 7f5bb7332640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb00cf1b0 0x7f5bb01f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb7332640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb00cd7e0 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb7332640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb00cd660 con 0x7f5bb006dea0 2024-09-21T06:46:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb7332640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb00cd960 con 0x7f5bb00cf1b0 2024-09-21T06:46:00.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb00caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39624/0 (socket says 172.21.15.81:39624) 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 -- 172.21.15.81:0/1996106667 learned_addr learned my addr 172.21.15.81:0/1996106667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb50ce640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb006dea0 0x7f5bb01f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb58cf640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb00cf1b0 0x7f5bb01f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 -- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb00cf1b0 msgr2=0x7f5bb01f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb00cf1b0 0x7f5bb01f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 -- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb006dea0 msgr2=0x7f5bb01f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb006dea0 0x7f5bb01f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 -- 172.21.15.81:0/1996106667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb01f5b10 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb50ce640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb006dea0 0x7f5bb01f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb58cf640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb00cf1b0 0x7f5bb01f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:00.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb48cd640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb00caf40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000b3f0 tx=0x7f5ba000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5ba5ffb640 1 -- 172.21.15.81:0/1996106667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0015020 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5ba5ffb640 1 -- 172.21.15.81:0/1996106667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ba0011920 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5ba5ffb640 1 -- 172.21.15.81:0/1996106667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0011d70 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.746+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb01f9820 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.747+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb01f5d80 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.747+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb00ce3d0 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.748+0000 7f5ba5ffb640 1 -- 172.21.15.81:0/1996106667 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ba0018020 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.748+0000 7f5ba5ffb640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b94078bc0 0x7f5b9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.749+0000 7f5ba5ffb640 1 -- 172.21.15.81:0/1996106667 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f5ba009a830 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.749+0000 7f5bb50ce640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b94078bc0 0x7f5b9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:00.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.749+0000 7f5bb50ce640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b94078bc0 0x7f5b9407b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bac034000 tx=0x7f5bac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:00.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.753+0000 7f5ba5ffb640 1 -- 172.21.15.81:0/1996106667 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5bb00ce3d0 con 0x7f5bb00ce5b0 2024-09-21T06:46:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.995+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f5bb01f95b0 con 0x7f5bb00ce5b0 2024-09-21T06:46:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:00.999+0000 7f5ba5ffb640 1 -- 172.21.15.81:0/1996106667 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v32) ==== 90+0+0 (secure 0 0 0) 0x7f5ba001f030 con 0x7f5bb00ce5b0 2024-09-21T06:46:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b94078bc0 msgr2=0x7f5b9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b94078bc0 0x7f5b9407b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5bac034000 tx=0x7f5bac004730 comp rx=0 tx=0).stop 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 msgr2=0x7f5bb00caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb00caf40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000b3f0 tx=0x7f5ba000b8b0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 shutdown_connections 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b94078bc0 0x7f5b9407b0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5bb00cf1b0 0x7f5bb01f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb00ce5b0 0x7f5bb00caf40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 --2- 172.21.15.81:0/1996106667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bb006dea0 0x7f5bb01f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 >> 172.21.15.81:0/1996106667 conn(0x7f5bb00b4210 msgr2=0x7f5bb006f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 shutdown_connections 2024-09-21T06:46:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.001+0000 7f5bb7332640 1 -- 172.21.15.81:0/1996106667 wait complete. 2024-09-21T06:46:01.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:46:01.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 -- 172.21.15.81:0/4115017849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40015c2f0 msgr2=0x7fe40015c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 --2- 172.21.15.81:0/4115017849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40015c2f0 0x7fe40015c700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe400074c70 tx=0x7fe3f402a560 comp rx=0 tx=0).stop 2024-09-21T06:46:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 -- 172.21.15.81:0/4115017849 shutdown_connections 2024-09-21T06:46:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 --2- 172.21.15.81:0/4115017849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40015c2f0 0x7fe40015c700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 --2- 172.21.15.81:0/4115017849 >> v2:172.21.15.89:3300/0 conn(0x7fe40006f510 0x7fe40015bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 -- 172.21.15.81:0/4115017849 >> 172.21.15.81:0/4115017849 conn(0x7fe4000740a0 msgr2=0x7fe4000b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 -- 172.21.15.81:0/4115017849 shutdown_connections 2024-09-21T06:46:01.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.129+0000 7fe407f01640 1 -- 172.21.15.81:0/4115017849 wait complete. 2024-09-21T06:46:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.131+0000 7fe407f01640 1 Processor -- start 2024-09-21T06:46:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.131+0000 7fe407f01640 1 -- start start 2024-09-21T06:46:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe407f01640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40006e2f0 0x7fe40014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe407f01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40006f510 0x7fe400154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe407f01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40015c2f0 0x7fe4000d1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe407f01640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe40009ad70 con 0x7fe40006f510 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe407f01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe40009abf0 con 0x7fe40015c2f0 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe407f01640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fe40015cf70 con 0x7fe40006e2f0 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe40549c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40006f510 0x7fe400154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe40549c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40006f510 0x7fe400154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39634/0 (socket says 172.21.15.81:39634) 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe40549c640 1 -- 172.21.15.81:0/3312004841 learned_addr learned my addr 172.21.15.81:0/3312004841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.132+0000 7fe405c9d640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40006e2f0 0x7fe40014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe40649e640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40015c2f0 0x7fe4000d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe40549c640 1 -- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40006e2f0 msgr2=0x7fe40014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe40549c640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40006e2f0 0x7fe40014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe40549c640 1 -- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40015c2f0 msgr2=0x7fe4000d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe40549c640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40015c2f0 0x7fe4000d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe40549c640 1 -- 172.21.15.81:0/3312004841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4001552a0 con 0x7fe40006f510 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe40549c640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40006f510 0x7fe400154840 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4034040 tx=0x7fe3f4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe3f27fc640 1 -- 172.21.15.81:0/3312004841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f403e030 con 0x7fe40006f510 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe3f27fc640 1 -- 172.21.15.81:0/3312004841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3f4003e00 con 0x7fe40006f510 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4001f3350 con 0x7fe40006f510 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe3f27fc640 1 -- 172.21.15.81:0/3312004841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4035040 con 0x7fe40006f510 2024-09-21T06:46:01.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.133+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4000b1500 con 0x7fe40006f510 2024-09-21T06:46:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.134+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40006f020 con 0x7fe40006f510 2024-09-21T06:46:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.135+0000 7fe3f27fc640 1 -- 172.21.15.81:0/3312004841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3f4041030 con 0x7fe40006f510 2024-09-21T06:46:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.135+0000 7fe3f27fc640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe3e4078b90 0x7fe3e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.136+0000 7fe3f27fc640 1 -- 172.21.15.81:0/3312004841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fe3f40bb700 con 0x7fe40006f510 2024-09-21T06:46:01.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.136+0000 7fe405c9d640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe3e4078b90 0x7fe3e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.136+0000 7fe405c9d640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe3e4078b90 0x7fe3e407b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe400069f70 tx=0x7fe3fc00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.139+0000 7fe3f27fc640 1 -- 172.21.15.81:0/3312004841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe3f4083790 con 0x7fe40006f510 2024-09-21T06:46:01.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.323+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe4001f3100 con 0x7fe40006f510 2024-09-21T06:46:01.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.323+0000 7fe3f27fc640 1 -- 172.21.15.81:0/3312004841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7fe3f40881c0 con 0x7fe40006f510 2024-09-21T06:46:01.325 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:01.325 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-21T06:46:01.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:01.325 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-21T06:46:01.326 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-21T06:46:01.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:01.326 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-21T06:46:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe3e4078b90 msgr2=0x7fe3e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe3e4078b90 0x7fe3e407b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe400069f70 tx=0x7fe3fc00b2e0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40006f510 msgr2=0x7fe400154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40006f510 0x7fe400154840 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4034040 tx=0x7fe3f4003910 comp rx=0 tx=0).stop 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 shutdown_connections 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe3e4078b90 0x7fe3e407b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe40015c2f0 0x7fe4000d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe40006f510 0x7fe400154840 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 --2- 172.21.15.81:0/3312004841 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe40006e2f0 0x7fe40014db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 >> 172.21.15.81:0/3312004841 conn(0x7fe4000740a0 msgr2=0x7fe40014fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 shutdown_connections 2024-09-21T06:46:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.325+0000 7fe407f01640 1 -- 172.21.15.81:0/3312004841 wait complete. 2024-09-21T06:46:01.339 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:46:01.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:46:01.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 -- 172.21.15.81:0/2240297988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c15e800 msgr2=0x7f162c0b99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 --2- 172.21.15.81:0/2240297988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c15e800 0x7f162c0b99a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f161c009830 tx=0x7f161c02a510 comp rx=0 tx=0).stop 2024-09-21T06:46:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 -- 172.21.15.81:0/2240297988 shutdown_connections 2024-09-21T06:46:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 --2- 172.21.15.81:0/2240297988 >> v2:172.21.15.89:3300/0 conn(0x7f162c0cf130 0x7f162c0cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 --2- 172.21.15.81:0/2240297988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c15e800 0x7f162c0b99a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 -- 172.21.15.81:0/2240297988 >> 172.21.15.81:0/2240297988 conn(0x7f162c0b7330 msgr2=0x7f162c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 -- 172.21.15.81:0/2240297988 shutdown_connections 2024-09-21T06:46:01.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.462+0000 7f16322b6640 1 -- 172.21.15.81:0/2240297988 wait complete. 2024-09-21T06:46:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.464+0000 7f16322b6640 1 Processor -- start 2024-09-21T06:46:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.464+0000 7f16322b6640 1 -- start start 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.465+0000 7f16322b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162c0cf130 0x7f162c14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f16322b6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c0d4370 0x7f162c06cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f16322b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f162c15e800 0x7f162c14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f16322b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f162c0cfe10 con 0x7f162c0cf130 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f16322b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f162c0cfc90 con 0x7f162c15e800 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f16322b6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f162c0cff90 con 0x7f162c0d4370 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162c0cf130 0x7f162c14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162c0cf130 0x7f162c14d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39646/0 (socket says 172.21.15.81:39646) 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 -- 172.21.15.81:0/1554705449 learned_addr learned my addr 172.21.15.81:0/1554705449 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f1630853640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f162c15e800 0x7f162c14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162b7fe640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c0d4370 0x7f162c06cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 -- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c0d4370 msgr2=0x7f162c06cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c0d4370 0x7f162c06cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 -- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f162c15e800 msgr2=0x7f162c14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f162c15e800 0x7f162c14b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 -- 172.21.15.81:0/1554705449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162c14ba80 con 0x7f162c0cf130 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.466+0000 7f162bfff640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162c0cf130 0x7f162c14d9e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f161c009950 tx=0x7f161c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.467+0000 7f1628ff9640 1 -- 172.21.15.81:0/1554705449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c005220 con 0x7f162c0cf130 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.467+0000 7f1628ff9640 1 -- 172.21.15.81:0/1554705449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f161c0054b0 con 0x7f162c0cf130 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.467+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162c14e330 con 0x7f162c0cf130 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.467+0000 7f1628ff9640 1 -- 172.21.15.81:0/1554705449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f161c004a00 con 0x7f162c0cf130 2024-09-21T06:46:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.467+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f162c06ede0 con 0x7f162c0cf130 2024-09-21T06:46:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.468+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f162c0d04b0 con 0x7f162c0cf130 2024-09-21T06:46:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.469+0000 7f1628ff9640 1 -- 172.21.15.81:0/1554705449 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f161c004ba0 con 0x7f162c0cf130 2024-09-21T06:46:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.470+0000 7f1628ff9640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1618078b90 0x7f161807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.470+0000 7f1628ff9640 1 -- 172.21.15.81:0/1554705449 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f161c0bbef0 con 0x7f162c0cf130 2024-09-21T06:46:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.470+0000 7f162b7fe640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1618078b90 0x7f161807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.470+0000 7f162b7fe640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1618078b90 0x7f161807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b10e0 tx=0x7f1620009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.474+0000 7f1628ff9640 1 -- 172.21.15.81:0/1554705449 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f161c03f030 con 0x7f162c0cf130 2024-09-21T06:46:01.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:46:01.534 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:46:01.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:01.662+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f162c0b16d0 con 0x7f162c0cf130 2024-09-21T06:46:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.620+0000 7f1628ff9640 1 -- 172.21.15.81:0/1554705449 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f161c031770 con 0x7f162c0cf130 2024-09-21T06:46:02.623 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1618078b90 msgr2=0x7f161807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1618078b90 0x7f161807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b10e0 tx=0x7f1620009040 comp rx=0 tx=0).stop 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162c0cf130 msgr2=0x7f162c14d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162c0cf130 0x7f162c14d9e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f161c009950 tx=0x7f161c0040c0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 shutdown_connections 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1618078b90 0x7f161807b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162c0d4370 0x7f162c06cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f162c15e800 0x7f162c14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 --2- 172.21.15.81:0/1554705449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f162c0cf130 0x7f162c14d9e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.623+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 >> 172.21.15.81:0/1554705449 conn(0x7f162c0b7330 msgr2=0x7f162c0c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.624+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 shutdown_connections 2024-09-21T06:46:02.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.624+0000 7f16322b6640 1 -- 172.21.15.81:0/1554705449 wait complete. 2024-09-21T06:46:02.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:46:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.759+0000 7ff315e25640 1 -- 172.21.15.81:0/2296124950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31006f630 msgr2=0x7ff3100b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.759+0000 7ff315e25640 1 --2- 172.21.15.81:0/2296124950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31006f630 0x7ff3100b3600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff308005fd0 tx=0x7ff30802a8b0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.760+0000 7ff315e25640 1 -- 172.21.15.81:0/2296124950 shutdown_connections 2024-09-21T06:46:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.760+0000 7ff315e25640 1 --2- 172.21.15.81:0/2296124950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff31006f630 0x7ff3100b3600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.760+0000 7ff315e25640 1 -- 172.21.15.81:0/2296124950 >> 172.21.15.81:0/2296124950 conn(0x7ff3100b2030 msgr2=0x7ff3100b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:02.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.760+0000 7ff315e25640 1 -- 172.21.15.81:0/2296124950 shutdown_connections 2024-09-21T06:46:02.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.760+0000 7ff315e25640 1 -- 172.21.15.81:0/2296124950 wait complete. 2024-09-21T06:46:02.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.761+0000 7ff315e25640 1 Processor -- start 2024-09-21T06:46:02.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.761+0000 7ff315e25640 1 -- start start 2024-09-21T06:46:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31006f630 0x7ff31014d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100b4c60 0x7ff3101f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3100cf610 0x7ff3101f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff31006d780 con 0x7ff3100b4c60 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff310158cc0 con 0x7ff3100cf610 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff31006d900 con 0x7ff31006f630 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100b4c60 0x7ff3101f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100b4c60 0x7ff3101f8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39652/0 (socket says 172.21.15.81:39652) 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff30ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3100cf610 0x7ff3101f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 -- 172.21.15.81:0/2862909280 learned_addr learned my addr 172.21.15.81:0/2862909280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff30f7fe640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31006f630 0x7ff31014d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 -- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31006f630 msgr2=0x7ff31014d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31006f630 0x7ff31014d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 -- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3100cf610 msgr2=0x7ff3101f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:02.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3100cf610 0x7ff3101f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:02.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 -- 172.21.15.81:0/2862909280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3100cb0a0 con 0x7ff3100b4c60 2024-09-21T06:46:02.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff307fff640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100b4c60 0x7ff3101f8100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c370 tx=0x7ff2f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:02.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff30cff9640 1 -- 172.21.15.81:0/2862909280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8017070 con 0x7ff3100b4c60 2024-09-21T06:46:02.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff30cff9640 1 -- 172.21.15.81:0/2862909280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2f80035f0 con 0x7ff3100b4c60 2024-09-21T06:46:02.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31014d5b0 con 0x7ff3100b4c60 2024-09-21T06:46:02.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff30cff9640 1 -- 172.21.15.81:0/2862909280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8003a40 con 0x7ff3100b4c60 2024-09-21T06:46:02.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.763+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3100cb310 con 0x7ff3100b4c60 2024-09-21T06:46:02.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.764+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3101f8b80 con 0x7ff3100b4c60 2024-09-21T06:46:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.765+0000 7ff30cff9640 1 -- 172.21.15.81:0/2862909280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2f801a070 con 0x7ff3100b4c60 2024-09-21T06:46:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.766+0000 7ff30cff9640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2f0078b90 0x7ff2f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.766+0000 7ff30cff9640 1 -- 172.21.15.81:0/2862909280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7ff2f809a360 con 0x7ff3100b4c60 2024-09-21T06:46:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.766+0000 7ff30f7fe640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2f0078b90 0x7ff2f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.767+0000 7ff30f7fe640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2f0078b90 0x7ff2f007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff300007fd0 tx=0x7ff300001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:02.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.770+0000 7ff30cff9640 1 -- 172.21.15.81:0/2862909280 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff2f8021020 con 0x7ff3100b4c60 2024-09-21T06:46:02.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:02.948+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff3100b3580 con 0x7ff3100b4c60 2024-09-21T06:46:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.627+0000 7ff30cff9640 1 -- 172.21.15.81:0/2862909280 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7ff31014d5b0 con 0x7ff3100b4c60 2024-09-21T06:46:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2f0078b90 msgr2=0x7ff2f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2f0078b90 0x7ff2f007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff300007fd0 tx=0x7ff300001370 comp rx=0 tx=0).stop 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100b4c60 msgr2=0x7ff3101f8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100b4c60 0x7ff3101f8100 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800c370 tx=0x7ff2f800c830 comp rx=0 tx=0).stop 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 shutdown_connections 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff2f0078b90 0x7ff2f007b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3100cf610 0x7ff3101f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3100b4c60 0x7ff3101f8100 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 --2- 172.21.15.81:0/2862909280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff31006f630 0x7ff31014d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.629+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 >> 172.21.15.81:0/2862909280 conn(0x7ff3100b2030 msgr2=0x7ff310068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.630+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 shutdown_connections 2024-09-21T06:46:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.630+0000 7ff315e25640 1 -- 172.21.15.81:0/2862909280 wait complete. 2024-09-21T06:46:03.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 -- 172.21.15.81:0/1106402277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d3220 msgr2=0x7fc0ec0b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/1106402277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d3220 0x7fc0ec0b96c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009830 tx=0x7fc0e002a510 comp rx=0 tx=0).stop 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 -- 172.21.15.81:0/1106402277 shutdown_connections 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/1106402277 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0ec0b9c00 0x7fc0ec0d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/1106402277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d3220 0x7fc0ec0b96c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 -- 172.21.15.81:0/1106402277 >> 172.21.15.81:0/1106402277 conn(0x7fc0ec0b7330 msgr2=0x7fc0ec0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 -- 172.21.15.81:0/1106402277 shutdown_connections 2024-09-21T06:46:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.769+0000 7fc0f0f89640 1 -- 172.21.15.81:0/1106402277 wait complete. 2024-09-21T06:46:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.771+0000 7fc0f0f89640 1 Processor -- start 2024-09-21T06:46:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.771+0000 7fc0f0f89640 1 -- start start 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.772+0000 7fc0f0f89640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0ec0b9c00 0x7fc0ec151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.772+0000 7fc0f0f89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ec0d3220 0x7fc0ec0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0f0f89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec15c450 0x7fc0ec0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0f0f89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec0b3440 con 0x7fc0ec15c450 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0f0f89640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec0d4b40 con 0x7fc0ec0d3220 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0f0f89640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ec0b35c0 con 0x7fc0ec0b9c00 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec15c450 0x7fc0ec0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec15c450 0x7fc0ec0cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39668/0 (socket says 172.21.15.81:39668) 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 -- 172.21.15.81:0/503151298 learned_addr learned my addr 172.21.15.81:0/503151298 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ea59c640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0ec0b9c00 0x7fc0ec151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0e9d9b640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ec0d3220 0x7fc0ec0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 -- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0ec0b9c00 msgr2=0x7fc0ec151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0ec0b9c00 0x7fc0ec151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 -- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ec0d3220 msgr2=0x7fc0ec0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ec0d3220 0x7fc0ec0cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 -- 172.21.15.81:0/503151298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec1522d0 con 0x7fc0ec15c450 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0ead9d640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec15c450 0x7fc0ec0cdc60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400cad0 tx=0x7fc0e400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0daffd640 1 -- 172.21.15.81:0/503151298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e400ae20 con 0x7fc0ec15c450 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0daffd640 1 -- 172.21.15.81:0/503151298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0e400f540 con 0x7fc0ec15c450 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ec0cb670 con 0x7fc0ec15c450 2024-09-21T06:46:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0daffd640 1 -- 172.21.15.81:0/503151298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e400f990 con 0x7fc0ec15c450 2024-09-21T06:46:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.773+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ec0b4980 con 0x7fc0ec15c450 2024-09-21T06:46:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.775+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0ec08d110 con 0x7fc0ec15c450 2024-09-21T06:46:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.775+0000 7fc0daffd640 1 -- 172.21.15.81:0/503151298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0e400fb30 con 0x7fc0ec15c450 2024-09-21T06:46:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.776+0000 7fc0daffd640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc0cc078bc0 0x7fc0cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.776+0000 7fc0daffd640 1 -- 172.21.15.81:0/503151298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7fc0e409b830 con 0x7fc0ec15c450 2024-09-21T06:46:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.776+0000 7fc0ea59c640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc0cc078bc0 0x7fc0cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.776+0000 7fc0ea59c640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc0cc078bc0 0x7fc0cc07b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec08c9c0 tx=0x7fc0dc007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.781+0000 7fc0daffd640 1 -- 172.21.15.81:0/503151298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc0ec08d110 con 0x7fc0ec15c450 2024-09-21T06:46:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:03.996+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc0ec0b3ab0 con 0x7fc0ec15c450 2024-09-21T06:46:04.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.628+0000 7fc0daffd640 1 -- 172.21.15.81:0/503151298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc0e4014030 con 0x7fc0ec15c450 2024-09-21T06:46:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 5 and data pool 6 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc0cc078bc0 msgr2=0x7fc0cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc0cc078bc0 0x7fc0cc07b0d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec08c9c0 tx=0x7fc0dc007e90 comp rx=0 tx=0).stop 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec15c450 msgr2=0x7fc0ec0cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec15c450 0x7fc0ec0cdc60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400cad0 tx=0x7fc0e400cf90 comp rx=0 tx=0).stop 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 shutdown_connections 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc0cc078bc0 0x7fc0cc07b0d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec15c450 0x7fc0ec0cdc60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0ec0d3220 0x7fc0ec0cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 --2- 172.21.15.81:0/503151298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0ec0b9c00 0x7fc0ec151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 >> 172.21.15.81:0/503151298 conn(0x7fc0ec0b7330 msgr2=0x7fc0ec0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:04.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.631+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 shutdown_connections 2024-09-21T06:46:04.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.632+0000 7fc0f0f89640 1 -- 172.21.15.81:0/503151298 wait complete. 2024-09-21T06:46:04.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 -- 172.21.15.81:0/527942562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 msgr2=0x7f907c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 --2- 172.21.15.81:0/527942562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c06dda0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f907c0cdc70 tx=0x7f907002a530 comp rx=0 tx=0).stop 2024-09-21T06:46:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 -- 172.21.15.81:0/527942562 shutdown_connections 2024-09-21T06:46:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 --2- 172.21.15.81:0/527942562 >> v2:172.21.15.89:3300/0 conn(0x7f907c06e2e0 0x7f907c0ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 --2- 172.21.15.81:0/527942562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c06dda0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 -- 172.21.15.81:0/527942562 >> 172.21.15.81:0/527942562 conn(0x7f907c073150 msgr2=0x7f907c073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 -- 172.21.15.81:0/527942562 shutdown_connections 2024-09-21T06:46:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.773+0000 7f9082382640 1 -- 172.21.15.81:0/527942562 wait complete. 2024-09-21T06:46:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.775+0000 7f9082382640 1 Processor -- start 2024-09-21T06:46:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.775+0000 7f9082382640 1 -- start start 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f9082382640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f907c06e2e0 0x7f907c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f9082382640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f907c155c10 0x7f907c143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f9082382640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f9082382640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f907c0cef90 con 0x7f907c15c660 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f9082382640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f907c0cee10 con 0x7f907c155c10 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f9082382640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f907c0cf110 con 0x7f907c06e2e0 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f908091f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f908091f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c143980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39680/0 (socket says 172.21.15.81:39680) 2024-09-21T06:46:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f908091f640 1 -- 172.21.15.81:0/1740109326 learned_addr learned my addr 172.21.15.81:0/1740109326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f907bfff640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f907c06e2e0 0x7f907c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.776+0000 7f907b7fe640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f907c155c10 0x7f907c143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f908091f640 1 -- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f907c06e2e0 msgr2=0x7f907c140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f908091f640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f907c06e2e0 0x7f907c140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f908091f640 1 -- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f907c155c10 msgr2=0x7f907c143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f908091f640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f907c155c10 0x7f907c143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f908091f640 1 -- 172.21.15.81:0/1740109326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c1413a0 con 0x7f907c15c660 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f908091f640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c143980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f907400cce0 tx=0x7f907400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f9078ff9640 1 -- 172.21.15.81:0/1740109326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907400f450 con 0x7f907c15c660 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f9078ff9640 1 -- 172.21.15.81:0/1740109326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f907400f6e0 con 0x7f907c15c660 2024-09-21T06:46:04.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907c141680 con 0x7f907c15c660 2024-09-21T06:46:04.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f9078ff9640 1 -- 172.21.15.81:0/1740109326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907400fb30 con 0x7f907c15c660 2024-09-21T06:46:04.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.777+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907c1e4350 con 0x7f907c15c660 2024-09-21T06:46:04.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.778+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f907c051080 con 0x7f907c15c660 2024-09-21T06:46:04.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.779+0000 7f9078ff9640 1 -- 172.21.15.81:0/1740109326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f907400fcd0 con 0x7f907c15c660 2024-09-21T06:46:04.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.779+0000 7f9078ff9640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9068078bc0 0x7f906807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:04.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.779+0000 7f9078ff9640 1 -- 172.21.15.81:0/1740109326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f907409b780 con 0x7f907c15c660 2024-09-21T06:46:04.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.780+0000 7f907bfff640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9068078bc0 0x7f906807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:04.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.780+0000 7f907bfff640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9068078bc0 0x7f906807b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f906c006fd0 tx=0x7f906c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:04.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.784+0000 7f9078ff9640 1 -- 172.21.15.81:0/1740109326 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f907c051080 con 0x7f907c15c660 2024-09-21T06:46:04.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.960+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f907c143fc0 con 0x7f907c15c660 2024-09-21T06:46:04.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.962+0000 7f9078ff9640 1 -- 172.21.15.81:0/1740109326 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16979 (secure 0 0 0) 0x7f9074014030 con 0x7f907c15c660 2024-09-21T06:46:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:04.964 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:03.998588+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:01.666905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:02.952864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9068078bc0 msgr2=0x7f906807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9068078bc0 0x7f906807b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f906c006fd0 tx=0x7f906c009060 comp rx=0 tx=0).stop 2024-09-21T06:46:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 msgr2=0x7f907c143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:04.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c143980 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f907400cce0 tx=0x7f907400a620 comp rx=0 tx=0).stop 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 shutdown_connections 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9068078bc0 0x7f906807b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f907c15c660 0x7f907c143980 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f907c155c10 0x7f907c143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 --2- 172.21.15.81:0/1740109326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f907c06e2e0 0x7f907c140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 >> 172.21.15.81:0/1740109326 conn(0x7f907c073150 msgr2=0x7f907c06fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 shutdown_connections 2024-09-21T06:46:04.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:04.964+0000 7f9082382640 1 -- 172.21.15.81:0/1740109326 wait complete. 2024-09-21T06:46:04.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 -- 172.21.15.81:0/125533892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 msgr2=0x7f10fc15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 --2- 172.21.15.81:0/125533892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc15a290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005fd0 tx=0x7f10ec02a4f0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 -- 172.21.15.81:0/125533892 shutdown_connections 2024-09-21T06:46:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 --2- 172.21.15.81:0/125533892 >> v2:172.21.15.89:3300/0 conn(0x7f10fc15d2c0 0x7f10fc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 --2- 172.21.15.81:0/125533892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc15a290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 -- 172.21.15.81:0/125533892 >> 172.21.15.81:0/125533892 conn(0x7f10fc0d25e0 msgr2=0x7f10fc0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 -- 172.21.15.81:0/125533892 shutdown_connections 2024-09-21T06:46:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.087+0000 7f1101ada640 1 -- 172.21.15.81:0/125533892 wait complete. 2024-09-21T06:46:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.088+0000 7f1101ada640 1 Processor -- start 2024-09-21T06:46:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.089+0000 7f1101ada640 1 -- start start 2024-09-21T06:46:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f1101ada640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f1101ada640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10fc15d2c0 0x7f10fc0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f1101ada640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10fc1601c0 0x7f10fc0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f1101ada640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc0730d0 con 0x7f10fc0d19a0 2024-09-21T06:46:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f1101ada640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc072f50 con 0x7f10fc1601c0 2024-09-21T06:46:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f1101ada640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f10fc073250 con 0x7f10fc15d2c0 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc1505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39690/0 (socket says 172.21.15.81:39690) 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 -- 172.21.15.81:0/858662451 learned_addr learned my addr 172.21.15.81:0/858662451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10faffd640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10fc15d2c0 0x7f10fc0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fbfff640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10fc1601c0 0x7f10fc0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 -- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10fc15d2c0 msgr2=0x7f10fc0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10fc15d2c0 0x7f10fc0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 -- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10fc1601c0 msgr2=0x7f10fc0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10fc1601c0 0x7f10fc0c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.090+0000 7f10fb7fe640 1 -- 172.21.15.81:0/858662451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc0cc0c0 con 0x7f10fc0d19a0 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.091+0000 7f10fb7fe640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc1505b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10ec034040 tx=0x7f10ec003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.091+0000 7f10e3fff640 1 -- 172.21.15.81:0/858662451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec03e030 con 0x7f10fc0d19a0 2024-09-21T06:46:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.091+0000 7f10e3fff640 1 -- 172.21.15.81:0/858662451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10ec0047a0 con 0x7f10fc0d19a0 2024-09-21T06:46:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.091+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc0c9e00 con 0x7f10fc0d19a0 2024-09-21T06:46:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.091+0000 7f10e3fff640 1 -- 172.21.15.81:0/858662451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec035040 con 0x7f10fc0d19a0 2024-09-21T06:46:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.091+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc150af0 con 0x7f10fc0d19a0 2024-09-21T06:46:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.092+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10fc15a290 con 0x7f10fc0d19a0 2024-09-21T06:46:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.093+0000 7f10e3fff640 1 -- 172.21.15.81:0/858662451 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10ec041030 con 0x7f10fc0d19a0 2024-09-21T06:46:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.093+0000 7f10e3fff640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f10e8078b90 0x7f10e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.093+0000 7f10e3fff640 1 -- 172.21.15.81:0/858662451 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f10ec0bb6f0 con 0x7f10fc0d19a0 2024-09-21T06:46:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.093+0000 7f10faffd640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f10e8078b90 0x7f10e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.094+0000 7f10faffd640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f10e8078b90 0x7f10e807b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0c78f0 tx=0x7f10f00094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.098+0000 7f10e3fff640 1 -- 172.21.15.81:0/858662451 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f10ec083a30 con 0x7f10fc0d19a0 2024-09-21T06:46:05.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.278+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10fc15a990 con 0x7f10fc0d19a0 2024-09-21T06:46:05.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.279+0000 7f10e3fff640 1 -- 172.21.15.81:0/858662451 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16979 (secure 0 0 0) 0x7f10ec083330 con 0x7f10fc0d19a0 2024-09-21T06:46:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:05.281 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:03.998588+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:01.666905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:02.952864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:05.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f10e8078b90 msgr2=0x7f10e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f10e8078b90 0x7f10e807b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0c78f0 tx=0x7f10f00094f0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 msgr2=0x7f10fc1505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc1505b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10ec034040 tx=0x7f10ec003970 comp rx=0 tx=0).stop 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 shutdown_connections 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f10e8078b90 0x7f10e807b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10fc15d2c0 0x7f10fc0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10fc1601c0 0x7f10fc0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 --2- 172.21.15.81:0/858662451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10fc0d19a0 0x7f10fc1505b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 >> 172.21.15.81:0/858662451 conn(0x7f10fc0d25e0 msgr2=0x7f10fc0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 shutdown_connections 2024-09-21T06:46:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.281+0000 7f1101ada640 1 -- 172.21.15.81:0/858662451 wait complete. 2024-09-21T06:46:05.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 -- 172.21.15.81:0/2760966441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 msgr2=0x7f9c2c0d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 --2- 172.21.15.81:0/2760966441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c0d41a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9c24005fd0 tx=0x7f9c2402a8b0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 -- 172.21.15.81:0/2760966441 shutdown_connections 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 --2- 172.21.15.81:0/2760966441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c0d41a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 --2- 172.21.15.81:0/2760966441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c2c0d3220 0x7f9c2c0b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 -- 172.21.15.81:0/2760966441 >> 172.21.15.81:0/2760966441 conn(0x7f9c2c0b7330 msgr2=0x7f9c2c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 -- 172.21.15.81:0/2760966441 shutdown_connections 2024-09-21T06:46:05.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.408+0000 7f9c3424d640 1 -- 172.21.15.81:0/2760966441 wait complete. 2024-09-21T06:46:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.410+0000 7f9c3424d640 1 Processor -- start 2024-09-21T06:46:05.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.410+0000 7f9c3424d640 1 -- start start 2024-09-21T06:46:05.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c3424d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c3424d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2c0d3220 0x7f9c2c0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c3424d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c2c15c450 0x7f9c2c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c3424d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c0b35c0 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c3424d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c0b3440 con 0x7f9c2c0d3220 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c3424d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c0b3740 con 0x7f9c2c15c450 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c31fe9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c31fe9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39700/0 (socket says 172.21.15.81:39700) 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c31fe9640 1 -- 172.21.15.81:0/4149457984 learned_addr learned my addr 172.21.15.81:0/4149457984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c327ea640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c2c15c450 0x7f9c2c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.411+0000 7f9c317e8640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2c0d3220 0x7f9c2c0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c31fe9640 1 -- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c2c15c450 msgr2=0x7f9c2c0c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c31fe9640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c2c15c450 0x7f9c2c0c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c31fe9640 1 -- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2c0d3220 msgr2=0x7f9c2c0c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c31fe9640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2c0d3220 0x7f9c2c0c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c31fe9640 1 -- 172.21.15.81:0/4149457984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c0b5b30 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c317e8640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2c0d3220 0x7f9c2c0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c31fe9640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c1598c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c390 tx=0x7f9c2800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c227fc640 1 -- 172.21.15.81:0/4149457984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28017070 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c227fc640 1 -- 172.21.15.81:0/4149457984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c280035f0 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c0b5e10 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c227fc640 1 -- 172.21.15.81:0/4149457984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28003a60 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.412+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c0b63d0 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.413+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2c08d110 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.414+0000 7f9c227fc640 1 -- 172.21.15.81:0/4149457984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c2801a070 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.414+0000 7f9c227fc640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c10078b90 0x7f9c1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.414+0000 7f9c227fc640 1 -- 172.21.15.81:0/4149457984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f9c2809a0f0 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.414+0000 7f9c317e8640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c10078b90 0x7f9c1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.415+0000 7f9c317e8640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c10078b90 0x7f9c1007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c06fe90 tx=0x7f9c1c005f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.419+0000 7f9c227fc640 1 -- 172.21.15.81:0/4149457984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9c2c08d110 con 0x7f9c2c0b9c00 2024-09-21T06:46:05.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:05.634+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9c2c0d41a0 con 0x7f9c2c0b9c00 2024-09-21T06:46:06.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.051+0000 7f9c227fc640 1 -- 172.21.15.81:0/4149457984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f9c28061d50 con 0x7f9c2c0b9c00 2024-09-21T06:46:06.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c10078b90 msgr2=0x7f9c1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:06.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c10078b90 0x7f9c1007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c06fe90 tx=0x7f9c1c005f10 comp rx=0 tx=0).stop 2024-09-21T06:46:06.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 msgr2=0x7f9c2c1598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:06.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c1598c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800c390 tx=0x7f9c2800c850 comp rx=0 tx=0).stop 2024-09-21T06:46:06.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 shutdown_connections 2024-09-21T06:46:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9c10078b90 0x7f9c1007b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c2c15c450 0x7f9c2c0c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2c0d3220 0x7f9c2c0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 --2- 172.21.15.81:0/4149457984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c2c0b9c00 0x7f9c2c1598c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 >> 172.21.15.81:0/4149457984 conn(0x7f9c2c0b7330 msgr2=0x7f9c2c15d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 shutdown_connections 2024-09-21T06:46:06.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.054+0000 7f9c3424d640 1 -- 172.21.15.81:0/4149457984 wait complete. 2024-09-21T06:46:06.067 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:46:06.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 -- 172.21.15.81:0/1385918465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d3015c450 msgr2=0x7f6d300d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 --2- 172.21.15.81:0/1385918465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d3015c450 0x7f6d300d3220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6d20005fd0 tx=0x7f6d2002aa90 comp rx=0 tx=0).stop 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 -- 172.21.15.81:0/1385918465 shutdown_connections 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 --2- 172.21.15.81:0/1385918465 >> v2:172.21.15.89:3300/0 conn(0x7f6d3015eda0 0x7f6d300b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 --2- 172.21.15.81:0/1385918465 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d3015c450 0x7f6d300d3220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 -- 172.21.15.81:0/1385918465 >> 172.21.15.81:0/1385918465 conn(0x7f6d300b7330 msgr2=0x7f6d300b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 -- 172.21.15.81:0/1385918465 shutdown_connections 2024-09-21T06:46:06.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.181+0000 7f6d35907640 1 -- 172.21.15.81:0/1385918465 wait complete. 2024-09-21T06:46:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.183+0000 7f6d35907640 1 Processor -- start 2024-09-21T06:46:06.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.183+0000 7f6d35907640 1 -- start start 2024-09-21T06:46:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d300b9c00 0x7f6d3006f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3015c450 0x7f6d3014d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d3015eda0 0x7f6d3014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d300b33b0 con 0x7f6d3015c450 2024-09-21T06:46:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6d300b3230 con 0x7f6d3015eda0 2024-09-21T06:46:06.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f6d300b3530 con 0x7f6d300b9c00 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3015c450 0x7f6d3014d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3015c450 0x7f6d3014d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39708/0 (socket says 172.21.15.81:39708) 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 -- 172.21.15.81:0/3707238945 learned_addr learned my addr 172.21.15.81:0/3707238945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2effd640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d300b9c00 0x7f6d3006f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2f7fe640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d3015eda0 0x7f6d3014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 -- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d300b9c00 msgr2=0x7f6d3006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d300b9c00 0x7f6d3006f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 -- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d3015eda0 msgr2=0x7f6d3014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d3015eda0 0x7f6d3014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 -- 172.21.15.81:0/3707238945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d300cd8b0 con 0x7f6d3015c450 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2effd640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d300b9c00 0x7f6d3006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d2e7fc640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3015c450 0x7f6d3014d780 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800ea20 tx=0x7f6d1800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d27fff640 1 -- 172.21.15.81:0/3707238945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800cde0 con 0x7f6d3015c450 2024-09-21T06:46:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d27fff640 1 -- 172.21.15.81:0/3707238945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d18004020 con 0x7f6d3015c450 2024-09-21T06:46:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d27fff640 1 -- 172.21.15.81:0/3707238945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18004470 con 0x7f6d3015c450 2024-09-21T06:46:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d300cdb90 con 0x7f6d3015c450 2024-09-21T06:46:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.185+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d300ce150 con 0x7f6d3015c450 2024-09-21T06:46:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.187+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3008d110 con 0x7f6d3015c450 2024-09-21T06:46:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.187+0000 7f6d27fff640 1 -- 172.21.15.81:0/3707238945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d180035f0 con 0x7f6d3015c450 2024-09-21T06:46:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.187+0000 7f6d27fff640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6d10078b90 0x7f6d1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.188+0000 7f6d27fff640 1 -- 172.21.15.81:0/3707238945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f6d1809b8b0 con 0x7f6d3015c450 2024-09-21T06:46:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.188+0000 7f6d2effd640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6d10078b90 0x7f6d1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.188+0000 7f6d2effd640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6d10078b90 0x7f6d1007b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d20035000 tx=0x7f6d20038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:06.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.192+0000 7f6d27fff640 1 -- 172.21.15.81:0/3707238945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6d3008d110 con 0x7f6d3015c450 2024-09-21T06:46:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:06.407+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6d300b3a50 con 0x7f6d3015c450 2024-09-21T06:46:07.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.054+0000 7f6d27fff640 1 -- 172.21.15.81:0/3707238945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f6d18063c80 con 0x7f6d3015c450 2024-09-21T06:46:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6d10078b90 msgr2=0x7f6d1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6d10078b90 0x7f6d1007b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d20035000 tx=0x7f6d20038040 comp rx=0 tx=0).stop 2024-09-21T06:46:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3015c450 msgr2=0x7f6d3014d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3015c450 0x7f6d3014d780 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800ea20 tx=0x7f6d1800eee0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 shutdown_connections 2024-09-21T06:46:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6d10078b90 0x7f6d1007b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d3015eda0 0x7f6d3014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d3015c450 0x7f6d3014d780 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 --2- 172.21.15.81:0/3707238945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6d300b9c00 0x7f6d3006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 >> 172.21.15.81:0/3707238945 conn(0x7f6d300b7330 msgr2=0x7f6d300d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 shutdown_connections 2024-09-21T06:46:07.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.057+0000 7f6d35907640 1 -- 172.21.15.81:0/3707238945 wait complete. 2024-09-21T06:46:07.071 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:46:07.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.183+0000 7f842f27f640 1 -- 172.21.15.81:0/3158055000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 msgr2=0x7f841400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.183+0000 7f842f27f640 1 --2- 172.21.15.81:0/3158055000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f841400b9c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8420009b20 tx=0x7f8414005830 comp rx=0 tx=0).stop 2024-09-21T06:46:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.183+0000 7f842f27f640 1 -- 172.21.15.81:0/3158055000 shutdown_connections 2024-09-21T06:46:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.183+0000 7f842f27f640 1 --2- 172.21.15.81:0/3158055000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f841400b9c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.183+0000 7f842f27f640 1 -- 172.21.15.81:0/3158055000 >> 172.21.15.81:0/3158055000 conn(0x7f84280b2030 msgr2=0x7f84280b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.183+0000 7f842f27f640 1 -- 172.21.15.81:0/3158055000 shutdown_connections 2024-09-21T06:46:07.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.183+0000 7f842f27f640 1 -- 172.21.15.81:0/3158055000 wait complete. 2024-09-21T06:46:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.185+0000 7f842f27f640 1 Processor -- start 2024-09-21T06:46:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.185+0000 7f842f27f640 1 -- start start 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.186+0000 7f842f27f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f8428146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.186+0000 7f842f27f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280ce460 0x7f8428153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.186+0000 7f842f27f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f842814f1c0 0x7f84281542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.186+0000 7f842f27f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84280ad290 con 0x7f84140051c0 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.186+0000 7f842f27f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8428073c90 con 0x7f842814f1c0 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.186+0000 7f842f27f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f84280ad410 con 0x7f84280ce460 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f8428146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f8428146920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39720/0 (socket says 172.21.15.81:39720) 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 -- 172.21.15.81:0/3736177194 learned_addr learned my addr 172.21.15.81:0/3736177194 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d81c640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f842814f1c0 0x7f84281542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842c81a640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280ce460 0x7f8428153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 -- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280ce460 msgr2=0x7f8428153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280ce460 0x7f8428153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 -- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f842814f1c0 msgr2=0x7f84281542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f842814f1c0 0x7f84281542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 -- 172.21.15.81:0/3736177194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84280cc350 con 0x7f84140051c0 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d81c640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f842814f1c0 0x7f84281542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842d01b640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f8428146920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f84240019c0 tx=0x7f8424001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f841dffb640 1 -- 172.21.15.81:0/3736177194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424015070 con 0x7f84140051c0 2024-09-21T06:46:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f841dffb640 1 -- 172.21.15.81:0/3736177194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f842400eb70 con 0x7f84140051c0 2024-09-21T06:46:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84280cc630 con 0x7f84140051c0 2024-09-21T06:46:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f841dffb640 1 -- 172.21.15.81:0/3736177194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424011460 con 0x7f84140051c0 2024-09-21T06:46:07.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.187+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84280ccbf0 con 0x7f84140051c0 2024-09-21T06:46:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.188+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84280ad970 con 0x7f84140051c0 2024-09-21T06:46:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.189+0000 7f841dffb640 1 -- 172.21.15.81:0/3736177194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8424018070 con 0x7f84140051c0 2024-09-21T06:46:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.189+0000 7f841dffb640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f840c078b90 0x7f840c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.190+0000 7f841dffb640 1 -- 172.21.15.81:0/3736177194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f842409b780 con 0x7f84140051c0 2024-09-21T06:46:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.190+0000 7f842c81a640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f840c078b90 0x7f840c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.190+0000 7f842c81a640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f840c078b90 0x7f840c07b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84180047a0 tx=0x7f8418000ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:07.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.194+0000 7f841dffb640 1 -- 172.21.15.81:0/3736177194 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8424063b50 con 0x7f84140051c0 2024-09-21T06:46:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.409+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84280b3870 con 0x7f84140051c0 2024-09-21T06:46:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.409+0000 7f841dffb640 1 -- 172.21.15.81:0/3736177194 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7f8424063450 con 0x7f84140051c0 2024-09-21T06:46:07.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:07.412 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"btime":"2024-09-21T06:46:07:052774+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:03.998544+0000","modified":"2024-09-21T06:46:06.408923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/3622751302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":3622751302},{"type":"v1","addr":"172.21.15.89:6837","nonce":3622751302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":2}]} 2024-09-21T06:46:07.412 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f840c078b90 msgr2=0x7f840c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f840c078b90 0x7f840c07b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84180047a0 tx=0x7f8418000ef0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 msgr2=0x7f8428146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f8428146920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f84240019c0 tx=0x7f8424001e80 comp rx=0 tx=0).stop 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 shutdown_connections 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f840c078b90 0x7f840c07b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84280ce460 0x7f8428153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f842814f1c0 0x7f84281542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 --2- 172.21.15.81:0/3736177194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140051c0 0x7f8428146920 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 >> 172.21.15.81:0/3736177194 conn(0x7f84280b2030 msgr2=0x7f84280cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:07.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 shutdown_connections 2024-09-21T06:46:07.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.411+0000 7f842f27f640 1 -- 172.21.15.81:0/3736177194 wait complete. 2024-09-21T06:46:07.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:07.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 -- 172.21.15.81:0/4261416195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb815a290 msgr2=0x7f0eb81601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/4261416195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb815a290 0x7f0eb81601c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009830 tx=0x7f0ea802a510 comp rx=0 tx=0).stop 2024-09-21T06:46:07.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 -- 172.21.15.81:0/4261416195 shutdown_connections 2024-09-21T06:46:07.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/4261416195 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0eb815d2c0 0x7f0eb815d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/4261416195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb815a290 0x7f0eb81601c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 -- 172.21.15.81:0/4261416195 >> 172.21.15.81:0/4261416195 conn(0x7f0eb80d25e0 msgr2=0x7f0eb80d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:07.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 -- 172.21.15.81:0/4261416195 shutdown_connections 2024-09-21T06:46:07.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.535+0000 7f0ebf64d640 1 -- 172.21.15.81:0/4261416195 wait complete. 2024-09-21T06:46:07.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.537+0000 7f0ebf64d640 1 Processor -- start 2024-09-21T06:46:07.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.537+0000 7f0ebf64d640 1 -- start start 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebf64d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb80d19a0 0x7f0eb80b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebf64d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0eb815a290 0x7f0eb81f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebf64d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0eb815d2c0 0x7f0eb81542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebf64d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8072ec0 con 0x7f0eb80d19a0 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebf64d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8072d40 con 0x7f0eb815d2c0 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebf64d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb8073040 con 0x7f0eb815a290 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebd3e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb80d19a0 0x7f0eb80b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebd3e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb80d19a0 0x7f0eb80b5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39736/0 (socket says 172.21.15.81:39736) 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebd3e9640 1 -- 172.21.15.81:0/602199426 learned_addr learned my addr 172.21.15.81:0/602199426 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebcbe8640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0eb815a290 0x7f0eb81f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.538+0000 7f0ebdbea640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0eb815d2c0 0x7f0eb81542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebd3e9640 1 -- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0eb815a290 msgr2=0x7f0eb81f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebd3e9640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0eb815a290 0x7f0eb81f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebd3e9640 1 -- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0eb815d2c0 msgr2=0x7f0eb81542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebd3e9640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0eb815d2c0 0x7f0eb81542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebd3e9640 1 -- 172.21.15.81:0/602199426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb8154800 con 0x7f0eb80d19a0 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebcbe8640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0eb815a290 0x7f0eb81f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebdbea640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0eb815d2c0 0x7f0eb81542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebd3e9640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb80d19a0 0x7f0eb80b5cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400c420 tx=0x7f0eb400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0eadffb640 1 -- 172.21.15.81:0/602199426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4017070 con 0x7f0eb80d19a0 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0eadffb640 1 -- 172.21.15.81:0/602199426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eb40035f0 con 0x7f0eb80d19a0 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb8154cf0 con 0x7f0eb80d19a0 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0eadffb640 1 -- 172.21.15.81:0/602199426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4003a40 con 0x7f0eb80d19a0 2024-09-21T06:46:07.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.539+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb80b51f0 con 0x7f0eb80d19a0 2024-09-21T06:46:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.540+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb8073560 con 0x7f0eb80d19a0 2024-09-21T06:46:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.541+0000 7f0eadffb640 1 -- 172.21.15.81:0/602199426 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0eb401a070 con 0x7f0eb80d19a0 2024-09-21T06:46:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.541+0000 7f0eadffb640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0e9c078b90 0x7f0e9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.542+0000 7f0eadffb640 1 -- 172.21.15.81:0/602199426 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f0eb409a1b0 con 0x7f0eb80d19a0 2024-09-21T06:46:07.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.542+0000 7f0ebcbe8640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0e9c078b90 0x7f0e9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.542+0000 7f0ebcbe8640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0e9c078b90 0x7f0e9c07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8034000 tx=0x7f0ea8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:07.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.546+0000 7f0eadffb640 1 -- 172.21.15.81:0/602199426 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0eb4062470 con 0x7f0eb80d19a0 2024-09-21T06:46:07.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.724+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0eb8159b60 con 0x7f0eb80d19a0 2024-09-21T06:46:07.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.725+0000 7f0eadffb640 1 -- 172.21.15.81:0/602199426 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16966 (secure 0 0 0) 0x7f0eb4061d70 con 0x7f0eb80d19a0 2024-09-21T06:46:07.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:07.728 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:05.639642+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:01.666905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:02.952864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0e9c078b90 msgr2=0x7f0e9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0e9c078b90 0x7f0e9c07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8034000 tx=0x7f0ea8004730 comp rx=0 tx=0).stop 2024-09-21T06:46:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb80d19a0 msgr2=0x7f0eb80b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb80d19a0 0x7f0eb80b5cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400c420 tx=0x7f0eb400c8e0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 shutdown_connections 2024-09-21T06:46:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0e9c078b90 0x7f0e9c07b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0eb815a290 0x7f0eb81f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0eb815d2c0 0x7f0eb81542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 --2- 172.21.15.81:0/602199426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0eb80d19a0 0x7f0eb80b5cd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 >> 172.21.15.81:0/602199426 conn(0x7f0eb80d25e0 msgr2=0x7f0eb815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 shutdown_connections 2024-09-21T06:46:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.728+0000 7f0ebf64d640 1 -- 172.21.15.81:0/602199426 wait complete. 2024-09-21T06:46:07.741 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:46:07.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.852+0000 7f158808b640 1 -- 172.21.15.81:0/1362849748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f156c004800 msgr2=0x7f156c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.852+0000 7f158808b640 1 --2- 172.21.15.81:0/1362849748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f156c004800 0x7f156c004c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1570009b20 tx=0x7f156c005830 comp rx=0 tx=0).stop 2024-09-21T06:46:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.852+0000 7f158808b640 1 -- 172.21.15.81:0/1362849748 shutdown_connections 2024-09-21T06:46:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.852+0000 7f158808b640 1 --2- 172.21.15.81:0/1362849748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f156c004800 0x7f156c004c10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.852+0000 7f158808b640 1 -- 172.21.15.81:0/1362849748 >> 172.21.15.81:0/1362849748 conn(0x7f15800b7330 msgr2=0x7f15800b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.852+0000 7f158808b640 1 -- 172.21.15.81:0/1362849748 shutdown_connections 2024-09-21T06:46:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.852+0000 7f158808b640 1 -- 172.21.15.81:0/1362849748 wait complete. 2024-09-21T06:46:07.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.854+0000 7f158808b640 1 Processor -- start 2024-09-21T06:46:07.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.854+0000 7f158808b640 1 -- start start 2024-09-21T06:46:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f158808b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156c004800 0x7f15800b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f158808b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15801f6370 0x7f15801f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f158808b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15801f9690 0x7f15800c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f158808b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f158015f130 con 0x7f15801f6370 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f158808b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f158015efb0 con 0x7f15801f9690 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f158808b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f158015f2b0 con 0x7f156c004800 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f1585626640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15801f6370 0x7f15801f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f1585626640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15801f6370 0x7f15801f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39746/0 (socket says 172.21.15.81:39746) 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.855+0000 7f1585626640 1 -- 172.21.15.81:0/2925914981 learned_addr learned my addr 172.21.15.81:0/2925914981 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585e27640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156c004800 0x7f15800b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1586628640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15801f9690 0x7f15800c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585626640 1 -- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156c004800 msgr2=0x7f15800b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585626640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156c004800 0x7f15800b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585626640 1 -- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15801f9690 msgr2=0x7f15800c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585626640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15801f9690 0x7f15800c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585626640 1 -- 172.21.15.81:0/2925914981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15800b5ae0 con 0x7f15801f6370 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585e27640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156c004800 0x7f15800b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1586628640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15801f9690 0x7f15800c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f1585626640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15801f6370 0x7f15801f9150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1570036040 tx=0x7f1570033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f15767fc640 1 -- 172.21.15.81:0/2925914981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570038040 con 0x7f15801f6370 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f15767fc640 1 -- 172.21.15.81:0/2925914981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1570041070 con 0x7f15801f6370 2024-09-21T06:46:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15800b5d80 con 0x7f15801f6370 2024-09-21T06:46:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f15767fc640 1 -- 172.21.15.81:0/2925914981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570033df0 con 0x7f15801f6370 2024-09-21T06:46:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.856+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15800c99c0 con 0x7f15801f6370 2024-09-21T06:46:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.857+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158008d110 con 0x7f15801f6370 2024-09-21T06:46:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.858+0000 7f15767fc640 1 -- 172.21.15.81:0/2925914981 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1570046460 con 0x7f15801f6370 2024-09-21T06:46:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.858+0000 7f15767fc640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1564078b90 0x7f156407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.859+0000 7f15767fc640 1 -- 172.21.15.81:0/2925914981 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f15700bb990 con 0x7f15801f6370 2024-09-21T06:46:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.859+0000 7f1585e27640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1564078b90 0x7f156407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:07.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.859+0000 7f1585e27640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1564078b90 0x7f156407b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f157c0018a0 tx=0x7f157c000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:07.863+0000 7f15767fc640 1 -- 172.21.15.81:0/2925914981 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f158008d110 con 0x7f15801f6370 2024-09-21T06:46:08.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.035+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15800d4490 con 0x7f1564078b90 2024-09-21T06:46:08.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.040+0000 7f15767fc640 1 -- 172.21.15.81:0/2925914981 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243427 (secure 0 0 0) 0x7f15800d4490 con 0x7f1564078b90 2024-09-21T06:46:08.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:08.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1564078b90 msgr2=0x7f156407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1564078b90 0x7f156407b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f157c0018a0 tx=0x7f157c000ed0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15801f6370 msgr2=0x7f15801f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15801f6370 0x7f15801f9150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1570036040 tx=0x7f1570033670 comp rx=0 tx=0).stop 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 shutdown_connections 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1564078b90 0x7f156407b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15801f9690 0x7f15800c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15801f6370 0x7f15801f9150 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 --2- 172.21.15.81:0/2925914981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f156c004800 0x7f15800b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 >> 172.21.15.81:0/2925914981 conn(0x7f15800b7330 msgr2=0x7f15800b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 shutdown_connections 2024-09-21T06:46:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.043+0000 7f158808b640 1 -- 172.21.15.81:0/2925914981 wait complete. 2024-09-21T06:46:08.057 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-21T06:46:06.663820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220444,"kb_used_data":4196,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754276,"statfs":{"total":773094113280,"available":772868378624,"internally_reserved":0,"allocated":4296704,"data_stored":2452125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038031"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638055+0000","last_change":"2024-09-21T06:46:03.638055+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638055+0000","last_undegraded":"2024-09-21T06:46:03.638055+0000","last_fullsized":"2024-09-21T06:46:03.638055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637277+0000","last_change":"2024-09-21T06:46:03.637277+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637277+0000","last_undegraded":"2024-09-21T06:46:03.637277+0000","last_fullsized":"2024-09-21T06:46:03.637277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636790+0000","last_change":"2024-09-21T06:46:03.636790+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636790+0000","last_undegraded":"2024-09-21T06:46:03.636790+0000","last_fullsized":"2024-09-21T06:46:03.636790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636460+0000","last_change":"2024-09-21T06:46:03.636460+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636460+0000","last_undegraded":"2024-09-21T06:46:03.636460+0000","last_fullsized":"2024-09-21T06:46:03.636460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634514+0000","last_change":"2024-09-21T06:46:03.634514+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634514+0000","last_undegraded":"2024-09-21T06:46:03.634514+0000","last_fullsized":"2024-09-21T06:46:03.634514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642365+0000","last_change":"2024-09-21T06:46:03.642365+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642365+0000","last_undegraded":"2024-09-21T06:46:03.642365+0000","last_fullsized":"2024-09-21T06:46:03.642365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636642+0000","last_change":"2024-09-21T06:46:03.636642+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636642+0000","last_undegraded":"2024-09-21T06:46:03.636642+0000","last_fullsized":"2024-09-21T06:46:03.636642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642255+0000","last_change":"2024-09-21T06:46:03.642255+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642255+0000","last_undegraded":"2024-09-21T06:46:03.642255+0000","last_fullsized":"2024-09-21T06:46:03.642255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638858+0000","last_change":"2024-09-21T06:46:03.638858+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638858+0000","last_undegraded":"2024-09-21T06:46:03.638858+0000","last_fullsized":"2024-09-21T06:46:03.638858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635005+0000","last_change":"2024-09-21T06:46:03.635005+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635005+0000","last_undegraded":"2024-09-21T06:46:03.635005+0000","last_fullsized":"2024-09-21T06:46:03.635005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635377+0000","last_change":"2024-09-21T06:46:03.635377+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635377+0000","last_undegraded":"2024-09-21T06:46:03.635377+0000","last_fullsized":"2024-09-21T06:46:03.635377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637584+0000","last_change":"2024-09-21T06:46:03.637584+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637584+0000","last_undegraded":"2024-09-21T06:46:03.637584+0000","last_fullsized":"2024-09-21T06:46:03.637584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.641884+0000","last_change":"2024-09-21T06:46:03.641884+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.641884+0000","last_undegraded":"2024-09-21T06:46:03.641884+0000","last_fullsized":"2024-09-21T06:46:03.641884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640337+0000","last_change":"2024-09-21T06:46:03.640337+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640337+0000","last_undegraded":"2024-09-21T06:46:03.640337+0000","last_fullsized":"2024-09-21T06:46:03.640337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635863+0000","last_change":"2024-09-21T06:46:03.635863+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635863+0000","last_undegraded":"2024-09-21T06:46:03.635863+0000","last_fullsized":"2024-09-21T06:46:03.635863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634263+0000","last_change":"2024-09-21T06:46:03.634263+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634263+0000","last_undegraded":"2024-09-21T06:46:03.634263+0000","last_fullsized":"2024-09-21T06:46:03.634263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.639647+0000","last_change":"2024-09-21T06:46:03.639647+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.639647+0000","last_undegraded":"2024-09-21T06:46:03.639647+0000","last_fullsized":"2024-09-21T06:46:03.639647+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643531+0000","last_change":"2024-09-21T06:46:03.643531+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643531+0000","last_undegraded":"2024-09-21T06:46:03.643531+0000","last_fullsized":"2024-09-21T06:46:03.643531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634481+0000","last_change":"2024-09-21T06:46:03.634481+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634481+0000","last_undegraded":"2024-09-21T06:46:03.634481+0000","last_fullsized":"2024-09-21T06:46:03.634481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637166+0000","last_change":"2024-09-21T06:46:03.637166+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637166+0000","last_undegraded":"2024-09-21T06:46:03.637166+0000","last_fullsized":"2024-09-21T06:46:03.637166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649978+0000","last_change":"2024-09-21T06:46:03.647271+0000","last_active":"2024-09-21T06:46:03.649978+0000","last_peered":"2024-09-21T06:46:03.649978+0000","last_clean":"2024-09-21T06:46:03.649978+0000","last_became_active":"2024-09-21T06:46:03.646987+0000","last_became_peered":"2024-09-21T06:46:03.646987+0000","last_unstale":"2024-09-21T06:46:03.649978+0000","last_undegraded":"2024-09-21T06:46:03.649978+0000","last_fullsized":"2024-09-21T06:46:03.649978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:19.498283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629644+0000","last_change":"2024-09-21T06:46:02.629644+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629644+0000","last_undegraded":"2024-09-21T06:46:02.629644+0000","last_fullsized":"2024-09-21T06:46:02.629644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638060+0000","last_change":"2024-09-21T06:46:03.638060+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638060+0000","last_undegraded":"2024-09-21T06:46:03.638060+0000","last_fullsized":"2024-09-21T06:46:03.638060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629582+0000","last_change":"2024-09-21T06:46:02.629582+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629582+0000","last_undegraded":"2024-09-21T06:46:02.629582+0000","last_fullsized":"2024-09-21T06:46:02.629582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650018+0000","last_change":"2024-09-21T06:46:03.644181+0000","last_active":"2024-09-21T06:46:03.650018+0000","last_peered":"2024-09-21T06:46:03.650018+0000","last_clean":"2024-09-21T06:46:03.650018+0000","last_became_active":"2024-09-21T06:46:03.643878+0000","last_became_peered":"2024-09-21T06:46:03.643878+0000","last_unstale":"2024-09-21T06:46:03.650018+0000","last_undegraded":"2024-09-21T06:46:03.650018+0000","last_fullsized":"2024-09-21T06:46:03.650018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:52.886598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649465+0000","last_change":"2024-09-21T06:46:03.641222+0000","last_active":"2024-09-21T06:46:03.649465+0000","last_peered":"2024-09-21T06:46:03.649465+0000","last_clean":"2024-09-21T06:46:03.649465+0000","last_became_active":"2024-09-21T06:46:03.640868+0000","last_became_peered":"2024-09-21T06:46:03.640868+0000","last_unstale":"2024-09-21T06:46:03.649465+0000","last_undegraded":"2024-09-21T06:46:03.649465+0000","last_fullsized":"2024-09-21T06:46:03.649465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:43.128820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637875+0000","last_change":"2024-09-21T06:46:03.637875+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637875+0000","last_undegraded":"2024-09-21T06:46:03.637875+0000","last_fullsized":"2024-09-21T06:46:03.637875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.651433+0000","last_change":"2024-09-21T06:46:03.646346+0000","last_active":"2024-09-21T06:46:03.651433+0000","last_peered":"2024-09-21T06:46:03.651433+0000","last_clean":"2024-09-21T06:46:03.651433+0000","last_became_active":"2024-09-21T06:46:03.645110+0000","last_became_peered":"2024-09-21T06:46:03.645110+0000","last_unstale":"2024-09-21T06:46:03.651433+0000","last_undegraded":"2024-09-21T06:46:03.651433+0000","last_fullsized":"2024-09-21T06:46:03.651433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643077+0000","last_change":"2024-09-21T06:46:03.643077+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643077+0000","last_undegraded":"2024-09-21T06:46:03.643077+0000","last_fullsized":"2024-09-21T06:46:03.643077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630673+0000","last_change":"2024-09-21T06:46:02.630673+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630673+0000","last_undegraded":"2024-09-21T06:46:02.630673+0000","last_fullsized":"2024-09-21T06:46:02.630673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.644028+0000","last_change":"2024-09-21T06:46:03.639925+0000","last_active":"2024-09-21T06:46:03.644028+0000","last_peered":"2024-09-21T06:46:03.644028+0000","last_clean":"2024-09-21T06:46:03.644028+0000","last_became_active":"2024-09-21T06:46:03.639624+0000","last_became_peered":"2024-09-21T06:46:03.639624+0000","last_unstale":"2024-09-21T06:46:03.644028+0000","last_undegraded":"2024-09-21T06:46:03.644028+0000","last_fullsized":"2024-09-21T06:46:03.644028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:08.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629900+0000","last_change":"2024-09-21T06:46:02.629900+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629900+0000","last_undegraded":"2024-09-21T06:46:02.629900+0000","last_fullsized":"2024-09-21T06:46:02.629900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636360+0000","last_change":"2024-09-21T06:46:03.636360+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636360+0000","last_undegraded":"2024-09-21T06:46:03.636360+0000","last_fullsized":"2024-09-21T06:46:03.636360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653246+0000","last_change":"2024-09-21T06:46:03.647428+0000","last_active":"2024-09-21T06:46:03.653246+0000","last_peered":"2024-09-21T06:46:03.653246+0000","last_clean":"2024-09-21T06:46:03.653246+0000","last_became_active":"2024-09-21T06:46:03.647141+0000","last_became_peered":"2024-09-21T06:46:03.647141+0000","last_unstale":"2024-09-21T06:46:03.653246+0000","last_undegraded":"2024-09-21T06:46:03.653246+0000","last_fullsized":"2024-09-21T06:46:03.653246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:25.124073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.654885+0000","last_change":"2024-09-21T06:46:03.652929+0000","last_active":"2024-09-21T06:46:03.654885+0000","last_peered":"2024-09-21T06:46:03.654885+0000","last_clean":"2024-09-21T06:46:03.654885+0000","last_became_active":"2024-09-21T06:46:03.652578+0000","last_became_peered":"2024-09-21T06:46:03.652578+0000","last_unstale":"2024-09-21T06:46:03.654885+0000","last_undegraded":"2024-09-21T06:46:03.654885+0000","last_fullsized":"2024-09-21T06:46:03.654885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:06.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634148+0000","last_change":"2024-09-21T06:46:03.634148+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634148+0000","last_undegraded":"2024-09-21T06:46:03.634148+0000","last_fullsized":"2024-09-21T06:46:03.634148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630412+0000","last_change":"2024-09-21T06:46:02.630412+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630412+0000","last_undegraded":"2024-09-21T06:46:02.630412+0000","last_fullsized":"2024-09-21T06:46:02.630412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630318+0000","last_change":"2024-09-21T06:46:02.630318+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630318+0000","last_undegraded":"2024-09-21T06:46:02.630318+0000","last_fullsized":"2024-09-21T06:46:02.630318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630073+0000","last_change":"2024-09-21T06:46:02.630073+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630073+0000","last_undegraded":"2024-09-21T06:46:02.630073+0000","last_fullsized":"2024-09-21T06:46:02.630073+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635661+0000","last_change":"2024-09-21T06:46:03.635661+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635661+0000","last_undegraded":"2024-09-21T06:46:03.635661+0000","last_fullsized":"2024-09-21T06:46:03.635661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653673+0000","last_change":"2024-09-21T06:46:03.650829+0000","last_active":"2024-09-21T06:46:03.653673+0000","last_peered":"2024-09-21T06:46:03.653673+0000","last_clean":"2024-09-21T06:46:03.653673+0000","last_became_active":"2024-09-21T06:46:03.650489+0000","last_became_peered":"2024-09-21T06:46:03.650489+0000","last_unstale":"2024-09-21T06:46:03.653673+0000","last_undegraded":"2024-09-21T06:46:03.653673+0000","last_fullsized":"2024-09-21T06:46:03.653673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:02.441436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650055+0000","last_change":"2024-09-21T06:46:03.646551+0000","last_active":"2024-09-21T06:46:03.650055+0000","last_peered":"2024-09-21T06:46:03.650055+0000","last_clean":"2024-09-21T06:46:03.650055+0000","last_became_active":"2024-09-21T06:46:03.646209+0000","last_became_peered":"2024-09-21T06:46:03.646209+0000","last_unstale":"2024-09-21T06:46:03.650055+0000","last_undegraded":"2024-09-21T06:46:03.650055+0000","last_fullsized":"2024-09-21T06:46:03.650055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:24.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649059+0000","last_change":"2024-09-21T06:46:03.643628+0000","last_active":"2024-09-21T06:46:03.649059+0000","last_peered":"2024-09-21T06:46:03.649059+0000","last_clean":"2024-09-21T06:46:03.649059+0000","last_became_active":"2024-09-21T06:46:03.643306+0000","last_became_peered":"2024-09-21T06:46:03.643306+0000","last_unstale":"2024-09-21T06:46:03.649059+0000","last_undegraded":"2024-09-21T06:46:03.649059+0000","last_fullsized":"2024-09-21T06:46:03.649059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:59.156059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634286+0000","last_change":"2024-09-21T06:46:03.634286+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634286+0000","last_undegraded":"2024-09-21T06:46:03.634286+0000","last_fullsized":"2024-09-21T06:46:03.634286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653217+0000","last_change":"2024-09-21T06:46:03.646712+0000","last_active":"2024-09-21T06:46:03.653217+0000","last_peered":"2024-09-21T06:46:03.653217+0000","last_clean":"2024-09-21T06:46:03.653217+0000","last_became_active":"2024-09-21T06:46:03.646413+0000","last_became_peered":"2024-09-21T06:46:03.646413+0000","last_unstale":"2024-09-21T06:46:03.653217+0000","last_undegraded":"2024-09-21T06:46:03.653217+0000","last_fullsized":"2024-09-21T06:46:03.653217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:13.485574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634145+0000","last_change":"2024-09-21T06:46:03.634145+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634145+0000","last_undegraded":"2024-09-21T06:46:03.634145+0000","last_fullsized":"2024-09-21T06:46:03.634145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.627925+0000","last_change":"2024-09-21T06:46:02.627925+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.627925+0000","last_undegraded":"2024-09-21T06:46:02.627925+0000","last_fullsized":"2024-09-21T06:46:02.627925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.626757+0000","last_change":"2024-09-21T06:46:02.626757+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.626757+0000","last_undegraded":"2024-09-21T06:46:02.626757+0000","last_fullsized":"2024-09-21T06:46:02.626757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640692+0000","last_change":"2024-09-21T06:46:03.640692+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640692+0000","last_undegraded":"2024-09-21T06:46:03.640692+0000","last_fullsized":"2024-09-21T06:46:03.640692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.626766+0000","last_change":"2024-09-21T06:46:02.626766+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.626766+0000","last_undegraded":"2024-09-21T06:46:02.626766+0000","last_fullsized":"2024-09-21T06:46:02.626766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629621+0000","last_change":"2024-09-21T06:46:02.629621+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629621+0000","last_undegraded":"2024-09-21T06:46:02.629621+0000","last_fullsized":"2024-09-21T06:46:02.629621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637092+0000","last_change":"2024-09-21T06:46:03.637092+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637092+0000","last_undegraded":"2024-09-21T06:46:03.637092+0000","last_fullsized":"2024-09-21T06:46:03.637092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.648980+0000","last_change":"2024-09-21T06:46:03.643663+0000","last_active":"2024-09-21T06:46:03.648980+0000","last_peered":"2024-09-21T06:46:03.648980+0000","last_clean":"2024-09-21T06:46:03.648980+0000","last_became_active":"2024-09-21T06:46:03.643355+0000","last_became_peered":"2024-09-21T06:46:03.643355+0000","last_unstale":"2024-09-21T06:46:03.648980+0000","last_undegraded":"2024-09-21T06:46:03.648980+0000","last_fullsized":"2024-09-21T06:46:03.648980+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:40.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629550+0000","last_change":"2024-09-21T06:46:02.629550+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629550+0000","last_undegraded":"2024-09-21T06:46:02.629550+0000","last_fullsized":"2024-09-21T06:46:02.629550+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653732+0000","last_change":"2024-09-21T06:46:03.652711+0000","last_active":"2024-09-21T06:46:03.653732+0000","last_peered":"2024-09-21T06:46:03.653732+0000","last_clean":"2024-09-21T06:46:03.653732+0000","last_became_active":"2024-09-21T06:46:03.652296+0000","last_became_peered":"2024-09-21T06:46:03.652296+0000","last_unstale":"2024-09-21T06:46:03.653732+0000","last_undegraded":"2024-09-21T06:46:03.653732+0000","last_fullsized":"2024-09-21T06:46:03.653732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:46.504084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636335+0000","last_change":"2024-09-21T06:46:03.636335+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636335+0000","last_undegraded":"2024-09-21T06:46:03.636335+0000","last_fullsized":"2024-09-21T06:46:03.636335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.628107+0000","last_change":"2024-09-21T06:46:02.628107+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.628107+0000","last_undegraded":"2024-09-21T06:46:02.628107+0000","last_fullsized":"2024-09-21T06:46:02.628107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.627289+0000","last_change":"2024-09-21T06:46:02.627289+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.627289+0000","last_undegraded":"2024-09-21T06:46:02.627289+0000","last_fullsized":"2024-09-21T06:46:02.627289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629586+0000","last_change":"2024-09-21T06:46:02.629586+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629586+0000","last_undegraded":"2024-09-21T06:46:02.629586+0000","last_fullsized":"2024-09-21T06:46:02.629586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653629+0000","last_change":"2024-09-21T06:46:03.650579+0000","last_active":"2024-09-21T06:46:03.653629+0000","last_peered":"2024-09-21T06:46:03.653629+0000","last_clean":"2024-09-21T06:46:03.653629+0000","last_became_active":"2024-09-21T06:46:03.650243+0000","last_became_peered":"2024-09-21T06:46:03.650243+0000","last_unstale":"2024-09-21T06:46:03.653629+0000","last_undegraded":"2024-09-21T06:46:03.653629+0000","last_fullsized":"2024-09-21T06:46:03.653629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.738279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640108+0000","last_change":"2024-09-21T06:46:03.640108+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640108+0000","last_undegraded":"2024-09-21T06:46:03.640108+0000","last_fullsized":"2024-09-21T06:46:03.640108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653754+0000","last_change":"2024-09-21T06:46:03.652588+0000","last_active":"2024-09-21T06:46:03.653754+0000","last_peered":"2024-09-21T06:46:03.653754+0000","last_clean":"2024-09-21T06:46:03.653754+0000","last_became_active":"2024-09-21T06:46:03.652237+0000","last_became_peered":"2024-09-21T06:46:03.652237+0000","last_unstale":"2024-09-21T06:46:03.653754+0000","last_undegraded":"2024-09-21T06:46:03.653754+0000","last_fullsized":"2024-09-21T06:46:03.653754+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.139777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634844+0000","last_change":"2024-09-21T06:46:03.634844+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634844+0000","last_undegraded":"2024-09-21T06:46:03.634844+0000","last_fullsized":"2024-09-21T06:46:03.634844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629532+0000","last_change":"2024-09-21T06:46:02.629532+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629532+0000","last_undegraded":"2024-09-21T06:46:02.629532+0000","last_fullsized":"2024-09-21T06:46:02.629532+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643110+0000","last_change":"2024-09-21T06:46:03.643110+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643110+0000","last_undegraded":"2024-09-21T06:46:03.643110+0000","last_fullsized":"2024-09-21T06:46:03.643110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653849+0000","last_change":"2024-09-21T06:46:03.651097+0000","last_active":"2024-09-21T06:46:03.653849+0000","last_peered":"2024-09-21T06:46:03.653849+0000","last_clean":"2024-09-21T06:46:03.653849+0000","last_became_active":"2024-09-21T06:46:03.650544+0000","last_became_peered":"2024-09-21T06:46:03.650544+0000","last_unstale":"2024-09-21T06:46:03.653849+0000","last_undegraded":"2024-09-21T06:46:03.653849+0000","last_fullsized":"2024-09-21T06:46:03.653849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:40.871830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.630375+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:03.630375+0000","last_peered":"2024-09-21T06:46:03.630375+0000","last_clean":"2024-09-21T06:46:03.630375+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:03.630375+0000","last_undegraded":"2024-09-21T06:46:03.630375+0000","last_fullsized":"2024-09-21T06:46:03.630375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":751620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":155043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":974848,"data_stored":745411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":380928,"data_stored":155043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:08.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 -- 172.21.15.81:0/2830722726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c1601c0 msgr2=0x7ff25c0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 --2- 172.21.15.81:0/2830722726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c1601c0 0x7ff25c0b1b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff250009860 tx=0x7ff25002a540 comp rx=0 tx=0).stop 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 -- 172.21.15.81:0/2830722726 shutdown_connections 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 --2- 172.21.15.81:0/2830722726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c1601c0 0x7ff25c0b1b90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 --2- 172.21.15.81:0/2830722726 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff25c0d19a0 0x7ff25c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 -- 172.21.15.81:0/2830722726 >> 172.21.15.81:0/2830722726 conn(0x7ff25c0d25e0 msgr2=0x7ff25c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 -- 172.21.15.81:0/2830722726 shutdown_connections 2024-09-21T06:46:08.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.207+0000 7ff2622c5640 1 -- 172.21.15.81:0/2830722726 wait complete. 2024-09-21T06:46:08.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.209+0000 7ff2622c5640 1 Processor -- start 2024-09-21T06:46:08.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.209+0000 7ff2622c5640 1 -- start start 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff2622c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0b20d0 0x7ff25c1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff2622c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c0d19a0 0x7ff25c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff2622c5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff25c1601c0 0x7ff25c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff2622c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c072ec0 con 0x7ff25c0b20d0 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff2622c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c072d40 con 0x7ff25c0d19a0 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff2622c5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c073040 con 0x7ff25c1601c0 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0b20d0 0x7ff25c1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0b20d0 0x7ff25c1f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56686/0 (socket says 172.21.15.81:56686) 2024-09-21T06:46:08.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 -- 172.21.15.81:0/1863971866 learned_addr learned my addr 172.21.15.81:0/1863971866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25b7fe640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c0d19a0 0x7ff25c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff260862640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff25c1601c0 0x7ff25c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 -- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff25c1601c0 msgr2=0x7ff25c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff25c1601c0 0x7ff25c0c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 -- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c0d19a0 msgr2=0x7ff25c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c0d19a0 0x7ff25c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 -- 172.21.15.81:0/1863971866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c1f5e10 con 0x7ff25c0b20d0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff260862640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff25c1601c0 0x7ff25c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff25bfff640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0b20d0 0x7ff25c1f5620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00e9f0 tx=0x7ff24c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff258ff9640 1 -- 172.21.15.81:0/1863971866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c00cd80 con 0x7ff25c0b20d0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c1f60f0 con 0x7ff25c0b20d0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff258ff9640 1 -- 172.21.15.81:0/1863971866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff24c004020 con 0x7ff25c0b20d0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.211+0000 7ff258ff9640 1 -- 172.21.15.81:0/1863971866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c004470 con 0x7ff25c0b20d0 2024-09-21T06:46:08.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.212+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c0c97b0 con 0x7ff25c0b20d0 2024-09-21T06:46:08.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.212+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c06dea0 con 0x7ff25c0b20d0 2024-09-21T06:46:08.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.213+0000 7ff258ff9640 1 -- 172.21.15.81:0/1863971866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff24c0035f0 con 0x7ff25c0b20d0 2024-09-21T06:46:08.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.214+0000 7ff258ff9640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff248078b90 0x7ff24807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.214+0000 7ff258ff9640 1 -- 172.21.15.81:0/1863971866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7ff24c09b970 con 0x7ff25c0b20d0 2024-09-21T06:46:08.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.214+0000 7ff25b7fe640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff248078b90 0x7ff24807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.214+0000 7ff25b7fe640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff248078b90 0x7ff24807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff250034000 tx=0x7ff250004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:08.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.218+0000 7ff258ff9640 1 -- 172.21.15.81:0/1863971866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff25c06dea0 con 0x7ff25c0b20d0 2024-09-21T06:46:08.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.395+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff25c1f6610 con 0x7ff248078b90 2024-09-21T06:46:08.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.399+0000 7ff258ff9640 1 -- 172.21.15.81:0/1863971866 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243427 (secure 0 0 0) 0x7ff25c1f6610 con 0x7ff248078b90 2024-09-21T06:46:08.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff248078b90 msgr2=0x7ff24807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff248078b90 0x7ff24807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff250034000 tx=0x7ff250004730 comp rx=0 tx=0).stop 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0b20d0 msgr2=0x7ff25c1f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0b20d0 0x7ff25c1f5620 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00e9f0 tx=0x7ff24c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 shutdown_connections 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff248078b90 0x7ff24807b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff25c1601c0 0x7ff25c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff25c0d19a0 0x7ff25c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 --2- 172.21.15.81:0/1863971866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff25c0b20d0 0x7ff25c1f5620 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 >> 172.21.15.81:0/1863971866 conn(0x7ff25c0d25e0 msgr2=0x7ff25c15c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 shutdown_connections 2024-09-21T06:46:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.403+0000 7ff2622c5640 1 -- 172.21.15.81:0/1863971866 wait complete. 2024-09-21T06:46:08.416 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-21T06:46:06.663820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220444,"kb_used_data":4196,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754276,"statfs":{"total":773094113280,"available":772868378624,"internally_reserved":0,"allocated":4296704,"data_stored":2452125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038031"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638055+0000","last_change":"2024-09-21T06:46:03.638055+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638055+0000","last_undegraded":"2024-09-21T06:46:03.638055+0000","last_fullsized":"2024-09-21T06:46:03.638055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637277+0000","last_change":"2024-09-21T06:46:03.637277+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637277+0000","last_undegraded":"2024-09-21T06:46:03.637277+0000","last_fullsized":"2024-09-21T06:46:03.637277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636790+0000","last_change":"2024-09-21T06:46:03.636790+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636790+0000","last_undegraded":"2024-09-21T06:46:03.636790+0000","last_fullsized":"2024-09-21T06:46:03.636790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636460+0000","last_change":"2024-09-21T06:46:03.636460+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636460+0000","last_undegraded":"2024-09-21T06:46:03.636460+0000","last_fullsized":"2024-09-21T06:46:03.636460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634514+0000","last_change":"2024-09-21T06:46:03.634514+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634514+0000","last_undegraded":"2024-09-21T06:46:03.634514+0000","last_fullsized":"2024-09-21T06:46:03.634514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642365+0000","last_change":"2024-09-21T06:46:03.642365+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642365+0000","last_undegraded":"2024-09-21T06:46:03.642365+0000","last_fullsized":"2024-09-21T06:46:03.642365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636642+0000","last_change":"2024-09-21T06:46:03.636642+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636642+0000","last_undegraded":"2024-09-21T06:46:03.636642+0000","last_fullsized":"2024-09-21T06:46:03.636642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642255+0000","last_change":"2024-09-21T06:46:03.642255+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642255+0000","last_undegraded":"2024-09-21T06:46:03.642255+0000","last_fullsized":"2024-09-21T06:46:03.642255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638858+0000","last_change":"2024-09-21T06:46:03.638858+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638858+0000","last_undegraded":"2024-09-21T06:46:03.638858+0000","last_fullsized":"2024-09-21T06:46:03.638858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635005+0000","last_change":"2024-09-21T06:46:03.635005+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635005+0000","last_undegraded":"2024-09-21T06:46:03.635005+0000","last_fullsized":"2024-09-21T06:46:03.635005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635377+0000","last_change":"2024-09-21T06:46:03.635377+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635377+0000","last_undegraded":"2024-09-21T06:46:03.635377+0000","last_fullsized":"2024-09-21T06:46:03.635377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637584+0000","last_change":"2024-09-21T06:46:03.637584+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637584+0000","last_undegraded":"2024-09-21T06:46:03.637584+0000","last_fullsized":"2024-09-21T06:46:03.637584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.641884+0000","last_change":"2024-09-21T06:46:03.641884+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.641884+0000","last_undegraded":"2024-09-21T06:46:03.641884+0000","last_fullsized":"2024-09-21T06:46:03.641884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640337+0000","last_change":"2024-09-21T06:46:03.640337+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640337+0000","last_undegraded":"2024-09-21T06:46:03.640337+0000","last_fullsized":"2024-09-21T06:46:03.640337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635863+0000","last_change":"2024-09-21T06:46:03.635863+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635863+0000","last_undegraded":"2024-09-21T06:46:03.635863+0000","last_fullsized":"2024-09-21T06:46:03.635863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634263+0000","last_change":"2024-09-21T06:46:03.634263+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634263+0000","last_undegraded":"2024-09-21T06:46:03.634263+0000","last_fullsized":"2024-09-21T06:46:03.634263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.639647+0000","last_change":"2024-09-21T06:46:03.639647+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.639647+0000","last_undegraded":"2024-09-21T06:46:03.639647+0000","last_fullsized":"2024-09-21T06:46:03.639647+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643531+0000","last_change":"2024-09-21T06:46:03.643531+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643531+0000","last_undegraded":"2024-09-21T06:46:03.643531+0000","last_fullsized":"2024-09-21T06:46:03.643531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634481+0000","last_change":"2024-09-21T06:46:03.634481+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634481+0000","last_undegraded":"2024-09-21T06:46:03.634481+0000","last_fullsized":"2024-09-21T06:46:03.634481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637166+0000","last_change":"2024-09-21T06:46:03.637166+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637166+0000","last_undegraded":"2024-09-21T06:46:03.637166+0000","last_fullsized":"2024-09-21T06:46:03.637166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649978+0000","last_change":"2024-09-21T06:46:03.647271+0000","last_active":"2024-09-21T06:46:03.649978+0000","last_peered":"2024-09-21T06:46:03.649978+0000","last_clean":"2024-09-21T06:46:03.649978+0000","last_became_active":"2024-09-21T06:46:03.646987+0000","last_became_peered":"2024-09-21T06:46:03.646987+0000","last_unstale":"2024-09-21T06:46:03.649978+0000","last_undegraded":"2024-09-21T06:46:03.649978+0000","last_fullsized":"2024-09-21T06:46:03.649978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:19.498283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629644+0000","last_change":"2024-09-21T06:46:02.629644+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629644+0000","last_undegraded":"2024-09-21T06:46:02.629644+0000","last_fullsized":"2024-09-21T06:46:02.629644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638060+0000","last_change":"2024-09-21T06:46:03.638060+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638060+0000","last_undegraded":"2024-09-21T06:46:03.638060+0000","last_fullsized":"2024-09-21T06:46:03.638060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629582+0000","last_change":"2024-09-21T06:46:02.629582+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629582+0000","last_undegraded":"2024-09-21T06:46:02.629582+0000","last_fullsized":"2024-09-21T06:46:02.629582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650018+0000","last_change":"2024-09-21T06:46:03.644181+0000","last_active":"2024-09-21T06:46:03.650018+0000","last_peered":"2024-09-21T06:46:03.650018+0000","last_clean":"2024-09-21T06:46:03.650018+0000","last_became_active":"2024-09-21T06:46:03.643878+0000","last_became_peered":"2024-09-21T06:46:03.643878+0000","last_unstale":"2024-09-21T06:46:03.650018+0000","last_undegraded":"2024-09-21T06:46:03.650018+0000","last_fullsized":"2024-09-21T06:46:03.650018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:52.886598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649465+0000","last_change":"2024-09-21T06:46:03.641222+0000","last_active":"2024-09-21T06:46:03.649465+0000","last_peered":"2024-09-21T06:46:03.649465+0000","last_clean":"2024-09-21T06:46:03.649465+0000","last_became_active":"2024-09-21T06:46:03.640868+0000","last_became_peered":"2024-09-21T06:46:03.640868+0000","last_unstale":"2024-09-21T06:46:03.649465+0000","last_undegraded":"2024-09-21T06:46:03.649465+0000","last_fullsized":"2024-09-21T06:46:03.649465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:43.128820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637875+0000","last_change":"2024-09-21T06:46:03.637875+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637875+0000","last_undegraded":"2024-09-21T06:46:03.637875+0000","last_fullsized":"2024-09-21T06:46:03.637875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.651433+0000","last_change":"2024-09-21T06:46:03.646346+0000","last_active":"2024-09-21T06:46:03.651433+0000","last_peered":"2024-09-21T06:46:03.651433+0000","last_clean":"2024-09-21T06:46:03.651433+0000","last_became_active":"2024-09-21T06:46:03.645110+0000","last_became_peered":"2024-09-21T06:46:03.645110+0000","last_unstale":"2024-09-21T06:46:03.651433+0000","last_undegraded":"2024-09-21T06:46:03.651433+0000","last_fullsized":"2024-09-21T06:46:03.651433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643077+0000","last_change":"2024-09-21T06:46:03.643077+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643077+0000","last_undegraded":"2024-09-21T06:46:03.643077+0000","last_fullsized":"2024-09-21T06:46:03.643077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630673+0000","last_change":"2024-09-21T06:46:02.630673+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630673+0000","last_undegraded":"2024-09-21T06:46:02.630673+0000","last_fullsized":"2024-09-21T06:46:02.630673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.644028+0000","last_change":"2024-09-21T06:46:03.639925+0000","last_active":"2024-09-21T06:46:03.644028+0000","last_peered":"2024-09-21T06:46:03.644028+0000","last_clean":"2024-09-21T06:46:03.644028+0000","last_became_active":"2024-09-21T06:46:03.639624+0000","last_became_peered":"2024-09-21T06:46:03.639624+0000","last_unstale":"2024-09-21T06:46:03.644028+0000","last_undegraded":"2024-09-21T06:46:03.644028+0000","last_fullsized":"2024-09-21T06:46:03.644028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:08.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629900+0000","last_change":"2024-09-21T06:46:02.629900+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629900+0000","last_undegraded":"2024-09-21T06:46:02.629900+0000","last_fullsized":"2024-09-21T06:46:02.629900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636360+0000","last_change":"2024-09-21T06:46:03.636360+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636360+0000","last_undegraded":"2024-09-21T06:46:03.636360+0000","last_fullsized":"2024-09-21T06:46:03.636360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653246+0000","last_change":"2024-09-21T06:46:03.647428+0000","last_active":"2024-09-21T06:46:03.653246+0000","last_peered":"2024-09-21T06:46:03.653246+0000","last_clean":"2024-09-21T06:46:03.653246+0000","last_became_active":"2024-09-21T06:46:03.647141+0000","last_became_peered":"2024-09-21T06:46:03.647141+0000","last_unstale":"2024-09-21T06:46:03.653246+0000","last_undegraded":"2024-09-21T06:46:03.653246+0000","last_fullsized":"2024-09-21T06:46:03.653246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:25.124073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.654885+0000","last_change":"2024-09-21T06:46:03.652929+0000","last_active":"2024-09-21T06:46:03.654885+0000","last_peered":"2024-09-21T06:46:03.654885+0000","last_clean":"2024-09-21T06:46:03.654885+0000","last_became_active":"2024-09-21T06:46:03.652578+0000","last_became_peered":"2024-09-21T06:46:03.652578+0000","last_unstale":"2024-09-21T06:46:03.654885+0000","last_undegraded":"2024-09-21T06:46:03.654885+0000","last_fullsized":"2024-09-21T06:46:03.654885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:06.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634148+0000","last_change":"2024-09-21T06:46:03.634148+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634148+0000","last_undegraded":"2024-09-21T06:46:03.634148+0000","last_fullsized":"2024-09-21T06:46:03.634148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630412+0000","last_change":"2024-09-21T06:46:02.630412+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630412+0000","last_undegraded":"2024-09-21T06:46:02.630412+0000","last_fullsized":"2024-09-21T06:46:02.630412+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630318+0000","last_change":"2024-09-21T06:46:02.630318+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630318+0000","last_undegraded":"2024-09-21T06:46:02.630318+0000","last_fullsized":"2024-09-21T06:46:02.630318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.630073+0000","last_change":"2024-09-21T06:46:02.630073+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.630073+0000","last_undegraded":"2024-09-21T06:46:02.630073+0000","last_fullsized":"2024-09-21T06:46:02.630073+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635661+0000","last_change":"2024-09-21T06:46:03.635661+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635661+0000","last_undegraded":"2024-09-21T06:46:03.635661+0000","last_fullsized":"2024-09-21T06:46:03.635661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653673+0000","last_change":"2024-09-21T06:46:03.650829+0000","last_active":"2024-09-21T06:46:03.653673+0000","last_peered":"2024-09-21T06:46:03.653673+0000","last_clean":"2024-09-21T06:46:03.653673+0000","last_became_active":"2024-09-21T06:46:03.650489+0000","last_became_peered":"2024-09-21T06:46:03.650489+0000","last_unstale":"2024-09-21T06:46:03.653673+0000","last_undegraded":"2024-09-21T06:46:03.653673+0000","last_fullsized":"2024-09-21T06:46:03.653673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:02.441436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650055+0000","last_change":"2024-09-21T06:46:03.646551+0000","last_active":"2024-09-21T06:46:03.650055+0000","last_peered":"2024-09-21T06:46:03.650055+0000","last_clean":"2024-09-21T06:46:03.650055+0000","last_became_active":"2024-09-21T06:46:03.646209+0000","last_became_peered":"2024-09-21T06:46:03.646209+0000","last_unstale":"2024-09-21T06:46:03.650055+0000","last_undegraded":"2024-09-21T06:46:03.650055+0000","last_fullsized":"2024-09-21T06:46:03.650055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:24.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649059+0000","last_change":"2024-09-21T06:46:03.643628+0000","last_active":"2024-09-21T06:46:03.649059+0000","last_peered":"2024-09-21T06:46:03.649059+0000","last_clean":"2024-09-21T06:46:03.649059+0000","last_became_active":"2024-09-21T06:46:03.643306+0000","last_became_peered":"2024-09-21T06:46:03.643306+0000","last_unstale":"2024-09-21T06:46:03.649059+0000","last_undegraded":"2024-09-21T06:46:03.649059+0000","last_fullsized":"2024-09-21T06:46:03.649059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:59.156059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634286+0000","last_change":"2024-09-21T06:46:03.634286+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634286+0000","last_undegraded":"2024-09-21T06:46:03.634286+0000","last_fullsized":"2024-09-21T06:46:03.634286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653217+0000","last_change":"2024-09-21T06:46:03.646712+0000","last_active":"2024-09-21T06:46:03.653217+0000","last_peered":"2024-09-21T06:46:03.653217+0000","last_clean":"2024-09-21T06:46:03.653217+0000","last_became_active":"2024-09-21T06:46:03.646413+0000","last_became_peered":"2024-09-21T06:46:03.646413+0000","last_unstale":"2024-09-21T06:46:03.653217+0000","last_undegraded":"2024-09-21T06:46:03.653217+0000","last_fullsized":"2024-09-21T06:46:03.653217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:13.485574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634145+0000","last_change":"2024-09-21T06:46:03.634145+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634145+0000","last_undegraded":"2024-09-21T06:46:03.634145+0000","last_fullsized":"2024-09-21T06:46:03.634145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.627925+0000","last_change":"2024-09-21T06:46:02.627925+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.627925+0000","last_undegraded":"2024-09-21T06:46:02.627925+0000","last_fullsized":"2024-09-21T06:46:02.627925+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.626757+0000","last_change":"2024-09-21T06:46:02.626757+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.626757+0000","last_undegraded":"2024-09-21T06:46:02.626757+0000","last_fullsized":"2024-09-21T06:46:02.626757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640692+0000","last_change":"2024-09-21T06:46:03.640692+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640692+0000","last_undegraded":"2024-09-21T06:46:03.640692+0000","last_fullsized":"2024-09-21T06:46:03.640692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.626766+0000","last_change":"2024-09-21T06:46:02.626766+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.626766+0000","last_undegraded":"2024-09-21T06:46:02.626766+0000","last_fullsized":"2024-09-21T06:46:02.626766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629621+0000","last_change":"2024-09-21T06:46:02.629621+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629621+0000","last_undegraded":"2024-09-21T06:46:02.629621+0000","last_fullsized":"2024-09-21T06:46:02.629621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637092+0000","last_change":"2024-09-21T06:46:03.637092+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637092+0000","last_undegraded":"2024-09-21T06:46:03.637092+0000","last_fullsized":"2024-09-21T06:46:03.637092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.648980+0000","last_change":"2024-09-21T06:46:03.643663+0000","last_active":"2024-09-21T06:46:03.648980+0000","last_peered":"2024-09-21T06:46:03.648980+0000","last_clean":"2024-09-21T06:46:03.648980+0000","last_became_active":"2024-09-21T06:46:03.643355+0000","last_became_peered":"2024-09-21T06:46:03.643355+0000","last_unstale":"2024-09-21T06:46:03.648980+0000","last_undegraded":"2024-09-21T06:46:03.648980+0000","last_fullsized":"2024-09-21T06:46:03.648980+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:40.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629550+0000","last_change":"2024-09-21T06:46:02.629550+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629550+0000","last_undegraded":"2024-09-21T06:46:02.629550+0000","last_fullsized":"2024-09-21T06:46:02.629550+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653732+0000","last_change":"2024-09-21T06:46:03.652711+0000","last_active":"2024-09-21T06:46:03.653732+0000","last_peered":"2024-09-21T06:46:03.653732+0000","last_clean":"2024-09-21T06:46:03.653732+0000","last_became_active":"2024-09-21T06:46:03.652296+0000","last_became_peered":"2024-09-21T06:46:03.652296+0000","last_unstale":"2024-09-21T06:46:03.653732+0000","last_undegraded":"2024-09-21T06:46:03.653732+0000","last_fullsized":"2024-09-21T06:46:03.653732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:46.504084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636335+0000","last_change":"2024-09-21T06:46:03.636335+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636335+0000","last_undegraded":"2024-09-21T06:46:03.636335+0000","last_fullsized":"2024-09-21T06:46:03.636335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.628107+0000","last_change":"2024-09-21T06:46:02.628107+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.628107+0000","last_undegraded":"2024-09-21T06:46:02.628107+0000","last_fullsized":"2024-09-21T06:46:02.628107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.627289+0000","last_change":"2024-09-21T06:46:02.627289+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.627289+0000","last_undegraded":"2024-09-21T06:46:02.627289+0000","last_fullsized":"2024-09-21T06:46:02.627289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629586+0000","last_change":"2024-09-21T06:46:02.629586+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629586+0000","last_undegraded":"2024-09-21T06:46:02.629586+0000","last_fullsized":"2024-09-21T06:46:02.629586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T06:46:03.622420+0000","last_change":"2024-09-21T06:46:03.622420+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.622420+0000","last_undegraded":"2024-09-21T06:46:03.622420+0000","last_fullsized":"2024-09-21T06:46:03.622420+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653629+0000","last_change":"2024-09-21T06:46:03.650579+0000","last_active":"2024-09-21T06:46:03.653629+0000","last_peered":"2024-09-21T06:46:03.653629+0000","last_clean":"2024-09-21T06:46:03.653629+0000","last_became_active":"2024-09-21T06:46:03.650243+0000","last_became_peered":"2024-09-21T06:46:03.650243+0000","last_unstale":"2024-09-21T06:46:03.653629+0000","last_undegraded":"2024-09-21T06:46:03.653629+0000","last_fullsized":"2024-09-21T06:46:03.653629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.738279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640108+0000","last_change":"2024-09-21T06:46:03.640108+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640108+0000","last_undegraded":"2024-09-21T06:46:03.640108+0000","last_fullsized":"2024-09-21T06:46:03.640108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653754+0000","last_change":"2024-09-21T06:46:03.652588+0000","last_active":"2024-09-21T06:46:03.653754+0000","last_peered":"2024-09-21T06:46:03.653754+0000","last_clean":"2024-09-21T06:46:03.653754+0000","last_became_active":"2024-09-21T06:46:03.652237+0000","last_became_peered":"2024-09-21T06:46:03.652237+0000","last_unstale":"2024-09-21T06:46:03.653754+0000","last_undegraded":"2024-09-21T06:46:03.653754+0000","last_fullsized":"2024-09-21T06:46:03.653754+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.139777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634844+0000","last_change":"2024-09-21T06:46:03.634844+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634844+0000","last_undegraded":"2024-09-21T06:46:03.634844+0000","last_fullsized":"2024-09-21T06:46:03.634844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2024-09-21T06:46:02.629532+0000","last_change":"2024-09-21T06:46:02.629532+0000","last_active":"2024-09-21T06:46:02.619118+0000","last_peered":"2024-09-21T06:46:02.619118+0000","last_clean":"2024-09-21T06:46:02.619118+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:02.629532+0000","last_undegraded":"2024-09-21T06:46:02.629532+0000","last_fullsized":"2024-09-21T06:46:02.629532+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643110+0000","last_change":"2024-09-21T06:46:03.643110+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643110+0000","last_undegraded":"2024-09-21T06:46:03.643110+0000","last_fullsized":"2024-09-21T06:46:03.643110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653849+0000","last_change":"2024-09-21T06:46:03.651097+0000","last_active":"2024-09-21T06:46:03.653849+0000","last_peered":"2024-09-21T06:46:03.653849+0000","last_clean":"2024-09-21T06:46:03.653849+0000","last_became_active":"2024-09-21T06:46:03.650544+0000","last_became_peered":"2024-09-21T06:46:03.650544+0000","last_unstale":"2024-09-21T06:46:03.653849+0000","last_undegraded":"2024-09-21T06:46:03.653849+0000","last_fullsized":"2024-09-21T06:46:03.653849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:40.871830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.630375+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:03.630375+0000","last_peered":"2024-09-21T06:46:03.630375+0000","last_clean":"2024-09-21T06:46:03.630375+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:03.630375+0000","last_undegraded":"2024-09-21T06:46:03.630375+0000","last_fullsized":"2024-09-21T06:46:03.630375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":751620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":155043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":974848,"data_stored":745411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":380928,"data_stored":155043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:08.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:08.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.567+0000 7f026318b640 1 -- 172.21.15.81:0/2812232170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0244003a30 msgr2=0x7f0244003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.567+0000 7f026318b640 1 --2- 172.21.15.81:0/2812232170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0244003a30 0x7f0244003ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0258006fc0 tx=0x7f0244005830 comp rx=0 tx=0).stop 2024-09-21T06:46:08.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.567+0000 7f0261728640 1 -- 172.21.15.81:0/2812232170 reap_dead start 2024-09-21T06:46:08.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.567+0000 7f026318b640 1 -- 172.21.15.81:0/2812232170 shutdown_connections 2024-09-21T06:46:08.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.567+0000 7f026318b640 1 -- 172.21.15.81:0/2812232170 >> 172.21.15.81:0/2812232170 conn(0x7f025c0d25e0 msgr2=0x7f025c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:08.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.567+0000 7f026318b640 1 -- 172.21.15.81:0/2812232170 shutdown_connections 2024-09-21T06:46:08.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.567+0000 7f026318b640 1 -- 172.21.15.81:0/2812232170 wait complete. 2024-09-21T06:46:08.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.569+0000 7f026318b640 1 Processor -- start 2024-09-21T06:46:08.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.569+0000 7f026318b640 1 -- start start 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0244003a30 0x7f025c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f025c0c5f20 0x7f025c0b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f025c0c6330 0x7f025c0b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f025c15d850 con 0x7f025c0c5f20 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f025c15d6d0 con 0x7f025c0c6330 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f025c15d9d0 con 0x7f0244003a30 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f025c0c5f20 0x7f025c0b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f025c0c5f20 0x7f025c0b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56706/0 (socket says 172.21.15.81:56706) 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 -- 172.21.15.81:0/2886291550 learned_addr learned my addr 172.21.15.81:0/2886291550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0261728640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f025c0c6330 0x7f025c0b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0260f27640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0244003a30 0x7f025c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 -- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0244003a30 msgr2=0x7f025c14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0244003a30 0x7f025c14c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 -- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f025c0c6330 msgr2=0x7f025c0b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f025c0c6330 0x7f025c0b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 -- 172.21.15.81:0/2886291550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025c1f31f0 con 0x7f025c0c5f20 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f0253fff640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f025c0c5f20 0x7f025c0b7220 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f024c011ae0 tx=0x7f024c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f02517fa640 1 -- 172.21.15.81:0/2886291550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c01e070 con 0x7f025c0c5f20 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f02517fa640 1 -- 172.21.15.81:0/2886291550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f024c00fe70 con 0x7f025c0c5f20 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025c1f36e0 con 0x7f025c0c5f20 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f02517fa640 1 -- 172.21.15.81:0/2886291550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c004290 con 0x7f025c0c5f20 2024-09-21T06:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.571+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025c1f3ca0 con 0x7f025c0c5f20 2024-09-21T06:46:08.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.572+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f025c1f3430 con 0x7f025c0c5f20 2024-09-21T06:46:08.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.573+0000 7f02517fa640 1 -- 172.21.15.81:0/2886291550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f024c021070 con 0x7f025c0c5f20 2024-09-21T06:46:08.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.574+0000 7f02517fa640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0248078b90 0x7f024807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.574+0000 7f02517fa640 1 -- 172.21.15.81:0/2886291550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f024c09b820 con 0x7f025c0c5f20 2024-09-21T06:46:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.574+0000 7f0260f27640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0248078b90 0x7f024807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.574+0000 7f0260f27640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0248078b90 0x7f024807b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0258033000 tx=0x7f0258038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.578+0000 7f02517fa640 1 -- 172.21.15.81:0/2886291550 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f024c063540 con 0x7f025c0c5f20 2024-09-21T06:46:08.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.751+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f025c1602a0 con 0x7f0248078b90 2024-09-21T06:46:08.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.756+0000 7f02517fa640 1 -- 172.21.15.81:0/2886291550 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249147 (secure 0 0 0) 0x7f025c1602a0 con 0x7f0248078b90 2024-09-21T06:46:08.760 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0248078b90 msgr2=0x7f024807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0248078b90 0x7f024807b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0258033000 tx=0x7f0258038040 comp rx=0 tx=0).stop 2024-09-21T06:46:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f025c0c5f20 msgr2=0x7f025c0b7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f025c0c5f20 0x7f025c0b7220 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f024c011ae0 tx=0x7f024c009e90 comp rx=0 tx=0).stop 2024-09-21T06:46:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 shutdown_connections 2024-09-21T06:46:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0248078b90 0x7f024807b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f025c0c6330 0x7f025c0b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f025c0c5f20 0x7f025c0b7220 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 --2- 172.21.15.81:0/2886291550 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0244003a30 0x7f025c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 >> 172.21.15.81:0/2886291550 conn(0x7f025c0d25e0 msgr2=0x7f025c15c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 shutdown_connections 2024-09-21T06:46:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.759+0000 7f026318b640 1 -- 172.21.15.81:0/2886291550 wait complete. 2024-09-21T06:46:08.772 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-21T06:46:08.664308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220644,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754076,"statfs":{"total":773094113280,"available":772868173824,"internally_reserved":0,"allocated":4513792,"data_stored":2555278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001338"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651937+0000","last_change":"2024-09-21T06:46:04.653828+0000","last_active":"2024-09-21T06:46:05.651937+0000","last_peered":"2024-09-21T06:46:05.651937+0000","last_clean":"2024-09-21T06:46:05.651937+0000","last_became_active":"2024-09-21T06:46:04.653509+0000","last_became_peered":"2024-09-21T06:46:04.653509+0000","last_unstale":"2024-09-21T06:46:05.651937+0000","last_undegraded":"2024-09-21T06:46:05.651937+0000","last_fullsized":"2024-09-21T06:46:05.651937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:22.157120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021625+0000","last_change":"2024-09-21T06:46:04.661867+0000","last_active":"2024-09-21T06:46:06.021625+0000","last_peered":"2024-09-21T06:46:06.021625+0000","last_clean":"2024-09-21T06:46:06.021625+0000","last_became_active":"2024-09-21T06:46:04.661351+0000","last_became_peered":"2024-09-21T06:46:04.661351+0000","last_unstale":"2024-09-21T06:46:06.021625+0000","last_undegraded":"2024-09-21T06:46:06.021625+0000","last_fullsized":"2024-09-21T06:46:06.021625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:11.727185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652680+0000","last_change":"2024-09-21T06:46:04.663927+0000","last_active":"2024-09-21T06:46:05.652680+0000","last_peered":"2024-09-21T06:46:05.652680+0000","last_clean":"2024-09-21T06:46:05.652680+0000","last_became_active":"2024-09-21T06:46:04.663604+0000","last_became_peered":"2024-09-21T06:46:04.663604+0000","last_unstale":"2024-09-21T06:46:05.652680+0000","last_undegraded":"2024-09-21T06:46:05.652680+0000","last_fullsized":"2024-09-21T06:46:05.652680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:16.103507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652632+0000","last_change":"2024-09-21T06:46:04.660353+0000","last_active":"2024-09-21T06:46:05.652632+0000","last_peered":"2024-09-21T06:46:05.652632+0000","last_clean":"2024-09-21T06:46:05.652632+0000","last_became_active":"2024-09-21T06:46:04.660017+0000","last_became_peered":"2024-09-21T06:46:04.660017+0000","last_unstale":"2024-09-21T06:46:05.652632+0000","last_undegraded":"2024-09-21T06:46:05.652632+0000","last_fullsized":"2024-09-21T06:46:05.652632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:58.086168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021623+0000","last_change":"2024-09-21T06:46:04.648697+0000","last_active":"2024-09-21T06:46:06.021623+0000","last_peered":"2024-09-21T06:46:06.021623+0000","last_clean":"2024-09-21T06:46:06.021623+0000","last_became_active":"2024-09-21T06:46:04.648378+0000","last_became_peered":"2024-09-21T06:46:04.648378+0000","last_unstale":"2024-09-21T06:46:06.021623+0000","last_undegraded":"2024-09-21T06:46:06.021623+0000","last_fullsized":"2024-09-21T06:46:06.021623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:27.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022222+0000","last_change":"2024-09-21T06:46:04.661899+0000","last_active":"2024-09-21T06:46:06.022222+0000","last_peered":"2024-09-21T06:46:06.022222+0000","last_clean":"2024-09-21T06:46:06.022222+0000","last_became_active":"2024-09-21T06:46:04.661469+0000","last_became_peered":"2024-09-21T06:46:04.661469+0000","last_unstale":"2024-09-21T06:46:06.022222+0000","last_undegraded":"2024-09-21T06:46:06.022222+0000","last_fullsized":"2024-09-21T06:46:06.022222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:15.051574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638055+0000","last_change":"2024-09-21T06:46:03.638055+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638055+0000","last_undegraded":"2024-09-21T06:46:03.638055+0000","last_fullsized":"2024-09-21T06:46:03.638055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652150+0000","last_change":"2024-09-21T06:46:04.667034+0000","last_active":"2024-09-21T06:46:05.652150+0000","last_peered":"2024-09-21T06:46:05.652150+0000","last_clean":"2024-09-21T06:46:05.652150+0000","last_became_active":"2024-09-21T06:46:04.666723+0000","last_became_peered":"2024-09-21T06:46:04.666723+0000","last_unstale":"2024-09-21T06:46:05.652150+0000","last_undegraded":"2024-09-21T06:46:05.652150+0000","last_fullsized":"2024-09-21T06:46:05.652150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.904136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021812+0000","last_change":"2024-09-21T06:46:04.654275+0000","last_active":"2024-09-21T06:46:06.021812+0000","last_peered":"2024-09-21T06:46:06.021812+0000","last_clean":"2024-09-21T06:46:06.021812+0000","last_became_active":"2024-09-21T06:46:04.653913+0000","last_became_peered":"2024-09-21T06:46:04.653913+0000","last_unstale":"2024-09-21T06:46:06.021812+0000","last_undegraded":"2024-09-21T06:46:06.021812+0000","last_fullsized":"2024-09-21T06:46:06.021812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:02.434425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637277+0000","last_change":"2024-09-21T06:46:03.637277+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637277+0000","last_undegraded":"2024-09-21T06:46:03.637277+0000","last_fullsized":"2024-09-21T06:46:03.637277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636790+0000","last_change":"2024-09-21T06:46:03.636790+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636790+0000","last_undegraded":"2024-09-21T06:46:03.636790+0000","last_fullsized":"2024-09-21T06:46:03.636790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021385+0000","last_change":"2024-09-21T06:46:04.659857+0000","last_active":"2024-09-21T06:46:06.021385+0000","last_peered":"2024-09-21T06:46:06.021385+0000","last_clean":"2024-09-21T06:46:06.021385+0000","last_became_active":"2024-09-21T06:46:04.659546+0000","last_became_peered":"2024-09-21T06:46:04.659546+0000","last_unstale":"2024-09-21T06:46:06.021385+0000","last_undegraded":"2024-09-21T06:46:06.021385+0000","last_fullsized":"2024-09-21T06:46:06.021385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:28.070646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636460+0000","last_change":"2024-09-21T06:46:03.636460+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636460+0000","last_undegraded":"2024-09-21T06:46:03.636460+0000","last_fullsized":"2024-09-21T06:46:03.636460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634514+0000","last_change":"2024-09-21T06:46:03.634514+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634514+0000","last_undegraded":"2024-09-21T06:46:03.634514+0000","last_fullsized":"2024-09-21T06:46:03.634514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642365+0000","last_change":"2024-09-21T06:46:03.642365+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642365+0000","last_undegraded":"2024-09-21T06:46:03.642365+0000","last_fullsized":"2024-09-21T06:46:03.642365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636642+0000","last_change":"2024-09-21T06:46:03.636642+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636642+0000","last_undegraded":"2024-09-21T06:46:03.636642+0000","last_fullsized":"2024-09-21T06:46:03.636642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642255+0000","last_change":"2024-09-21T06:46:03.642255+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642255+0000","last_undegraded":"2024-09-21T06:46:03.642255+0000","last_fullsized":"2024-09-21T06:46:03.642255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638858+0000","last_change":"2024-09-21T06:46:03.638858+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638858+0000","last_undegraded":"2024-09-21T06:46:03.638858+0000","last_fullsized":"2024-09-21T06:46:03.638858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651166+0000","last_change":"2024-09-21T06:46:04.658383+0000","last_active":"2024-09-21T06:46:05.651166+0000","last_peered":"2024-09-21T06:46:05.651166+0000","last_clean":"2024-09-21T06:46:05.651166+0000","last_became_active":"2024-09-21T06:46:04.657091+0000","last_became_peered":"2024-09-21T06:46:04.657091+0000","last_unstale":"2024-09-21T06:46:05.651166+0000","last_undegraded":"2024-09-21T06:46:05.651166+0000","last_fullsized":"2024-09-21T06:46:05.651166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.983526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635005+0000","last_change":"2024-09-21T06:46:03.635005+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635005+0000","last_undegraded":"2024-09-21T06:46:03.635005+0000","last_fullsized":"2024-09-21T06:46:03.635005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635377+0000","last_change":"2024-09-21T06:46:03.635377+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635377+0000","last_undegraded":"2024-09-21T06:46:03.635377+0000","last_fullsized":"2024-09-21T06:46:03.635377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637584+0000","last_change":"2024-09-21T06:46:03.637584+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637584+0000","last_undegraded":"2024-09-21T06:46:03.637584+0000","last_fullsized":"2024-09-21T06:46:03.637584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.641884+0000","last_change":"2024-09-21T06:46:03.641884+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.641884+0000","last_undegraded":"2024-09-21T06:46:03.641884+0000","last_fullsized":"2024-09-21T06:46:03.641884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652114+0000","last_change":"2024-09-21T06:46:04.658260+0000","last_active":"2024-09-21T06:46:05.652114+0000","last_peered":"2024-09-21T06:46:05.652114+0000","last_clean":"2024-09-21T06:46:05.652114+0000","last_became_active":"2024-09-21T06:46:04.657919+0000","last_became_peered":"2024-09-21T06:46:04.657919+0000","last_unstale":"2024-09-21T06:46:05.652114+0000","last_undegraded":"2024-09-21T06:46:05.652114+0000","last_fullsized":"2024-09-21T06:46:05.652114+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:29.074983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640337+0000","last_change":"2024-09-21T06:46:03.640337+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640337+0000","last_undegraded":"2024-09-21T06:46:03.640337+0000","last_fullsized":"2024-09-21T06:46:03.640337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651964+0000","last_change":"2024-09-21T06:46:04.654047+0000","last_active":"2024-09-21T06:46:05.651964+0000","last_peered":"2024-09-21T06:46:05.651964+0000","last_clean":"2024-09-21T06:46:05.651964+0000","last_became_active":"2024-09-21T06:46:04.653726+0000","last_became_peered":"2024-09-21T06:46:04.653726+0000","last_unstale":"2024-09-21T06:46:05.651964+0000","last_undegraded":"2024-09-21T06:46:05.651964+0000","last_fullsized":"2024-09-21T06:46:05.651964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:24.218374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635863+0000","last_change":"2024-09-21T06:46:03.635863+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635863+0000","last_undegraded":"2024-09-21T06:46:03.635863+0000","last_fullsized":"2024-09-21T06:46:03.635863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634263+0000","last_change":"2024-09-21T06:46:03.634263+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634263+0000","last_undegraded":"2024-09-21T06:46:03.634263+0000","last_fullsized":"2024-09-21T06:46:03.634263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.639647+0000","last_change":"2024-09-21T06:46:03.639647+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.639647+0000","last_undegraded":"2024-09-21T06:46:03.639647+0000","last_fullsized":"2024-09-21T06:46:03.639647+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643531+0000","last_change":"2024-09-21T06:46:03.643531+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643531+0000","last_undegraded":"2024-09-21T06:46:03.643531+0000","last_fullsized":"2024-09-21T06:46:03.643531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634481+0000","last_change":"2024-09-21T06:46:03.634481+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634481+0000","last_undegraded":"2024-09-21T06:46:03.634481+0000","last_fullsized":"2024-09-21T06:46:03.634481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652372+0000","last_change":"2024-09-21T06:46:04.663746+0000","last_active":"2024-09-21T06:46:05.652372+0000","last_peered":"2024-09-21T06:46:05.652372+0000","last_clean":"2024-09-21T06:46:05.652372+0000","last_became_active":"2024-09-21T06:46:04.663442+0000","last_became_peered":"2024-09-21T06:46:04.663442+0000","last_unstale":"2024-09-21T06:46:05.652372+0000","last_undegraded":"2024-09-21T06:46:05.652372+0000","last_fullsized":"2024-09-21T06:46:05.652372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:34.082130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637166+0000","last_change":"2024-09-21T06:46:03.637166+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637166+0000","last_undegraded":"2024-09-21T06:46:03.637166+0000","last_fullsized":"2024-09-21T06:46:03.637166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649978+0000","last_change":"2024-09-21T06:46:03.647271+0000","last_active":"2024-09-21T06:46:03.649978+0000","last_peered":"2024-09-21T06:46:03.649978+0000","last_clean":"2024-09-21T06:46:03.649978+0000","last_became_active":"2024-09-21T06:46:03.646987+0000","last_became_peered":"2024-09-21T06:46:03.646987+0000","last_unstale":"2024-09-21T06:46:03.649978+0000","last_undegraded":"2024-09-21T06:46:03.649978+0000","last_fullsized":"2024-09-21T06:46:03.649978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:19.498283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021604+0000","last_change":"2024-09-21T06:46:04.660925+0000","last_active":"2024-09-21T06:46:06.021604+0000","last_peered":"2024-09-21T06:46:06.021604+0000","last_clean":"2024-09-21T06:46:06.021604+0000","last_became_active":"2024-09-21T06:46:04.660586+0000","last_became_peered":"2024-09-21T06:46:04.660586+0000","last_unstale":"2024-09-21T06:46:06.021604+0000","last_undegraded":"2024-09-21T06:46:06.021604+0000","last_fullsized":"2024-09-21T06:46:06.021604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:26.073993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021594+0000","last_change":"2024-09-21T06:46:03.653877+0000","last_active":"2024-09-21T06:46:06.021594+0000","last_peered":"2024-09-21T06:46:06.021594+0000","last_clean":"2024-09-21T06:46:06.021594+0000","last_became_active":"2024-09-21T06:46:03.653554+0000","last_became_peered":"2024-09-21T06:46:03.653554+0000","last_unstale":"2024-09-21T06:46:06.021594+0000","last_undegraded":"2024-09-21T06:46:06.021594+0000","last_fullsized":"2024-09-21T06:46:06.021594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:23.469489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638060+0000","last_change":"2024-09-21T06:46:03.638060+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638060+0000","last_undegraded":"2024-09-21T06:46:03.638060+0000","last_fullsized":"2024-09-21T06:46:03.638060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652631+0000","last_change":"2024-09-21T06:46:03.648247+0000","last_active":"2024-09-21T06:46:05.652631+0000","last_peered":"2024-09-21T06:46:05.652631+0000","last_clean":"2024-09-21T06:46:05.652631+0000","last_became_active":"2024-09-21T06:46:03.647153+0000","last_became_peered":"2024-09-21T06:46:03.647153+0000","last_unstale":"2024-09-21T06:46:05.652631+0000","last_undegraded":"2024-09-21T06:46:05.652631+0000","last_fullsized":"2024-09-21T06:46:05.652631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:16.140311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022143+0000","last_change":"2024-09-21T06:46:04.662876+0000","last_active":"2024-09-21T06:46:06.022143+0000","last_peered":"2024-09-21T06:46:06.022143+0000","last_clean":"2024-09-21T06:46:06.022143+0000","last_became_active":"2024-09-21T06:46:04.662576+0000","last_became_peered":"2024-09-21T06:46:04.662576+0000","last_unstale":"2024-09-21T06:46:06.022143+0000","last_undegraded":"2024-09-21T06:46:06.022143+0000","last_fullsized":"2024-09-21T06:46:06.022143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:32.493240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650018+0000","last_change":"2024-09-21T06:46:03.644181+0000","last_active":"2024-09-21T06:46:03.650018+0000","last_peered":"2024-09-21T06:46:03.650018+0000","last_clean":"2024-09-21T06:46:03.650018+0000","last_became_active":"2024-09-21T06:46:03.643878+0000","last_became_peered":"2024-09-21T06:46:03.643878+0000","last_unstale":"2024-09-21T06:46:03.650018+0000","last_undegraded":"2024-09-21T06:46:03.650018+0000","last_fullsized":"2024-09-21T06:46:03.650018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:52.886598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652393+0000","last_change":"2024-09-21T06:46:04.654929+0000","last_active":"2024-09-21T06:46:05.652393+0000","last_peered":"2024-09-21T06:46:05.652393+0000","last_clean":"2024-09-21T06:46:05.652393+0000","last_became_active":"2024-09-21T06:46:04.654243+0000","last_became_peered":"2024-09-21T06:46:04.654243+0000","last_unstale":"2024-09-21T06:46:05.652393+0000","last_undegraded":"2024-09-21T06:46:05.652393+0000","last_fullsized":"2024-09-21T06:46:05.652393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:18.804337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649465+0000","last_change":"2024-09-21T06:46:03.641222+0000","last_active":"2024-09-21T06:46:03.649465+0000","last_peered":"2024-09-21T06:46:03.649465+0000","last_clean":"2024-09-21T06:46:03.649465+0000","last_became_active":"2024-09-21T06:46:03.640868+0000","last_became_peered":"2024-09-21T06:46:03.640868+0000","last_unstale":"2024-09-21T06:46:03.649465+0000","last_undegraded":"2024-09-21T06:46:03.649465+0000","last_fullsized":"2024-09-21T06:46:03.649465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:43.128820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637875+0000","last_change":"2024-09-21T06:46:03.637875+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637875+0000","last_undegraded":"2024-09-21T06:46:03.637875+0000","last_fullsized":"2024-09-21T06:46:03.637875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.651433+0000","last_change":"2024-09-21T06:46:03.646346+0000","last_active":"2024-09-21T06:46:03.651433+0000","last_peered":"2024-09-21T06:46:03.651433+0000","last_clean":"2024-09-21T06:46:03.651433+0000","last_became_active":"2024-09-21T06:46:03.645110+0000","last_became_peered":"2024-09-21T06:46:03.645110+0000","last_unstale":"2024-09-21T06:46:03.651433+0000","last_undegraded":"2024-09-21T06:46:03.651433+0000","last_fullsized":"2024-09-21T06:46:03.651433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643077+0000","last_change":"2024-09-21T06:46:03.643077+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643077+0000","last_undegraded":"2024-09-21T06:46:03.643077+0000","last_fullsized":"2024-09-21T06:46:03.643077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651641+0000","last_change":"2024-09-21T06:46:03.653821+0000","last_active":"2024-09-21T06:46:05.651641+0000","last_peered":"2024-09-21T06:46:05.651641+0000","last_clean":"2024-09-21T06:46:05.651641+0000","last_became_active":"2024-09-21T06:46:03.653466+0000","last_became_peered":"2024-09-21T06:46:03.653466+0000","last_unstale":"2024-09-21T06:46:05.651641+0000","last_undegraded":"2024-09-21T06:46:05.651641+0000","last_fullsized":"2024-09-21T06:46:05.651641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:06.669384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022050+0000","last_change":"2024-09-21T06:46:04.658674+0000","last_active":"2024-09-21T06:46:06.022050+0000","last_peered":"2024-09-21T06:46:06.022050+0000","last_clean":"2024-09-21T06:46:06.022050+0000","last_became_active":"2024-09-21T06:46:04.658375+0000","last_became_peered":"2024-09-21T06:46:04.658375+0000","last_unstale":"2024-09-21T06:46:06.022050+0000","last_undegraded":"2024-09-21T06:46:06.022050+0000","last_fullsized":"2024-09-21T06:46:06.022050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:18.162094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.644028+0000","last_change":"2024-09-21T06:46:03.639925+0000","last_active":"2024-09-21T06:46:03.644028+0000","last_peered":"2024-09-21T06:46:03.644028+0000","last_clean":"2024-09-21T06:46:03.644028+0000","last_became_active":"2024-09-21T06:46:03.639624+0000","last_became_peered":"2024-09-21T06:46:03.639624+0000","last_unstale":"2024-09-21T06:46:03.644028+0000","last_undegraded":"2024-09-21T06:46:03.644028+0000","last_fullsized":"2024-09-21T06:46:03.644028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:08.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652525+0000","last_change":"2024-09-21T06:46:04.657543+0000","last_active":"2024-09-21T06:46:05.652525+0000","last_peered":"2024-09-21T06:46:05.652525+0000","last_clean":"2024-09-21T06:46:05.652525+0000","last_became_active":"2024-09-21T06:46:04.656454+0000","last_became_peered":"2024-09-21T06:46:04.656454+0000","last_unstale":"2024-09-21T06:46:05.652525+0000","last_undegraded":"2024-09-21T06:46:05.652525+0000","last_fullsized":"2024-09-21T06:46:05.652525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.287462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652046+0000","last_change":"2024-09-21T06:46:03.643897+0000","last_active":"2024-09-21T06:46:05.652046+0000","last_peered":"2024-09-21T06:46:05.652046+0000","last_clean":"2024-09-21T06:46:05.652046+0000","last_became_active":"2024-09-21T06:46:03.642845+0000","last_became_peered":"2024-09-21T06:46:03.642845+0000","last_unstale":"2024-09-21T06:46:05.652046+0000","last_undegraded":"2024-09-21T06:46:05.652046+0000","last_fullsized":"2024-09-21T06:46:05.652046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:57.330223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636360+0000","last_change":"2024-09-21T06:46:03.636360+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636360+0000","last_undegraded":"2024-09-21T06:46:03.636360+0000","last_fullsized":"2024-09-21T06:46:03.636360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653246+0000","last_change":"2024-09-21T06:46:03.647428+0000","last_active":"2024-09-21T06:46:03.653246+0000","last_peered":"2024-09-21T06:46:03.653246+0000","last_clean":"2024-09-21T06:46:03.653246+0000","last_became_active":"2024-09-21T06:46:03.647141+0000","last_became_peered":"2024-09-21T06:46:03.647141+0000","last_unstale":"2024-09-21T06:46:03.653246+0000","last_undegraded":"2024-09-21T06:46:03.653246+0000","last_fullsized":"2024-09-21T06:46:03.653246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:25.124073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652036+0000","last_change":"2024-09-21T06:46:04.654222+0000","last_active":"2024-09-21T06:46:05.652036+0000","last_peered":"2024-09-21T06:46:05.652036+0000","last_clean":"2024-09-21T06:46:05.652036+0000","last_became_active":"2024-09-21T06:46:04.653337+0000","last_became_peered":"2024-09-21T06:46:04.653337+0000","last_unstale":"2024-09-21T06:46:05.652036+0000","last_undegraded":"2024-09-21T06:46:05.652036+0000","last_fullsized":"2024-09-21T06:46:05.652036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:00.246624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.654885+0000","last_change":"2024-09-21T06:46:03.652929+0000","last_active":"2024-09-21T06:46:03.654885+0000","last_peered":"2024-09-21T06:46:03.654885+0000","last_clean":"2024-09-21T06:46:03.654885+0000","last_became_active":"2024-09-21T06:46:03.652578+0000","last_became_peered":"2024-09-21T06:46:03.652578+0000","last_unstale":"2024-09-21T06:46:03.654885+0000","last_undegraded":"2024-09-21T06:46:03.654885+0000","last_fullsized":"2024-09-21T06:46:03.654885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:06.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634148+0000","last_change":"2024-09-21T06:46:03.634148+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634148+0000","last_undegraded":"2024-09-21T06:46:03.634148+0000","last_fullsized":"2024-09-21T06:46:03.634148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652605+0000","last_change":"2024-09-21T06:46:03.645602+0000","last_active":"2024-09-21T06:46:05.652605+0000","last_peered":"2024-09-21T06:46:05.652605+0000","last_clean":"2024-09-21T06:46:05.652605+0000","last_became_active":"2024-09-21T06:46:03.645130+0000","last_became_peered":"2024-09-21T06:46:03.645130+0000","last_unstale":"2024-09-21T06:46:05.652605+0000","last_undegraded":"2024-09-21T06:46:05.652605+0000","last_fullsized":"2024-09-21T06:46:05.652605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:25.387037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652654+0000","last_change":"2024-09-21T06:46:04.659242+0000","last_active":"2024-09-21T06:46:05.652654+0000","last_peered":"2024-09-21T06:46:05.652654+0000","last_clean":"2024-09-21T06:46:05.652654+0000","last_became_active":"2024-09-21T06:46:04.657419+0000","last_became_peered":"2024-09-21T06:46:04.657419+0000","last_unstale":"2024-09-21T06:46:05.652654+0000","last_undegraded":"2024-09-21T06:46:05.652654+0000","last_fullsized":"2024-09-21T06:46:05.652654+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:18.015872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651737+0000","last_change":"2024-09-21T06:46:03.649916+0000","last_active":"2024-09-21T06:46:05.651737+0000","last_peered":"2024-09-21T06:46:05.651737+0000","last_clean":"2024-09-21T06:46:05.651737+0000","last_became_active":"2024-09-21T06:46:03.649612+0000","last_became_peered":"2024-09-21T06:46:03.649612+0000","last_unstale":"2024-09-21T06:46:05.651737+0000","last_undegraded":"2024-09-21T06:46:05.651737+0000","last_fullsized":"2024-09-21T06:46:05.651737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:10.350057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022147+0000","last_change":"2024-09-21T06:46:04.659602+0000","last_active":"2024-09-21T06:46:06.022147+0000","last_peered":"2024-09-21T06:46:06.022147+0000","last_clean":"2024-09-21T06:46:06.022147+0000","last_became_active":"2024-09-21T06:46:04.659302+0000","last_became_peered":"2024-09-21T06:46:04.659302+0000","last_unstale":"2024-09-21T06:46:06.022147+0000","last_undegraded":"2024-09-21T06:46:06.022147+0000","last_fullsized":"2024-09-21T06:46:06.022147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:42.004616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022075+0000","last_change":"2024-09-21T06:46:03.652325+0000","last_active":"2024-09-21T06:46:06.022075+0000","last_peered":"2024-09-21T06:46:06.022075+0000","last_clean":"2024-09-21T06:46:06.022075+0000","last_became_active":"2024-09-21T06:46:03.651992+0000","last_became_peered":"2024-09-21T06:46:03.651992+0000","last_unstale":"2024-09-21T06:46:06.022075+0000","last_undegraded":"2024-09-21T06:46:06.022075+0000","last_fullsized":"2024-09-21T06:46:06.022075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.054085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635661+0000","last_change":"2024-09-21T06:46:03.635661+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635661+0000","last_undegraded":"2024-09-21T06:46:03.635661+0000","last_fullsized":"2024-09-21T06:46:03.635661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653673+0000","last_change":"2024-09-21T06:46:03.650829+0000","last_active":"2024-09-21T06:46:03.653673+0000","last_peered":"2024-09-21T06:46:03.653673+0000","last_clean":"2024-09-21T06:46:03.653673+0000","last_became_active":"2024-09-21T06:46:03.650489+0000","last_became_peered":"2024-09-21T06:46:03.650489+0000","last_unstale":"2024-09-21T06:46:03.653673+0000","last_undegraded":"2024-09-21T06:46:03.653673+0000","last_fullsized":"2024-09-21T06:46:03.653673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:02.441436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021401+0000","last_change":"2024-09-21T06:46:04.663113+0000","last_active":"2024-09-21T06:46:06.021401+0000","last_peered":"2024-09-21T06:46:06.021401+0000","last_clean":"2024-09-21T06:46:06.021401+0000","last_became_active":"2024-09-21T06:46:04.662781+0000","last_became_peered":"2024-09-21T06:46:04.662781+0000","last_unstale":"2024-09-21T06:46:06.021401+0000","last_undegraded":"2024-09-21T06:46:06.021401+0000","last_fullsized":"2024-09-21T06:46:06.021401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:32.289889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650055+0000","last_change":"2024-09-21T06:46:03.646551+0000","last_active":"2024-09-21T06:46:03.650055+0000","last_peered":"2024-09-21T06:46:03.650055+0000","last_clean":"2024-09-21T06:46:03.650055+0000","last_became_active":"2024-09-21T06:46:03.646209+0000","last_became_peered":"2024-09-21T06:46:03.646209+0000","last_unstale":"2024-09-21T06:46:03.650055+0000","last_undegraded":"2024-09-21T06:46:03.650055+0000","last_fullsized":"2024-09-21T06:46:03.650055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:24.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022399+0000","last_change":"2024-09-21T06:46:04.658778+0000","last_active":"2024-09-21T06:46:06.022399+0000","last_peered":"2024-09-21T06:46:06.022399+0000","last_clean":"2024-09-21T06:46:06.022399+0000","last_became_active":"2024-09-21T06:46:04.658327+0000","last_became_peered":"2024-09-21T06:46:04.658327+0000","last_unstale":"2024-09-21T06:46:06.022399+0000","last_undegraded":"2024-09-21T06:46:06.022399+0000","last_fullsized":"2024-09-21T06:46:06.022399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:47.909007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649059+0000","last_change":"2024-09-21T06:46:03.643628+0000","last_active":"2024-09-21T06:46:03.649059+0000","last_peered":"2024-09-21T06:46:03.649059+0000","last_clean":"2024-09-21T06:46:03.649059+0000","last_became_active":"2024-09-21T06:46:03.643306+0000","last_became_peered":"2024-09-21T06:46:03.643306+0000","last_unstale":"2024-09-21T06:46:03.649059+0000","last_undegraded":"2024-09-21T06:46:03.649059+0000","last_fullsized":"2024-09-21T06:46:03.649059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:59.156059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634286+0000","last_change":"2024-09-21T06:46:03.634286+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634286+0000","last_undegraded":"2024-09-21T06:46:03.634286+0000","last_fullsized":"2024-09-21T06:46:03.634286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653217+0000","last_change":"2024-09-21T06:46:03.646712+0000","last_active":"2024-09-21T06:46:03.653217+0000","last_peered":"2024-09-21T06:46:03.653217+0000","last_clean":"2024-09-21T06:46:03.653217+0000","last_became_active":"2024-09-21T06:46:03.646413+0000","last_became_peered":"2024-09-21T06:46:03.646413+0000","last_unstale":"2024-09-21T06:46:03.653217+0000","last_undegraded":"2024-09-21T06:46:03.653217+0000","last_fullsized":"2024-09-21T06:46:03.653217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:13.485574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634145+0000","last_change":"2024-09-21T06:46:03.634145+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634145+0000","last_undegraded":"2024-09-21T06:46:03.634145+0000","last_fullsized":"2024-09-21T06:46:03.634145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021694+0000","last_change":"2024-09-21T06:46:03.651000+0000","last_active":"2024-09-21T06:46:06.021694+0000","last_peered":"2024-09-21T06:46:06.021694+0000","last_clean":"2024-09-21T06:46:06.021694+0000","last_became_active":"2024-09-21T06:46:03.650667+0000","last_became_peered":"2024-09-21T06:46:03.650667+0000","last_unstale":"2024-09-21T06:46:06.021694+0000","last_undegraded":"2024-09-21T06:46:06.021694+0000","last_fullsized":"2024-09-21T06:46:06.021694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:57.914977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651472+0000","last_change":"2024-09-21T06:46:04.655207+0000","last_active":"2024-09-21T06:46:05.651472+0000","last_peered":"2024-09-21T06:46:05.651472+0000","last_clean":"2024-09-21T06:46:05.651472+0000","last_became_active":"2024-09-21T06:46:04.654864+0000","last_became_peered":"2024-09-21T06:46:04.654864+0000","last_unstale":"2024-09-21T06:46:05.651472+0000","last_undegraded":"2024-09-21T06:46:05.651472+0000","last_fullsized":"2024-09-21T06:46:05.651472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:41.749439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.650828+0000","last_change":"2024-09-21T06:46:03.641140+0000","last_active":"2024-09-21T06:46:05.650828+0000","last_peered":"2024-09-21T06:46:05.650828+0000","last_clean":"2024-09-21T06:46:05.650828+0000","last_became_active":"2024-09-21T06:46:03.640811+0000","last_became_peered":"2024-09-21T06:46:03.640811+0000","last_unstale":"2024-09-21T06:46:05.650828+0000","last_undegraded":"2024-09-21T06:46:05.650828+0000","last_fullsized":"2024-09-21T06:46:05.650828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:18.235509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640692+0000","last_change":"2024-09-21T06:46:03.640692+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640692+0000","last_undegraded":"2024-09-21T06:46:03.640692+0000","last_fullsized":"2024-09-21T06:46:03.640692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651028+0000","last_change":"2024-09-21T06:46:03.640499+0000","last_active":"2024-09-21T06:46:05.651028+0000","last_peered":"2024-09-21T06:46:05.651028+0000","last_clean":"2024-09-21T06:46:05.651028+0000","last_became_active":"2024-09-21T06:46:03.640205+0000","last_became_peered":"2024-09-21T06:46:03.640205+0000","last_unstale":"2024-09-21T06:46:05.651028+0000","last_undegraded":"2024-09-21T06:46:05.651028+0000","last_fullsized":"2024-09-21T06:46:05.651028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:34.540855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651938+0000","last_change":"2024-09-21T06:46:04.667436+0000","last_active":"2024-09-21T06:46:05.651938+0000","last_peered":"2024-09-21T06:46:05.651938+0000","last_clean":"2024-09-21T06:46:05.651938+0000","last_became_active":"2024-09-21T06:46:04.667136+0000","last_became_peered":"2024-09-21T06:46:04.667136+0000","last_unstale":"2024-09-21T06:46:05.651938+0000","last_undegraded":"2024-09-21T06:46:05.651938+0000","last_fullsized":"2024-09-21T06:46:05.651938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:55.347574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022157+0000","last_change":"2024-09-21T06:46:03.650652+0000","last_active":"2024-09-21T06:46:06.022157+0000","last_peered":"2024-09-21T06:46:06.022157+0000","last_clean":"2024-09-21T06:46:06.022157+0000","last_became_active":"2024-09-21T06:46:03.650301+0000","last_became_peered":"2024-09-21T06:46:03.650301+0000","last_unstale":"2024-09-21T06:46:06.022157+0000","last_undegraded":"2024-09-21T06:46:06.022157+0000","last_fullsized":"2024-09-21T06:46:06.022157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:15.761508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637092+0000","last_change":"2024-09-21T06:46:03.637092+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637092+0000","last_undegraded":"2024-09-21T06:46:03.637092+0000","last_fullsized":"2024-09-21T06:46:03.637092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.648980+0000","last_change":"2024-09-21T06:46:03.643663+0000","last_active":"2024-09-21T06:46:03.648980+0000","last_peered":"2024-09-21T06:46:03.648980+0000","last_clean":"2024-09-21T06:46:03.648980+0000","last_became_active":"2024-09-21T06:46:03.643355+0000","last_became_peered":"2024-09-21T06:46:03.643355+0000","last_unstale":"2024-09-21T06:46:03.648980+0000","last_undegraded":"2024-09-21T06:46:03.648980+0000","last_fullsized":"2024-09-21T06:46:03.648980+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:40.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651882+0000","last_change":"2024-09-21T06:46:04.666300+0000","last_active":"2024-09-21T06:46:05.651882+0000","last_peered":"2024-09-21T06:46:05.651882+0000","last_clean":"2024-09-21T06:46:05.651882+0000","last_became_active":"2024-09-21T06:46:04.665888+0000","last_became_peered":"2024-09-21T06:46:04.665888+0000","last_unstale":"2024-09-21T06:46:05.651882+0000","last_undegraded":"2024-09-21T06:46:05.651882+0000","last_fullsized":"2024-09-21T06:46:05.651882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:10.919709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021264+0000","last_change":"2024-09-21T06:46:03.648142+0000","last_active":"2024-09-21T06:46:06.021264+0000","last_peered":"2024-09-21T06:46:06.021264+0000","last_clean":"2024-09-21T06:46:06.021264+0000","last_became_active":"2024-09-21T06:46:03.647606+0000","last_became_peered":"2024-09-21T06:46:03.647606+0000","last_unstale":"2024-09-21T06:46:06.021264+0000","last_undegraded":"2024-09-21T06:46:06.021264+0000","last_fullsized":"2024-09-21T06:46:06.021264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021769+0000","last_change":"2024-09-21T06:46:04.642387+0000","last_active":"2024-09-21T06:46:06.021769+0000","last_peered":"2024-09-21T06:46:06.021769+0000","last_clean":"2024-09-21T06:46:06.021769+0000","last_became_active":"2024-09-21T06:46:04.642071+0000","last_became_peered":"2024-09-21T06:46:04.642071+0000","last_unstale":"2024-09-21T06:46:06.021769+0000","last_undegraded":"2024-09-21T06:46:06.021769+0000","last_fullsized":"2024-09-21T06:46:06.021769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:25.785034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653732+0000","last_change":"2024-09-21T06:46:03.652711+0000","last_active":"2024-09-21T06:46:03.653732+0000","last_peered":"2024-09-21T06:46:03.653732+0000","last_clean":"2024-09-21T06:46:03.653732+0000","last_became_active":"2024-09-21T06:46:03.652296+0000","last_became_peered":"2024-09-21T06:46:03.652296+0000","last_unstale":"2024-09-21T06:46:03.653732+0000","last_undegraded":"2024-09-21T06:46:03.653732+0000","last_fullsized":"2024-09-21T06:46:03.653732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:46.504084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636335+0000","last_change":"2024-09-21T06:46:03.636335+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636335+0000","last_undegraded":"2024-09-21T06:46:03.636335+0000","last_fullsized":"2024-09-21T06:46:03.636335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021469+0000","last_change":"2024-09-21T06:46:03.643980+0000","last_active":"2024-09-21T06:46:06.021469+0000","last_peered":"2024-09-21T06:46:06.021469+0000","last_clean":"2024-09-21T06:46:06.021469+0000","last_became_active":"2024-09-21T06:46:03.643648+0000","last_became_peered":"2024-09-21T06:46:03.643648+0000","last_unstale":"2024-09-21T06:46:06.021469+0000","last_undegraded":"2024-09-21T06:46:06.021469+0000","last_fullsized":"2024-09-21T06:46:06.021469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:59.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651361+0000","last_change":"2024-09-21T06:46:04.656420+0000","last_active":"2024-09-21T06:46:05.651361+0000","last_peered":"2024-09-21T06:46:05.651361+0000","last_clean":"2024-09-21T06:46:05.651361+0000","last_became_active":"2024-09-21T06:46:04.656113+0000","last_became_peered":"2024-09-21T06:46:04.656113+0000","last_unstale":"2024-09-21T06:46:05.651361+0000","last_undegraded":"2024-09-21T06:46:05.651361+0000","last_fullsized":"2024-09-21T06:46:05.651361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:58.937793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021830+0000","last_change":"2024-09-21T06:46:03.647357+0000","last_active":"2024-09-21T06:46:06.021830+0000","last_peered":"2024-09-21T06:46:06.021830+0000","last_clean":"2024-09-21T06:46:06.021830+0000","last_became_active":"2024-09-21T06:46:03.647005+0000","last_became_peered":"2024-09-21T06:46:03.647005+0000","last_unstale":"2024-09-21T06:46:06.021830+0000","last_undegraded":"2024-09-21T06:46:06.021830+0000","last_fullsized":"2024-09-21T06:46:06.021830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:12.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021169+0000","last_change":"2024-09-21T06:46:04.656652+0000","last_active":"2024-09-21T06:46:06.021169+0000","last_peered":"2024-09-21T06:46:06.021169+0000","last_clean":"2024-09-21T06:46:06.021169+0000","last_became_active":"2024-09-21T06:46:04.656322+0000","last_became_peered":"2024-09-21T06:46:04.656322+0000","last_unstale":"2024-09-21T06:46:06.021169+0000","last_undegraded":"2024-09-21T06:46:06.021169+0000","last_fullsized":"2024-09-21T06:46:06.021169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:20.501586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652019+0000","last_change":"2024-09-21T06:46:03.649908+0000","last_active":"2024-09-21T06:46:05.652019+0000","last_peered":"2024-09-21T06:46:05.652019+0000","last_clean":"2024-09-21T06:46:05.652019+0000","last_became_active":"2024-09-21T06:46:03.649595+0000","last_became_peered":"2024-09-21T06:46:03.649595+0000","last_unstale":"2024-09-21T06:46:05.652019+0000","last_undegraded":"2024-09-21T06:46:05.652019+0000","last_fullsized":"2024-09-21T06:46:05.652019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:26.657306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022261+0000","last_change":"2024-09-21T06:46:04.665360+0000","last_active":"2024-09-21T06:46:06.022261+0000","last_peered":"2024-09-21T06:46:06.022261+0000","last_clean":"2024-09-21T06:46:06.022261+0000","last_became_active":"2024-09-21T06:46:04.663777+0000","last_became_peered":"2024-09-21T06:46:04.663777+0000","last_unstale":"2024-09-21T06:46:06.022261+0000","last_undegraded":"2024-09-21T06:46:06.022261+0000","last_fullsized":"2024-09-21T06:46:06.022261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:07.180410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653629+0000","last_change":"2024-09-21T06:46:03.650579+0000","last_active":"2024-09-21T06:46:03.653629+0000","last_peered":"2024-09-21T06:46:03.653629+0000","last_clean":"2024-09-21T06:46:03.653629+0000","last_became_active":"2024-09-21T06:46:03.650243+0000","last_became_peered":"2024-09-21T06:46:03.650243+0000","last_unstale":"2024-09-21T06:46:03.653629+0000","last_undegraded":"2024-09-21T06:46:03.653629+0000","last_fullsized":"2024-09-21T06:46:03.653629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.738279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640108+0000","last_change":"2024-09-21T06:46:03.640108+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640108+0000","last_undegraded":"2024-09-21T06:46:03.640108+0000","last_fullsized":"2024-09-21T06:46:03.640108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653754+0000","last_change":"2024-09-21T06:46:03.652588+0000","last_active":"2024-09-21T06:46:03.653754+0000","last_peered":"2024-09-21T06:46:03.653754+0000","last_clean":"2024-09-21T06:46:03.653754+0000","last_became_active":"2024-09-21T06:46:03.652237+0000","last_became_peered":"2024-09-21T06:46:03.652237+0000","last_unstale":"2024-09-21T06:46:03.653754+0000","last_undegraded":"2024-09-21T06:46:03.653754+0000","last_fullsized":"2024-09-21T06:46:03.653754+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.139777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634844+0000","last_change":"2024-09-21T06:46:03.634844+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634844+0000","last_undegraded":"2024-09-21T06:46:03.634844+0000","last_fullsized":"2024-09-21T06:46:03.634844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652543+0000","last_change":"2024-09-21T06:46:03.650389+0000","last_active":"2024-09-21T06:46:05.652543+0000","last_peered":"2024-09-21T06:46:05.652543+0000","last_clean":"2024-09-21T06:46:05.652543+0000","last_became_active":"2024-09-21T06:46:03.650078+0000","last_became_peered":"2024-09-21T06:46:03.650078+0000","last_unstale":"2024-09-21T06:46:05.652543+0000","last_undegraded":"2024-09-21T06:46:05.652543+0000","last_fullsized":"2024-09-21T06:46:05.652543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:19.252522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643110+0000","last_change":"2024-09-21T06:46:03.643110+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643110+0000","last_undegraded":"2024-09-21T06:46:03.643110+0000","last_fullsized":"2024-09-21T06:46:03.643110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653849+0000","last_change":"2024-09-21T06:46:03.651097+0000","last_active":"2024-09-21T06:46:03.653849+0000","last_peered":"2024-09-21T06:46:03.653849+0000","last_clean":"2024-09-21T06:46:03.653849+0000","last_became_active":"2024-09-21T06:46:03.650544+0000","last_became_peered":"2024-09-21T06:46:03.650544+0000","last_unstale":"2024-09-21T06:46:03.653849+0000","last_undegraded":"2024-09-21T06:46:03.653849+0000","last_fullsized":"2024-09-21T06:46:03.653849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:40.871830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.630375+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:03.630375+0000","last_peered":"2024-09-21T06:46:03.630375+0000","last_clean":"2024-09-21T06:46:03.630375+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:03.630375+0000","last_undegraded":"2024-09-21T06:46:03.630375+0000","last_fullsized":"2024-09-21T06:46:03.630375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":751620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":181848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":181812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1028096,"data_stored":772728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":183514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:08.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-09-21T06:46:08.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.638055+0000', 'last_change': '2024-09-21T06:46:03.638055+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.638055+0000', 'last_undegraded': '2024-09-21T06:46:03.638055+0000', 'last_fullsized': '2024-09-21T06:46:03.638055+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-09-21T06:46:08.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.637277+0000', 'last_change': '2024-09-21T06:46:03.637277+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.637277+0000', 'last_undegraded': '2024-09-21T06:46:03.637277+0000', 'last_fullsized': '2024-09-21T06:46:03.637277+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.776 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-09-21T06:46:08.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.636790+0000', 'last_change': '2024-09-21T06:46:03.636790+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.636790+0000', 'last_undegraded': '2024-09-21T06:46:03.636790+0000', 'last_fullsized': '2024-09-21T06:46:03.636790+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.636460+0000', 'last_change': '2024-09-21T06:46:03.636460+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.636460+0000', 'last_undegraded': '2024-09-21T06:46:03.636460+0000', 'last_fullsized': '2024-09-21T06:46:03.636460+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.634514+0000', 'last_change': '2024-09-21T06:46:03.634514+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.634514+0000', 'last_undegraded': '2024-09-21T06:46:03.634514+0000', 'last_fullsized': '2024-09-21T06:46:03.634514+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.642365+0000', 'last_change': '2024-09-21T06:46:03.642365+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.642365+0000', 'last_undegraded': '2024-09-21T06:46:03.642365+0000', 'last_fullsized': '2024-09-21T06:46:03.642365+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.636642+0000', 'last_change': '2024-09-21T06:46:03.636642+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.636642+0000', 'last_undegraded': '2024-09-21T06:46:03.636642+0000', 'last_fullsized': '2024-09-21T06:46:03.636642+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.777 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.642255+0000', 'last_change': '2024-09-21T06:46:03.642255+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.642255+0000', 'last_undegraded': '2024-09-21T06:46:03.642255+0000', 'last_fullsized': '2024-09-21T06:46:03.642255+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.638858+0000', 'last_change': '2024-09-21T06:46:03.638858+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.638858+0000', 'last_undegraded': '2024-09-21T06:46:03.638858+0000', 'last_fullsized': '2024-09-21T06:46:03.638858+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.635005+0000', 'last_change': '2024-09-21T06:46:03.635005+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.635005+0000', 'last_undegraded': '2024-09-21T06:46:03.635005+0000', 'last_fullsized': '2024-09-21T06:46:03.635005+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.635377+0000', 'last_change': '2024-09-21T06:46:03.635377+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.635377+0000', 'last_undegraded': '2024-09-21T06:46:03.635377+0000', 'last_fullsized': '2024-09-21T06:46:03.635377+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-09-21T06:46:08.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.637584+0000', 'last_change': '2024-09-21T06:46:03.637584+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.637584+0000', 'last_undegraded': '2024-09-21T06:46:03.637584+0000', 'last_fullsized': '2024-09-21T06:46:03.637584+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.641884+0000', 'last_change': '2024-09-21T06:46:03.641884+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.641884+0000', 'last_undegraded': '2024-09-21T06:46:03.641884+0000', 'last_fullsized': '2024-09-21T06:46:03.641884+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.640337+0000', 'last_change': '2024-09-21T06:46:03.640337+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.640337+0000', 'last_undegraded': '2024-09-21T06:46:03.640337+0000', 'last_fullsized': '2024-09-21T06:46:03.640337+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.635863+0000', 'last_change': '2024-09-21T06:46:03.635863+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.635863+0000', 'last_undegraded': '2024-09-21T06:46:03.635863+0000', 'last_fullsized': '2024-09-21T06:46:03.635863+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.634263+0000', 'last_change': '2024-09-21T06:46:03.634263+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.634263+0000', 'last_undegraded': '2024-09-21T06:46:03.634263+0000', 'last_fullsized': '2024-09-21T06:46:03.634263+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-09-21T06:46:08.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.639647+0000', 'last_change': '2024-09-21T06:46:03.639647+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.639647+0000', 'last_undegraded': '2024-09-21T06:46:03.639647+0000', 'last_fullsized': '2024-09-21T06:46:03.639647+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.643531+0000', 'last_change': '2024-09-21T06:46:03.643531+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.643531+0000', 'last_undegraded': '2024-09-21T06:46:03.643531+0000', 'last_fullsized': '2024-09-21T06:46:03.643531+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.634481+0000', 'last_change': '2024-09-21T06:46:03.634481+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.634481+0000', 'last_undegraded': '2024-09-21T06:46:03.634481+0000', 'last_fullsized': '2024-09-21T06:46:03.634481+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.637166+0000', 'last_change': '2024-09-21T06:46:03.637166+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.637166+0000', 'last_undegraded': '2024-09-21T06:46:03.637166+0000', 'last_fullsized': '2024-09-21T06:46:03.637166+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.638060+0000', 'last_change': '2024-09-21T06:46:03.638060+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.638060+0000', 'last_undegraded': '2024-09-21T06:46:03.638060+0000', 'last_fullsized': '2024-09-21T06:46:03.638060+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.780 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.637875+0000', 'last_change': '2024-09-21T06:46:03.637875+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.637875+0000', 'last_undegraded': '2024-09-21T06:46:03.637875+0000', 'last_fullsized': '2024-09-21T06:46:03.637875+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.643077+0000', 'last_change': '2024-09-21T06:46:03.643077+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.643077+0000', 'last_undegraded': '2024-09-21T06:46:03.643077+0000', 'last_fullsized': '2024-09-21T06:46:03.643077+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.636360+0000', 'last_change': '2024-09-21T06:46:03.636360+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.636360+0000', 'last_undegraded': '2024-09-21T06:46:03.636360+0000', 'last_fullsized': '2024-09-21T06:46:03.636360+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.634148+0000', 'last_change': '2024-09-21T06:46:03.634148+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.634148+0000', 'last_undegraded': '2024-09-21T06:46:03.634148+0000', 'last_fullsized': '2024-09-21T06:46:03.634148+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.635661+0000', 'last_change': '2024-09-21T06:46:03.635661+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.635661+0000', 'last_undegraded': '2024-09-21T06:46:03.635661+0000', 'last_fullsized': '2024-09-21T06:46:03.635661+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-09-21T06:46:08.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.634286+0000', 'last_change': '2024-09-21T06:46:03.634286+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.634286+0000', 'last_undegraded': '2024-09-21T06:46:03.634286+0000', 'last_fullsized': '2024-09-21T06:46:03.634286+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.634145+0000', 'last_change': '2024-09-21T06:46:03.634145+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.634145+0000', 'last_undegraded': '2024-09-21T06:46:03.634145+0000', 'last_fullsized': '2024-09-21T06:46:03.634145+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.640692+0000', 'last_change': '2024-09-21T06:46:03.640692+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.640692+0000', 'last_undegraded': '2024-09-21T06:46:03.640692+0000', 'last_fullsized': '2024-09-21T06:46:03.640692+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.637092+0000', 'last_change': '2024-09-21T06:46:03.637092+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.637092+0000', 'last_undegraded': '2024-09-21T06:46:03.637092+0000', 'last_fullsized': '2024-09-21T06:46:03.637092+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.636335+0000', 'last_change': '2024-09-21T06:46:03.636335+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.636335+0000', 'last_undegraded': '2024-09-21T06:46:03.636335+0000', 'last_fullsized': '2024-09-21T06:46:03.636335+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.782 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-21T06:46:08.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.640108+0000', 'last_change': '2024-09-21T06:46:03.640108+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.640108+0000', 'last_undegraded': '2024-09-21T06:46:03.640108+0000', 'last_fullsized': '2024-09-21T06:46:03.640108+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.783 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-21T06:46:08.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.634844+0000', 'last_change': '2024-09-21T06:46:03.634844+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.634844+0000', 'last_undegraded': '2024-09-21T06:46:03.634844+0000', 'last_fullsized': '2024-09-21T06:46:03.634844+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T06:46:08.783 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-09-21T06:46:08.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:03.643110+0000', 'last_change': '2024-09-21T06:46:03.643110+0000', 'last_active': '2024-09-21T06:46:03.622420+0000', 'last_peered': '2024-09-21T06:46:03.622420+0000', 'last_clean': '2024-09-21T06:46:03.622420+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:03.643110+0000', 'last_undegraded': '2024-09-21T06:46:03.643110+0000', 'last_fullsized': '2024-09-21T06:46:03.643110+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:03.622420+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T06:46:08.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.922+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3391616816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2815f030 msgr2=0x7f3a2815f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.922+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3391616816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2815f030 0x7f3a2815f440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3a280cde50 tx=0x7f3a1c02a560 comp rx=0 tx=0).stop 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.922+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3391616816 shutdown_connections 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.922+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3391616816 >> v2:172.21.15.89:3300/0 conn(0x7f3a2806dea0 0x7f3a2806e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.922+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3391616816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2815f030 0x7f3a2815f440 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.922+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3391616816 >> 172.21.15.81:0/3391616816 conn(0x7f3a280d0ae0 msgr2=0x7f3a280d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.923+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3391616816 shutdown_connections 2024-09-21T06:46:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.923+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3391616816 wait complete. 2024-09-21T06:46:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.924+0000 7f3a2de3f640 1 Processor -- start 2024-09-21T06:46:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.924+0000 7f3a2de3f640 1 -- start start 2024-09-21T06:46:08.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a2de3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2806dea0 0x7f3a28143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a2de3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a281590f0 0x7f3a280c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a2de3f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2815f030 0x7f3a2815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a2de3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a280cea90 con 0x7f3a2806dea0 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a2de3f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3a280ce910 con 0x7f3a281590f0 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a2de3f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3a280cec10 con 0x7f3a2815f030 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2806dea0 0x7f3a28143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2806dea0 0x7f3a28143f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56726/0 (socket says 172.21.15.81:56726) 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 -- 172.21.15.81:0/3707706702 learned_addr learned my addr 172.21.15.81:0/3707706702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a26ffd640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a281590f0 0x7f3a280c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a27fff640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2815f030 0x7f3a2815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 -- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2815f030 msgr2=0x7f3a2815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2815f030 0x7f3a2815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 -- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a281590f0 msgr2=0x7f3a280c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a281590f0 0x7f3a280c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 -- 172.21.15.81:0/3707706702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a281f7ba0 con 0x7f3a2806dea0 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a277fe640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2806dea0 0x7f3a28143f10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800c730 tx=0x7f3a1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a0ffff640 1 -- 172.21.15.81:0/3707706702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18003b70 con 0x7f3a2806dea0 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a0ffff640 1 -- 172.21.15.81:0/3707706702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a18003d30 con 0x7f3a2806dea0 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.926+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a281f7020 con 0x7f3a2806dea0 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.927+0000 7f3a0ffff640 1 -- 172.21.15.81:0/3707706702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800aab0 con 0x7f3a2806dea0 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.927+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a281f75e0 con 0x7f3a2806dea0 2024-09-21T06:46:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.927+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a280cf130 con 0x7f3a2806dea0 2024-09-21T06:46:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.928+0000 7f3a0ffff640 1 -- 172.21.15.81:0/3707706702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a1800ac50 con 0x7f3a2806dea0 2024-09-21T06:46:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.929+0000 7f3a0ffff640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3a14078b90 0x7f3a1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.929+0000 7f3a0ffff640 1 -- 172.21.15.81:0/3707706702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3a1809ab30 con 0x7f3a2806dea0 2024-09-21T06:46:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.929+0000 7f3a26ffd640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3a14078b90 0x7f3a1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.929+0000 7f3a26ffd640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3a14078b90 0x7f3a1407b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c033000 tx=0x7f3a1c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:08.933+0000 7f3a0ffff640 1 -- 172.21.15.81:0/3707706702 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3a2806e7f0 con 0x7f3a2806dea0 2024-09-21T06:46:09.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.181+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3a280d1070 con 0x7f3a2806dea0 2024-09-21T06:46:09.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.182+0000 7f3a0ffff640 1 -- 172.21.15.81:0/3707706702 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1688 (secure 0 0 0) 0x7f3a18062820 con 0x7f3a2806dea0 2024-09-21T06:46:09.184 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:09.184 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":78,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1726901103,"num_in_osds":8,"osd_in_since":1726901093,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":63},{"state_name":"creating+peering","count":34}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":592084,"bytes_used":225939456,"bytes_avail":772868173824,"bytes_total":773094113280,"inactive_pgs_ratio":0.3505154550075531,"write_bytes_sec":1876,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":17,"btime":"2024-09-21T06:46:07:052774+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4882}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-21T06:46:04.663443+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T06:46:09.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3a14078b90 msgr2=0x7f3a1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3a14078b90 0x7f3a1407b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c033000 tx=0x7f3a1c004730 comp rx=0 tx=0).stop 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2806dea0 msgr2=0x7f3a28143f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2806dea0 0x7f3a28143f10 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800c730 tx=0x7f3a1800cbf0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 shutdown_connections 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3a14078b90 0x7f3a1407b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a2815f030 0x7f3a2815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a281590f0 0x7f3a280c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 --2- 172.21.15.81:0/3707706702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a2806dea0 0x7f3a28143f10 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 >> 172.21.15.81:0/3707706702 conn(0x7f3a280d0ae0 msgr2=0x7f3a28158400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 shutdown_connections 2024-09-21T06:46:09.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.184+0000 7f3a2de3f640 1 -- 172.21.15.81:0/3707706702 wait complete. 2024-09-21T06:46:09.198 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T06:46:09.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:09.286 INFO:tasks.ceph.mds.b.smithi089.stderr:2024-09-21T06:46:09.284+0000 7fd063fb4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:46:09.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 -- 172.21.15.81:0/2960876072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 msgr2=0x7f66dc0b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 --2- 172.21.15.81:0/2960876072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc0b1b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f66d0005fd0 tx=0x7f66d002a5a0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 -- 172.21.15.81:0/2960876072 shutdown_connections 2024-09-21T06:46:09.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 --2- 172.21.15.81:0/2960876072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc0b1b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 --2- 172.21.15.81:0/2960876072 >> v2:172.21.15.89:3300/0 conn(0x7f66dc0d19a0 0x7f66dc15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 -- 172.21.15.81:0/2960876072 >> 172.21.15.81:0/2960876072 conn(0x7f66dc0d25e0 msgr2=0x7f66dc0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 -- 172.21.15.81:0/2960876072 shutdown_connections 2024-09-21T06:46:09.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.308+0000 7f66e0a25640 1 -- 172.21.15.81:0/2960876072 wait complete. 2024-09-21T06:46:09.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.310+0000 7f66e0a25640 1 Processor -- start 2024-09-21T06:46:09.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.310+0000 7f66e0a25640 1 -- start start 2024-09-21T06:46:09.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66e0a25640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66dc0b20d0 0x7f66dc1f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66e0a25640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc0d19a0 0x7f66dc1f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66e0a25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66e0a25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc072ec0 con 0x7f66dc1601c0 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66e0a25640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc072d40 con 0x7f66dc0d19a0 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66e0a25640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc073040 con 0x7f66dc0b20d0 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66dad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66dad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc14a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56734/0 (socket says 172.21.15.81:56734) 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66dad9d640 1 -- 172.21.15.81:0/1829470868 learned_addr learned my addr 172.21.15.81:0/1829470868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66d9d9b640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc0d19a0 0x7f66dc1f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.311+0000 7f66da59c640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66dc0b20d0 0x7f66dc1f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66dad9d640 1 -- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66dc0b20d0 msgr2=0x7f66dc1f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66dad9d640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66dc0b20d0 0x7f66dc1f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66dad9d640 1 -- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc0d19a0 msgr2=0x7f66dc1f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66dad9d640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc0d19a0 0x7f66dc1f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66dad9d640 1 -- 172.21.15.81:0/1829470868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc0c80e0 con 0x7f66dc1601c0 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66dad9d640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc14a1b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f66d4002230 tx=0x7f66d400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66caffd640 1 -- 172.21.15.81:0/1829470868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003b70 con 0x7f66dc1601c0 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66caffd640 1 -- 172.21.15.81:0/1829470868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66d4003d10 con 0x7f66dc1601c0 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66caffd640 1 -- 172.21.15.81:0/1829470868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4005330 con 0x7f66dc1601c0 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc0c83c0 con 0x7f66dc1601c0 2024-09-21T06:46:09.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.312+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc0c8980 con 0x7f66dc1601c0 2024-09-21T06:46:09.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.313+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc073560 con 0x7f66dc1601c0 2024-09-21T06:46:09.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.314+0000 7f66caffd640 1 -- 172.21.15.81:0/1829470868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66d40056e0 con 0x7f66dc1601c0 2024-09-21T06:46:09.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.314+0000 7f66caffd640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078b90 0x7f66bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.315+0000 7f66caffd640 1 -- 172.21.15.81:0/1829470868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f66d409ae20 con 0x7f66dc1601c0 2024-09-21T06:46:09.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.315+0000 7f66da59c640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078b90 0x7f66bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.315+0000 7f66da59c640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078b90 0x7f66bc07b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009b30 tx=0x7f66cc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.319+0000 7f66caffd640 1 -- 172.21.15.81:0/1829470868 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66d40629e0 con 0x7f66dc1601c0 2024-09-21T06:46:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.493+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66dc159ad0 con 0x7f66bc078b90 2024-09-21T06:46:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.498+0000 7f66caffd640 1 -- 172.21.15.81:0/1829470868 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249147 (secure 0 0 0) 0x7f66dc159ad0 con 0x7f66bc078b90 2024-09-21T06:46:09.502 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.500+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078b90 msgr2=0x7f66bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.500+0000 7f66e0a25640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078b90 0x7f66bc07b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009b30 tx=0x7f66cc005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 msgr2=0x7f66dc14a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc14a1b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f66d4002230 tx=0x7f66d400cb90 comp rx=0 tx=0).stop 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 shutdown_connections 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f66bc078b90 0x7f66bc07b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1601c0 0x7f66dc14a1b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66dc0d19a0 0x7f66dc1f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 --2- 172.21.15.81:0/1829470868 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66dc0b20d0 0x7f66dc1f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 >> 172.21.15.81:0/1829470868 conn(0x7f66dc0d25e0 msgr2=0x7f66dc0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 shutdown_connections 2024-09-21T06:46:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:09.501+0000 7f66e0a25640 1 -- 172.21.15.81:0/1829470868 wait complete. 2024-09-21T06:46:09.514 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-21T06:46:08.664308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":116,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220644,"kb_used_data":4408,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754076,"statfs":{"total":773094113280,"available":772868173824,"internally_reserved":0,"allocated":4513792,"data_stored":2555278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001338"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651937+0000","last_change":"2024-09-21T06:46:04.653828+0000","last_active":"2024-09-21T06:46:05.651937+0000","last_peered":"2024-09-21T06:46:05.651937+0000","last_clean":"2024-09-21T06:46:05.651937+0000","last_became_active":"2024-09-21T06:46:04.653509+0000","last_became_peered":"2024-09-21T06:46:04.653509+0000","last_unstale":"2024-09-21T06:46:05.651937+0000","last_undegraded":"2024-09-21T06:46:05.651937+0000","last_fullsized":"2024-09-21T06:46:05.651937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:22.157120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021625+0000","last_change":"2024-09-21T06:46:04.661867+0000","last_active":"2024-09-21T06:46:06.021625+0000","last_peered":"2024-09-21T06:46:06.021625+0000","last_clean":"2024-09-21T06:46:06.021625+0000","last_became_active":"2024-09-21T06:46:04.661351+0000","last_became_peered":"2024-09-21T06:46:04.661351+0000","last_unstale":"2024-09-21T06:46:06.021625+0000","last_undegraded":"2024-09-21T06:46:06.021625+0000","last_fullsized":"2024-09-21T06:46:06.021625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:11.727185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652680+0000","last_change":"2024-09-21T06:46:04.663927+0000","last_active":"2024-09-21T06:46:05.652680+0000","last_peered":"2024-09-21T06:46:05.652680+0000","last_clean":"2024-09-21T06:46:05.652680+0000","last_became_active":"2024-09-21T06:46:04.663604+0000","last_became_peered":"2024-09-21T06:46:04.663604+0000","last_unstale":"2024-09-21T06:46:05.652680+0000","last_undegraded":"2024-09-21T06:46:05.652680+0000","last_fullsized":"2024-09-21T06:46:05.652680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:16.103507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652632+0000","last_change":"2024-09-21T06:46:04.660353+0000","last_active":"2024-09-21T06:46:05.652632+0000","last_peered":"2024-09-21T06:46:05.652632+0000","last_clean":"2024-09-21T06:46:05.652632+0000","last_became_active":"2024-09-21T06:46:04.660017+0000","last_became_peered":"2024-09-21T06:46:04.660017+0000","last_unstale":"2024-09-21T06:46:05.652632+0000","last_undegraded":"2024-09-21T06:46:05.652632+0000","last_fullsized":"2024-09-21T06:46:05.652632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:58.086168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021623+0000","last_change":"2024-09-21T06:46:04.648697+0000","last_active":"2024-09-21T06:46:06.021623+0000","last_peered":"2024-09-21T06:46:06.021623+0000","last_clean":"2024-09-21T06:46:06.021623+0000","last_became_active":"2024-09-21T06:46:04.648378+0000","last_became_peered":"2024-09-21T06:46:04.648378+0000","last_unstale":"2024-09-21T06:46:06.021623+0000","last_undegraded":"2024-09-21T06:46:06.021623+0000","last_fullsized":"2024-09-21T06:46:06.021623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:27.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022222+0000","last_change":"2024-09-21T06:46:04.661899+0000","last_active":"2024-09-21T06:46:06.022222+0000","last_peered":"2024-09-21T06:46:06.022222+0000","last_clean":"2024-09-21T06:46:06.022222+0000","last_became_active":"2024-09-21T06:46:04.661469+0000","last_became_peered":"2024-09-21T06:46:04.661469+0000","last_unstale":"2024-09-21T06:46:06.022222+0000","last_undegraded":"2024-09-21T06:46:06.022222+0000","last_fullsized":"2024-09-21T06:46:06.022222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:15.051574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638055+0000","last_change":"2024-09-21T06:46:03.638055+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638055+0000","last_undegraded":"2024-09-21T06:46:03.638055+0000","last_fullsized":"2024-09-21T06:46:03.638055+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652150+0000","last_change":"2024-09-21T06:46:04.667034+0000","last_active":"2024-09-21T06:46:05.652150+0000","last_peered":"2024-09-21T06:46:05.652150+0000","last_clean":"2024-09-21T06:46:05.652150+0000","last_became_active":"2024-09-21T06:46:04.666723+0000","last_became_peered":"2024-09-21T06:46:04.666723+0000","last_unstale":"2024-09-21T06:46:05.652150+0000","last_undegraded":"2024-09-21T06:46:05.652150+0000","last_fullsized":"2024-09-21T06:46:05.652150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.904136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021812+0000","last_change":"2024-09-21T06:46:04.654275+0000","last_active":"2024-09-21T06:46:06.021812+0000","last_peered":"2024-09-21T06:46:06.021812+0000","last_clean":"2024-09-21T06:46:06.021812+0000","last_became_active":"2024-09-21T06:46:04.653913+0000","last_became_peered":"2024-09-21T06:46:04.653913+0000","last_unstale":"2024-09-21T06:46:06.021812+0000","last_undegraded":"2024-09-21T06:46:06.021812+0000","last_fullsized":"2024-09-21T06:46:06.021812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:02.434425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637277+0000","last_change":"2024-09-21T06:46:03.637277+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637277+0000","last_undegraded":"2024-09-21T06:46:03.637277+0000","last_fullsized":"2024-09-21T06:46:03.637277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636790+0000","last_change":"2024-09-21T06:46:03.636790+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636790+0000","last_undegraded":"2024-09-21T06:46:03.636790+0000","last_fullsized":"2024-09-21T06:46:03.636790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021385+0000","last_change":"2024-09-21T06:46:04.659857+0000","last_active":"2024-09-21T06:46:06.021385+0000","last_peered":"2024-09-21T06:46:06.021385+0000","last_clean":"2024-09-21T06:46:06.021385+0000","last_became_active":"2024-09-21T06:46:04.659546+0000","last_became_peered":"2024-09-21T06:46:04.659546+0000","last_unstale":"2024-09-21T06:46:06.021385+0000","last_undegraded":"2024-09-21T06:46:06.021385+0000","last_fullsized":"2024-09-21T06:46:06.021385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:28.070646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636460+0000","last_change":"2024-09-21T06:46:03.636460+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636460+0000","last_undegraded":"2024-09-21T06:46:03.636460+0000","last_fullsized":"2024-09-21T06:46:03.636460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634514+0000","last_change":"2024-09-21T06:46:03.634514+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634514+0000","last_undegraded":"2024-09-21T06:46:03.634514+0000","last_fullsized":"2024-09-21T06:46:03.634514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642365+0000","last_change":"2024-09-21T06:46:03.642365+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642365+0000","last_undegraded":"2024-09-21T06:46:03.642365+0000","last_fullsized":"2024-09-21T06:46:03.642365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636642+0000","last_change":"2024-09-21T06:46:03.636642+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636642+0000","last_undegraded":"2024-09-21T06:46:03.636642+0000","last_fullsized":"2024-09-21T06:46:03.636642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.642255+0000","last_change":"2024-09-21T06:46:03.642255+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.642255+0000","last_undegraded":"2024-09-21T06:46:03.642255+0000","last_fullsized":"2024-09-21T06:46:03.642255+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638858+0000","last_change":"2024-09-21T06:46:03.638858+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638858+0000","last_undegraded":"2024-09-21T06:46:03.638858+0000","last_fullsized":"2024-09-21T06:46:03.638858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651166+0000","last_change":"2024-09-21T06:46:04.658383+0000","last_active":"2024-09-21T06:46:05.651166+0000","last_peered":"2024-09-21T06:46:05.651166+0000","last_clean":"2024-09-21T06:46:05.651166+0000","last_became_active":"2024-09-21T06:46:04.657091+0000","last_became_peered":"2024-09-21T06:46:04.657091+0000","last_unstale":"2024-09-21T06:46:05.651166+0000","last_undegraded":"2024-09-21T06:46:05.651166+0000","last_fullsized":"2024-09-21T06:46:05.651166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.983526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635005+0000","last_change":"2024-09-21T06:46:03.635005+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635005+0000","last_undegraded":"2024-09-21T06:46:03.635005+0000","last_fullsized":"2024-09-21T06:46:03.635005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635377+0000","last_change":"2024-09-21T06:46:03.635377+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635377+0000","last_undegraded":"2024-09-21T06:46:03.635377+0000","last_fullsized":"2024-09-21T06:46:03.635377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637584+0000","last_change":"2024-09-21T06:46:03.637584+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637584+0000","last_undegraded":"2024-09-21T06:46:03.637584+0000","last_fullsized":"2024-09-21T06:46:03.637584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.641884+0000","last_change":"2024-09-21T06:46:03.641884+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.641884+0000","last_undegraded":"2024-09-21T06:46:03.641884+0000","last_fullsized":"2024-09-21T06:46:03.641884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652114+0000","last_change":"2024-09-21T06:46:04.658260+0000","last_active":"2024-09-21T06:46:05.652114+0000","last_peered":"2024-09-21T06:46:05.652114+0000","last_clean":"2024-09-21T06:46:05.652114+0000","last_became_active":"2024-09-21T06:46:04.657919+0000","last_became_peered":"2024-09-21T06:46:04.657919+0000","last_unstale":"2024-09-21T06:46:05.652114+0000","last_undegraded":"2024-09-21T06:46:05.652114+0000","last_fullsized":"2024-09-21T06:46:05.652114+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:29.074983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640337+0000","last_change":"2024-09-21T06:46:03.640337+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640337+0000","last_undegraded":"2024-09-21T06:46:03.640337+0000","last_fullsized":"2024-09-21T06:46:03.640337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651964+0000","last_change":"2024-09-21T06:46:04.654047+0000","last_active":"2024-09-21T06:46:05.651964+0000","last_peered":"2024-09-21T06:46:05.651964+0000","last_clean":"2024-09-21T06:46:05.651964+0000","last_became_active":"2024-09-21T06:46:04.653726+0000","last_became_peered":"2024-09-21T06:46:04.653726+0000","last_unstale":"2024-09-21T06:46:05.651964+0000","last_undegraded":"2024-09-21T06:46:05.651964+0000","last_fullsized":"2024-09-21T06:46:05.651964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:24.218374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635863+0000","last_change":"2024-09-21T06:46:03.635863+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635863+0000","last_undegraded":"2024-09-21T06:46:03.635863+0000","last_fullsized":"2024-09-21T06:46:03.635863+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634263+0000","last_change":"2024-09-21T06:46:03.634263+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634263+0000","last_undegraded":"2024-09-21T06:46:03.634263+0000","last_fullsized":"2024-09-21T06:46:03.634263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.639647+0000","last_change":"2024-09-21T06:46:03.639647+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.639647+0000","last_undegraded":"2024-09-21T06:46:03.639647+0000","last_fullsized":"2024-09-21T06:46:03.639647+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643531+0000","last_change":"2024-09-21T06:46:03.643531+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643531+0000","last_undegraded":"2024-09-21T06:46:03.643531+0000","last_fullsized":"2024-09-21T06:46:03.643531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634481+0000","last_change":"2024-09-21T06:46:03.634481+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634481+0000","last_undegraded":"2024-09-21T06:46:03.634481+0000","last_fullsized":"2024-09-21T06:46:03.634481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652372+0000","last_change":"2024-09-21T06:46:04.663746+0000","last_active":"2024-09-21T06:46:05.652372+0000","last_peered":"2024-09-21T06:46:05.652372+0000","last_clean":"2024-09-21T06:46:05.652372+0000","last_became_active":"2024-09-21T06:46:04.663442+0000","last_became_peered":"2024-09-21T06:46:04.663442+0000","last_unstale":"2024-09-21T06:46:05.652372+0000","last_undegraded":"2024-09-21T06:46:05.652372+0000","last_fullsized":"2024-09-21T06:46:05.652372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:34.082130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637166+0000","last_change":"2024-09-21T06:46:03.637166+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637166+0000","last_undegraded":"2024-09-21T06:46:03.637166+0000","last_fullsized":"2024-09-21T06:46:03.637166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649978+0000","last_change":"2024-09-21T06:46:03.647271+0000","last_active":"2024-09-21T06:46:03.649978+0000","last_peered":"2024-09-21T06:46:03.649978+0000","last_clean":"2024-09-21T06:46:03.649978+0000","last_became_active":"2024-09-21T06:46:03.646987+0000","last_became_peered":"2024-09-21T06:46:03.646987+0000","last_unstale":"2024-09-21T06:46:03.649978+0000","last_undegraded":"2024-09-21T06:46:03.649978+0000","last_fullsized":"2024-09-21T06:46:03.649978+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:19.498283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021604+0000","last_change":"2024-09-21T06:46:04.660925+0000","last_active":"2024-09-21T06:46:06.021604+0000","last_peered":"2024-09-21T06:46:06.021604+0000","last_clean":"2024-09-21T06:46:06.021604+0000","last_became_active":"2024-09-21T06:46:04.660586+0000","last_became_peered":"2024-09-21T06:46:04.660586+0000","last_unstale":"2024-09-21T06:46:06.021604+0000","last_undegraded":"2024-09-21T06:46:06.021604+0000","last_fullsized":"2024-09-21T06:46:06.021604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:26.073993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021594+0000","last_change":"2024-09-21T06:46:03.653877+0000","last_active":"2024-09-21T06:46:06.021594+0000","last_peered":"2024-09-21T06:46:06.021594+0000","last_clean":"2024-09-21T06:46:06.021594+0000","last_became_active":"2024-09-21T06:46:03.653554+0000","last_became_peered":"2024-09-21T06:46:03.653554+0000","last_unstale":"2024-09-21T06:46:06.021594+0000","last_undegraded":"2024-09-21T06:46:06.021594+0000","last_fullsized":"2024-09-21T06:46:06.021594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:23.469489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.638060+0000","last_change":"2024-09-21T06:46:03.638060+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.638060+0000","last_undegraded":"2024-09-21T06:46:03.638060+0000","last_fullsized":"2024-09-21T06:46:03.638060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652631+0000","last_change":"2024-09-21T06:46:03.648247+0000","last_active":"2024-09-21T06:46:05.652631+0000","last_peered":"2024-09-21T06:46:05.652631+0000","last_clean":"2024-09-21T06:46:05.652631+0000","last_became_active":"2024-09-21T06:46:03.647153+0000","last_became_peered":"2024-09-21T06:46:03.647153+0000","last_unstale":"2024-09-21T06:46:05.652631+0000","last_undegraded":"2024-09-21T06:46:05.652631+0000","last_fullsized":"2024-09-21T06:46:05.652631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:16.140311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022143+0000","last_change":"2024-09-21T06:46:04.662876+0000","last_active":"2024-09-21T06:46:06.022143+0000","last_peered":"2024-09-21T06:46:06.022143+0000","last_clean":"2024-09-21T06:46:06.022143+0000","last_became_active":"2024-09-21T06:46:04.662576+0000","last_became_peered":"2024-09-21T06:46:04.662576+0000","last_unstale":"2024-09-21T06:46:06.022143+0000","last_undegraded":"2024-09-21T06:46:06.022143+0000","last_fullsized":"2024-09-21T06:46:06.022143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:32.493240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650018+0000","last_change":"2024-09-21T06:46:03.644181+0000","last_active":"2024-09-21T06:46:03.650018+0000","last_peered":"2024-09-21T06:46:03.650018+0000","last_clean":"2024-09-21T06:46:03.650018+0000","last_became_active":"2024-09-21T06:46:03.643878+0000","last_became_peered":"2024-09-21T06:46:03.643878+0000","last_unstale":"2024-09-21T06:46:03.650018+0000","last_undegraded":"2024-09-21T06:46:03.650018+0000","last_fullsized":"2024-09-21T06:46:03.650018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:52.886598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652393+0000","last_change":"2024-09-21T06:46:04.654929+0000","last_active":"2024-09-21T06:46:05.652393+0000","last_peered":"2024-09-21T06:46:05.652393+0000","last_clean":"2024-09-21T06:46:05.652393+0000","last_became_active":"2024-09-21T06:46:04.654243+0000","last_became_peered":"2024-09-21T06:46:04.654243+0000","last_unstale":"2024-09-21T06:46:05.652393+0000","last_undegraded":"2024-09-21T06:46:05.652393+0000","last_fullsized":"2024-09-21T06:46:05.652393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:18.804337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649465+0000","last_change":"2024-09-21T06:46:03.641222+0000","last_active":"2024-09-21T06:46:03.649465+0000","last_peered":"2024-09-21T06:46:03.649465+0000","last_clean":"2024-09-21T06:46:03.649465+0000","last_became_active":"2024-09-21T06:46:03.640868+0000","last_became_peered":"2024-09-21T06:46:03.640868+0000","last_unstale":"2024-09-21T06:46:03.649465+0000","last_undegraded":"2024-09-21T06:46:03.649465+0000","last_fullsized":"2024-09-21T06:46:03.649465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:43.128820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637875+0000","last_change":"2024-09-21T06:46:03.637875+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637875+0000","last_undegraded":"2024-09-21T06:46:03.637875+0000","last_fullsized":"2024-09-21T06:46:03.637875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.651433+0000","last_change":"2024-09-21T06:46:03.646346+0000","last_active":"2024-09-21T06:46:03.651433+0000","last_peered":"2024-09-21T06:46:03.651433+0000","last_clean":"2024-09-21T06:46:03.651433+0000","last_became_active":"2024-09-21T06:46:03.645110+0000","last_became_peered":"2024-09-21T06:46:03.645110+0000","last_unstale":"2024-09-21T06:46:03.651433+0000","last_undegraded":"2024-09-21T06:46:03.651433+0000","last_fullsized":"2024-09-21T06:46:03.651433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:31.981218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643077+0000","last_change":"2024-09-21T06:46:03.643077+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643077+0000","last_undegraded":"2024-09-21T06:46:03.643077+0000","last_fullsized":"2024-09-21T06:46:03.643077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651641+0000","last_change":"2024-09-21T06:46:03.653821+0000","last_active":"2024-09-21T06:46:05.651641+0000","last_peered":"2024-09-21T06:46:05.651641+0000","last_clean":"2024-09-21T06:46:05.651641+0000","last_became_active":"2024-09-21T06:46:03.653466+0000","last_became_peered":"2024-09-21T06:46:03.653466+0000","last_unstale":"2024-09-21T06:46:05.651641+0000","last_undegraded":"2024-09-21T06:46:05.651641+0000","last_fullsized":"2024-09-21T06:46:05.651641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:06.669384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022050+0000","last_change":"2024-09-21T06:46:04.658674+0000","last_active":"2024-09-21T06:46:06.022050+0000","last_peered":"2024-09-21T06:46:06.022050+0000","last_clean":"2024-09-21T06:46:06.022050+0000","last_became_active":"2024-09-21T06:46:04.658375+0000","last_became_peered":"2024-09-21T06:46:04.658375+0000","last_unstale":"2024-09-21T06:46:06.022050+0000","last_undegraded":"2024-09-21T06:46:06.022050+0000","last_fullsized":"2024-09-21T06:46:06.022050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:18.162094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.644028+0000","last_change":"2024-09-21T06:46:03.639925+0000","last_active":"2024-09-21T06:46:03.644028+0000","last_peered":"2024-09-21T06:46:03.644028+0000","last_clean":"2024-09-21T06:46:03.644028+0000","last_became_active":"2024-09-21T06:46:03.639624+0000","last_became_peered":"2024-09-21T06:46:03.639624+0000","last_unstale":"2024-09-21T06:46:03.644028+0000","last_undegraded":"2024-09-21T06:46:03.644028+0000","last_fullsized":"2024-09-21T06:46:03.644028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:08.819632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652525+0000","last_change":"2024-09-21T06:46:04.657543+0000","last_active":"2024-09-21T06:46:05.652525+0000","last_peered":"2024-09-21T06:46:05.652525+0000","last_clean":"2024-09-21T06:46:05.652525+0000","last_became_active":"2024-09-21T06:46:04.656454+0000","last_became_peered":"2024-09-21T06:46:04.656454+0000","last_unstale":"2024-09-21T06:46:05.652525+0000","last_undegraded":"2024-09-21T06:46:05.652525+0000","last_fullsized":"2024-09-21T06:46:05.652525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.287462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652046+0000","last_change":"2024-09-21T06:46:03.643897+0000","last_active":"2024-09-21T06:46:05.652046+0000","last_peered":"2024-09-21T06:46:05.652046+0000","last_clean":"2024-09-21T06:46:05.652046+0000","last_became_active":"2024-09-21T06:46:03.642845+0000","last_became_peered":"2024-09-21T06:46:03.642845+0000","last_unstale":"2024-09-21T06:46:05.652046+0000","last_undegraded":"2024-09-21T06:46:05.652046+0000","last_fullsized":"2024-09-21T06:46:05.652046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:57.330223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636360+0000","last_change":"2024-09-21T06:46:03.636360+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636360+0000","last_undegraded":"2024-09-21T06:46:03.636360+0000","last_fullsized":"2024-09-21T06:46:03.636360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653246+0000","last_change":"2024-09-21T06:46:03.647428+0000","last_active":"2024-09-21T06:46:03.653246+0000","last_peered":"2024-09-21T06:46:03.653246+0000","last_clean":"2024-09-21T06:46:03.653246+0000","last_became_active":"2024-09-21T06:46:03.647141+0000","last_became_peered":"2024-09-21T06:46:03.647141+0000","last_unstale":"2024-09-21T06:46:03.653246+0000","last_undegraded":"2024-09-21T06:46:03.653246+0000","last_fullsized":"2024-09-21T06:46:03.653246+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:25.124073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652036+0000","last_change":"2024-09-21T06:46:04.654222+0000","last_active":"2024-09-21T06:46:05.652036+0000","last_peered":"2024-09-21T06:46:05.652036+0000","last_clean":"2024-09-21T06:46:05.652036+0000","last_became_active":"2024-09-21T06:46:04.653337+0000","last_became_peered":"2024-09-21T06:46:04.653337+0000","last_unstale":"2024-09-21T06:46:05.652036+0000","last_undegraded":"2024-09-21T06:46:05.652036+0000","last_fullsized":"2024-09-21T06:46:05.652036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:00.246624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.654885+0000","last_change":"2024-09-21T06:46:03.652929+0000","last_active":"2024-09-21T06:46:03.654885+0000","last_peered":"2024-09-21T06:46:03.654885+0000","last_clean":"2024-09-21T06:46:03.654885+0000","last_became_active":"2024-09-21T06:46:03.652578+0000","last_became_peered":"2024-09-21T06:46:03.652578+0000","last_unstale":"2024-09-21T06:46:03.654885+0000","last_undegraded":"2024-09-21T06:46:03.654885+0000","last_fullsized":"2024-09-21T06:46:03.654885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:06.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634148+0000","last_change":"2024-09-21T06:46:03.634148+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634148+0000","last_undegraded":"2024-09-21T06:46:03.634148+0000","last_fullsized":"2024-09-21T06:46:03.634148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652605+0000","last_change":"2024-09-21T06:46:03.645602+0000","last_active":"2024-09-21T06:46:05.652605+0000","last_peered":"2024-09-21T06:46:05.652605+0000","last_clean":"2024-09-21T06:46:05.652605+0000","last_became_active":"2024-09-21T06:46:03.645130+0000","last_became_peered":"2024-09-21T06:46:03.645130+0000","last_unstale":"2024-09-21T06:46:05.652605+0000","last_undegraded":"2024-09-21T06:46:05.652605+0000","last_fullsized":"2024-09-21T06:46:05.652605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:25.387037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652654+0000","last_change":"2024-09-21T06:46:04.659242+0000","last_active":"2024-09-21T06:46:05.652654+0000","last_peered":"2024-09-21T06:46:05.652654+0000","last_clean":"2024-09-21T06:46:05.652654+0000","last_became_active":"2024-09-21T06:46:04.657419+0000","last_became_peered":"2024-09-21T06:46:04.657419+0000","last_unstale":"2024-09-21T06:46:05.652654+0000","last_undegraded":"2024-09-21T06:46:05.652654+0000","last_fullsized":"2024-09-21T06:46:05.652654+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:18.015872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651737+0000","last_change":"2024-09-21T06:46:03.649916+0000","last_active":"2024-09-21T06:46:05.651737+0000","last_peered":"2024-09-21T06:46:05.651737+0000","last_clean":"2024-09-21T06:46:05.651737+0000","last_became_active":"2024-09-21T06:46:03.649612+0000","last_became_peered":"2024-09-21T06:46:03.649612+0000","last_unstale":"2024-09-21T06:46:05.651737+0000","last_undegraded":"2024-09-21T06:46:05.651737+0000","last_fullsized":"2024-09-21T06:46:05.651737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:10.350057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022147+0000","last_change":"2024-09-21T06:46:04.659602+0000","last_active":"2024-09-21T06:46:06.022147+0000","last_peered":"2024-09-21T06:46:06.022147+0000","last_clean":"2024-09-21T06:46:06.022147+0000","last_became_active":"2024-09-21T06:46:04.659302+0000","last_became_peered":"2024-09-21T06:46:04.659302+0000","last_unstale":"2024-09-21T06:46:06.022147+0000","last_undegraded":"2024-09-21T06:46:06.022147+0000","last_fullsized":"2024-09-21T06:46:06.022147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:42.004616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022075+0000","last_change":"2024-09-21T06:46:03.652325+0000","last_active":"2024-09-21T06:46:06.022075+0000","last_peered":"2024-09-21T06:46:06.022075+0000","last_clean":"2024-09-21T06:46:06.022075+0000","last_became_active":"2024-09-21T06:46:03.651992+0000","last_became_peered":"2024-09-21T06:46:03.651992+0000","last_unstale":"2024-09-21T06:46:06.022075+0000","last_undegraded":"2024-09-21T06:46:06.022075+0000","last_fullsized":"2024-09-21T06:46:06.022075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.054085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.635661+0000","last_change":"2024-09-21T06:46:03.635661+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.635661+0000","last_undegraded":"2024-09-21T06:46:03.635661+0000","last_fullsized":"2024-09-21T06:46:03.635661+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653673+0000","last_change":"2024-09-21T06:46:03.650829+0000","last_active":"2024-09-21T06:46:03.653673+0000","last_peered":"2024-09-21T06:46:03.653673+0000","last_clean":"2024-09-21T06:46:03.653673+0000","last_became_active":"2024-09-21T06:46:03.650489+0000","last_became_peered":"2024-09-21T06:46:03.650489+0000","last_unstale":"2024-09-21T06:46:03.653673+0000","last_undegraded":"2024-09-21T06:46:03.653673+0000","last_fullsized":"2024-09-21T06:46:03.653673+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:02.441436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021401+0000","last_change":"2024-09-21T06:46:04.663113+0000","last_active":"2024-09-21T06:46:06.021401+0000","last_peered":"2024-09-21T06:46:06.021401+0000","last_clean":"2024-09-21T06:46:06.021401+0000","last_became_active":"2024-09-21T06:46:04.662781+0000","last_became_peered":"2024-09-21T06:46:04.662781+0000","last_unstale":"2024-09-21T06:46:06.021401+0000","last_undegraded":"2024-09-21T06:46:06.021401+0000","last_fullsized":"2024-09-21T06:46:06.021401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:32.289889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.650055+0000","last_change":"2024-09-21T06:46:03.646551+0000","last_active":"2024-09-21T06:46:03.650055+0000","last_peered":"2024-09-21T06:46:03.650055+0000","last_clean":"2024-09-21T06:46:03.650055+0000","last_became_active":"2024-09-21T06:46:03.646209+0000","last_became_peered":"2024-09-21T06:46:03.646209+0000","last_unstale":"2024-09-21T06:46:03.650055+0000","last_undegraded":"2024-09-21T06:46:03.650055+0000","last_fullsized":"2024-09-21T06:46:03.650055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:24.116938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022399+0000","last_change":"2024-09-21T06:46:04.658778+0000","last_active":"2024-09-21T06:46:06.022399+0000","last_peered":"2024-09-21T06:46:06.022399+0000","last_clean":"2024-09-21T06:46:06.022399+0000","last_became_active":"2024-09-21T06:46:04.658327+0000","last_became_peered":"2024-09-21T06:46:04.658327+0000","last_unstale":"2024-09-21T06:46:06.022399+0000","last_undegraded":"2024-09-21T06:46:06.022399+0000","last_fullsized":"2024-09-21T06:46:06.022399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:47.909007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.649059+0000","last_change":"2024-09-21T06:46:03.643628+0000","last_active":"2024-09-21T06:46:03.649059+0000","last_peered":"2024-09-21T06:46:03.649059+0000","last_clean":"2024-09-21T06:46:03.649059+0000","last_became_active":"2024-09-21T06:46:03.643306+0000","last_became_peered":"2024-09-21T06:46:03.643306+0000","last_unstale":"2024-09-21T06:46:03.649059+0000","last_undegraded":"2024-09-21T06:46:03.649059+0000","last_fullsized":"2024-09-21T06:46:03.649059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:59.156059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634286+0000","last_change":"2024-09-21T06:46:03.634286+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634286+0000","last_undegraded":"2024-09-21T06:46:03.634286+0000","last_fullsized":"2024-09-21T06:46:03.634286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653217+0000","last_change":"2024-09-21T06:46:03.646712+0000","last_active":"2024-09-21T06:46:03.653217+0000","last_peered":"2024-09-21T06:46:03.653217+0000","last_clean":"2024-09-21T06:46:03.653217+0000","last_became_active":"2024-09-21T06:46:03.646413+0000","last_became_peered":"2024-09-21T06:46:03.646413+0000","last_unstale":"2024-09-21T06:46:03.653217+0000","last_undegraded":"2024-09-21T06:46:03.653217+0000","last_fullsized":"2024-09-21T06:46:03.653217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:13.485574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634145+0000","last_change":"2024-09-21T06:46:03.634145+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634145+0000","last_undegraded":"2024-09-21T06:46:03.634145+0000","last_fullsized":"2024-09-21T06:46:03.634145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021694+0000","last_change":"2024-09-21T06:46:03.651000+0000","last_active":"2024-09-21T06:46:06.021694+0000","last_peered":"2024-09-21T06:46:06.021694+0000","last_clean":"2024-09-21T06:46:06.021694+0000","last_became_active":"2024-09-21T06:46:03.650667+0000","last_became_peered":"2024-09-21T06:46:03.650667+0000","last_unstale":"2024-09-21T06:46:06.021694+0000","last_undegraded":"2024-09-21T06:46:06.021694+0000","last_fullsized":"2024-09-21T06:46:06.021694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:57.914977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651472+0000","last_change":"2024-09-21T06:46:04.655207+0000","last_active":"2024-09-21T06:46:05.651472+0000","last_peered":"2024-09-21T06:46:05.651472+0000","last_clean":"2024-09-21T06:46:05.651472+0000","last_became_active":"2024-09-21T06:46:04.654864+0000","last_became_peered":"2024-09-21T06:46:04.654864+0000","last_unstale":"2024-09-21T06:46:05.651472+0000","last_undegraded":"2024-09-21T06:46:05.651472+0000","last_fullsized":"2024-09-21T06:46:05.651472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:41.749439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.650828+0000","last_change":"2024-09-21T06:46:03.641140+0000","last_active":"2024-09-21T06:46:05.650828+0000","last_peered":"2024-09-21T06:46:05.650828+0000","last_clean":"2024-09-21T06:46:05.650828+0000","last_became_active":"2024-09-21T06:46:03.640811+0000","last_became_peered":"2024-09-21T06:46:03.640811+0000","last_unstale":"2024-09-21T06:46:05.650828+0000","last_undegraded":"2024-09-21T06:46:05.650828+0000","last_fullsized":"2024-09-21T06:46:05.650828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:18.235509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640692+0000","last_change":"2024-09-21T06:46:03.640692+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640692+0000","last_undegraded":"2024-09-21T06:46:03.640692+0000","last_fullsized":"2024-09-21T06:46:03.640692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651028+0000","last_change":"2024-09-21T06:46:03.640499+0000","last_active":"2024-09-21T06:46:05.651028+0000","last_peered":"2024-09-21T06:46:05.651028+0000","last_clean":"2024-09-21T06:46:05.651028+0000","last_became_active":"2024-09-21T06:46:03.640205+0000","last_became_peered":"2024-09-21T06:46:03.640205+0000","last_unstale":"2024-09-21T06:46:05.651028+0000","last_undegraded":"2024-09-21T06:46:05.651028+0000","last_fullsized":"2024-09-21T06:46:05.651028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:34.540855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651938+0000","last_change":"2024-09-21T06:46:04.667436+0000","last_active":"2024-09-21T06:46:05.651938+0000","last_peered":"2024-09-21T06:46:05.651938+0000","last_clean":"2024-09-21T06:46:05.651938+0000","last_became_active":"2024-09-21T06:46:04.667136+0000","last_became_peered":"2024-09-21T06:46:04.667136+0000","last_unstale":"2024-09-21T06:46:05.651938+0000","last_undegraded":"2024-09-21T06:46:05.651938+0000","last_fullsized":"2024-09-21T06:46:05.651938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:55.347574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022157+0000","last_change":"2024-09-21T06:46:03.650652+0000","last_active":"2024-09-21T06:46:06.022157+0000","last_peered":"2024-09-21T06:46:06.022157+0000","last_clean":"2024-09-21T06:46:06.022157+0000","last_became_active":"2024-09-21T06:46:03.650301+0000","last_became_peered":"2024-09-21T06:46:03.650301+0000","last_unstale":"2024-09-21T06:46:06.022157+0000","last_undegraded":"2024-09-21T06:46:06.022157+0000","last_fullsized":"2024-09-21T06:46:06.022157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:15.761508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.637092+0000","last_change":"2024-09-21T06:46:03.637092+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.637092+0000","last_undegraded":"2024-09-21T06:46:03.637092+0000","last_fullsized":"2024-09-21T06:46:03.637092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.648980+0000","last_change":"2024-09-21T06:46:03.643663+0000","last_active":"2024-09-21T06:46:03.648980+0000","last_peered":"2024-09-21T06:46:03.648980+0000","last_clean":"2024-09-21T06:46:03.648980+0000","last_became_active":"2024-09-21T06:46:03.643355+0000","last_became_peered":"2024-09-21T06:46:03.643355+0000","last_unstale":"2024-09-21T06:46:03.648980+0000","last_undegraded":"2024-09-21T06:46:03.648980+0000","last_fullsized":"2024-09-21T06:46:03.648980+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:40.496962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651882+0000","last_change":"2024-09-21T06:46:04.666300+0000","last_active":"2024-09-21T06:46:05.651882+0000","last_peered":"2024-09-21T06:46:05.651882+0000","last_clean":"2024-09-21T06:46:05.651882+0000","last_became_active":"2024-09-21T06:46:04.665888+0000","last_became_peered":"2024-09-21T06:46:04.665888+0000","last_unstale":"2024-09-21T06:46:05.651882+0000","last_undegraded":"2024-09-21T06:46:05.651882+0000","last_fullsized":"2024-09-21T06:46:05.651882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:10.919709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021264+0000","last_change":"2024-09-21T06:46:03.648142+0000","last_active":"2024-09-21T06:46:06.021264+0000","last_peered":"2024-09-21T06:46:06.021264+0000","last_clean":"2024-09-21T06:46:06.021264+0000","last_became_active":"2024-09-21T06:46:03.647606+0000","last_became_peered":"2024-09-21T06:46:03.647606+0000","last_unstale":"2024-09-21T06:46:06.021264+0000","last_undegraded":"2024-09-21T06:46:06.021264+0000","last_fullsized":"2024-09-21T06:46:06.021264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021769+0000","last_change":"2024-09-21T06:46:04.642387+0000","last_active":"2024-09-21T06:46:06.021769+0000","last_peered":"2024-09-21T06:46:06.021769+0000","last_clean":"2024-09-21T06:46:06.021769+0000","last_became_active":"2024-09-21T06:46:04.642071+0000","last_became_peered":"2024-09-21T06:46:04.642071+0000","last_unstale":"2024-09-21T06:46:06.021769+0000","last_undegraded":"2024-09-21T06:46:06.021769+0000","last_fullsized":"2024-09-21T06:46:06.021769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:25.785034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653732+0000","last_change":"2024-09-21T06:46:03.652711+0000","last_active":"2024-09-21T06:46:03.653732+0000","last_peered":"2024-09-21T06:46:03.653732+0000","last_clean":"2024-09-21T06:46:03.653732+0000","last_became_active":"2024-09-21T06:46:03.652296+0000","last_became_peered":"2024-09-21T06:46:03.652296+0000","last_unstale":"2024-09-21T06:46:03.653732+0000","last_undegraded":"2024-09-21T06:46:03.653732+0000","last_fullsized":"2024-09-21T06:46:03.653732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:46.504084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.636335+0000","last_change":"2024-09-21T06:46:03.636335+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.636335+0000","last_undegraded":"2024-09-21T06:46:03.636335+0000","last_fullsized":"2024-09-21T06:46:03.636335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021469+0000","last_change":"2024-09-21T06:46:03.643980+0000","last_active":"2024-09-21T06:46:06.021469+0000","last_peered":"2024-09-21T06:46:06.021469+0000","last_clean":"2024-09-21T06:46:06.021469+0000","last_became_active":"2024-09-21T06:46:03.643648+0000","last_became_peered":"2024-09-21T06:46:03.643648+0000","last_unstale":"2024-09-21T06:46:06.021469+0000","last_undegraded":"2024-09-21T06:46:06.021469+0000","last_fullsized":"2024-09-21T06:46:06.021469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:59.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651361+0000","last_change":"2024-09-21T06:46:04.656420+0000","last_active":"2024-09-21T06:46:05.651361+0000","last_peered":"2024-09-21T06:46:05.651361+0000","last_clean":"2024-09-21T06:46:05.651361+0000","last_became_active":"2024-09-21T06:46:04.656113+0000","last_became_peered":"2024-09-21T06:46:04.656113+0000","last_unstale":"2024-09-21T06:46:05.651361+0000","last_undegraded":"2024-09-21T06:46:05.651361+0000","last_fullsized":"2024-09-21T06:46:05.651361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:58.937793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021830+0000","last_change":"2024-09-21T06:46:03.647357+0000","last_active":"2024-09-21T06:46:06.021830+0000","last_peered":"2024-09-21T06:46:06.021830+0000","last_clean":"2024-09-21T06:46:06.021830+0000","last_became_active":"2024-09-21T06:46:03.647005+0000","last_became_peered":"2024-09-21T06:46:03.647005+0000","last_unstale":"2024-09-21T06:46:06.021830+0000","last_undegraded":"2024-09-21T06:46:06.021830+0000","last_fullsized":"2024-09-21T06:46:06.021830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:12.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021169+0000","last_change":"2024-09-21T06:46:04.656652+0000","last_active":"2024-09-21T06:46:06.021169+0000","last_peered":"2024-09-21T06:46:06.021169+0000","last_clean":"2024-09-21T06:46:06.021169+0000","last_became_active":"2024-09-21T06:46:04.656322+0000","last_became_peered":"2024-09-21T06:46:04.656322+0000","last_unstale":"2024-09-21T06:46:06.021169+0000","last_undegraded":"2024-09-21T06:46:06.021169+0000","last_fullsized":"2024-09-21T06:46:06.021169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:20.501586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652019+0000","last_change":"2024-09-21T06:46:03.649908+0000","last_active":"2024-09-21T06:46:05.652019+0000","last_peered":"2024-09-21T06:46:05.652019+0000","last_clean":"2024-09-21T06:46:05.652019+0000","last_became_active":"2024-09-21T06:46:03.649595+0000","last_became_peered":"2024-09-21T06:46:03.649595+0000","last_unstale":"2024-09-21T06:46:05.652019+0000","last_undegraded":"2024-09-21T06:46:05.652019+0000","last_fullsized":"2024-09-21T06:46:05.652019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:26.657306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022261+0000","last_change":"2024-09-21T06:46:04.665360+0000","last_active":"2024-09-21T06:46:06.022261+0000","last_peered":"2024-09-21T06:46:06.022261+0000","last_clean":"2024-09-21T06:46:06.022261+0000","last_became_active":"2024-09-21T06:46:04.663777+0000","last_became_peered":"2024-09-21T06:46:04.663777+0000","last_unstale":"2024-09-21T06:46:06.022261+0000","last_undegraded":"2024-09-21T06:46:06.022261+0000","last_fullsized":"2024-09-21T06:46:06.022261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:07.180410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653629+0000","last_change":"2024-09-21T06:46:03.650579+0000","last_active":"2024-09-21T06:46:03.653629+0000","last_peered":"2024-09-21T06:46:03.653629+0000","last_clean":"2024-09-21T06:46:03.653629+0000","last_became_active":"2024-09-21T06:46:03.650243+0000","last_became_peered":"2024-09-21T06:46:03.650243+0000","last_unstale":"2024-09-21T06:46:03.653629+0000","last_undegraded":"2024-09-21T06:46:03.653629+0000","last_fullsized":"2024-09-21T06:46:03.653629+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:12.738279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.640108+0000","last_change":"2024-09-21T06:46:03.640108+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.640108+0000","last_undegraded":"2024-09-21T06:46:03.640108+0000","last_fullsized":"2024-09-21T06:46:03.640108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653754+0000","last_change":"2024-09-21T06:46:03.652588+0000","last_active":"2024-09-21T06:46:03.653754+0000","last_peered":"2024-09-21T06:46:03.653754+0000","last_clean":"2024-09-21T06:46:03.653754+0000","last_became_active":"2024-09-21T06:46:03.652237+0000","last_became_peered":"2024-09-21T06:46:03.652237+0000","last_unstale":"2024-09-21T06:46:03.653754+0000","last_undegraded":"2024-09-21T06:46:03.653754+0000","last_fullsized":"2024-09-21T06:46:03.653754+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.139777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.634844+0000","last_change":"2024-09-21T06:46:03.634844+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.634844+0000","last_undegraded":"2024-09-21T06:46:03.634844+0000","last_fullsized":"2024-09-21T06:46:03.634844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652543+0000","last_change":"2024-09-21T06:46:03.650389+0000","last_active":"2024-09-21T06:46:05.652543+0000","last_peered":"2024-09-21T06:46:05.652543+0000","last_clean":"2024-09-21T06:46:05.652543+0000","last_became_active":"2024-09-21T06:46:03.650078+0000","last_became_peered":"2024-09-21T06:46:03.650078+0000","last_unstale":"2024-09-21T06:46:05.652543+0000","last_undegraded":"2024-09-21T06:46:05.652543+0000","last_fullsized":"2024-09-21T06:46:05.652543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:19.252522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-21T06:46:03.643110+0000","last_change":"2024-09-21T06:46:03.643110+0000","last_active":"2024-09-21T06:46:03.622420+0000","last_peered":"2024-09-21T06:46:03.622420+0000","last_clean":"2024-09-21T06:46:03.622420+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:03.643110+0000","last_undegraded":"2024-09-21T06:46:03.643110+0000","last_fullsized":"2024-09-21T06:46:03.643110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.653849+0000","last_change":"2024-09-21T06:46:03.651097+0000","last_active":"2024-09-21T06:46:03.653849+0000","last_peered":"2024-09-21T06:46:03.653849+0000","last_clean":"2024-09-21T06:46:03.653849+0000","last_became_active":"2024-09-21T06:46:03.650544+0000","last_became_peered":"2024-09-21T06:46:03.650544+0000","last_unstale":"2024-09-21T06:46:03.653849+0000","last_undegraded":"2024-09-21T06:46:03.653849+0000","last_fullsized":"2024-09-21T06:46:03.653849+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:40.871830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-21T06:46:03.630375+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:03.630375+0000","last_peered":"2024-09-21T06:46:03.630375+0000","last_clean":"2024-09-21T06:46:03.630375+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:03.630375+0000","last_undegraded":"2024-09-21T06:46:03.630375+0000","last_fullsized":"2024-09-21T06:46:03.630375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":751620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":161252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":181848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":181812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1028096,"data_stored":772728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":183514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:12.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:12.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 -- 172.21.15.81:0/3959690444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700b9c00 msgr2=0x7f02700d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:12.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 --2- 172.21.15.81:0/3959690444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700b9c00 0x7f02700d41a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0268005fd0 tx=0x7f026802a8b0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 -- 172.21.15.81:0/3959690444 shutdown_connections 2024-09-21T06:46:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 --2- 172.21.15.81:0/3959690444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700b9c00 0x7f02700d41a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 --2- 172.21.15.81:0/3959690444 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f02700d3220 0x7f02700b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 -- 172.21.15.81:0/3959690444 >> 172.21.15.81:0/3959690444 conn(0x7f02700b7330 msgr2=0x7f02700b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 -- 172.21.15.81:0/3959690444 shutdown_connections 2024-09-21T06:46:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.635+0000 7f0275394640 1 -- 172.21.15.81:0/3959690444 wait complete. 2024-09-21T06:46:12.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.637+0000 7f0275394640 1 Processor -- start 2024-09-21T06:46:12.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.637+0000 7f0275394640 1 -- start start 2024-09-21T06:46:12.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f0275394640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02700b9c00 0x7f02700b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f0275394640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700d3220 0x7f02701f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f0275394640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f027015c450 0x7f027006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f0275394640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02700b35c0 con 0x7f02700b9c00 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f0275394640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f02700b3440 con 0x7f02700d3220 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f0275394640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f02700b3740 con 0x7f027015c450 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f026effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02700b9c00 0x7f02700b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f026effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02700b9c00 0x7f02700b6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56746/0 (socket says 172.21.15.81:56746) 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f026effd640 1 -- 172.21.15.81:0/852839506 learned_addr learned my addr 172.21.15.81:0/852839506 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f02667fc640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700d3220 0x7f02701f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.638+0000 7f026f7fe640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f027015c450 0x7f027006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f026effd640 1 -- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f027015c450 msgr2=0x7f027006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:12.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f026effd640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f027015c450 0x7f027006eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f026effd640 1 -- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700d3220 msgr2=0x7f02701f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f026effd640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700d3220 0x7f02701f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f026effd640 1 -- 172.21.15.81:0/852839506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02700cdf40 con 0x7f02700b9c00 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f026effd640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02700b9c00 0x7f02700b6840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f026000c370 tx=0x7f026000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f0267fff640 1 -- 172.21.15.81:0/852839506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260017070 con 0x7f02700b9c00 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f0267fff640 1 -- 172.21.15.81:0/852839506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02600053c0 con 0x7f02700b9c00 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f0267fff640 1 -- 172.21.15.81:0/852839506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260003850 con 0x7f02700b9c00 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02700ce220 con 0x7f02700b9c00 2024-09-21T06:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.639+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02700cb5c0 con 0x7f02700b9c00 2024-09-21T06:46:12.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.640+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0270074890 con 0x7f02700b9c00 2024-09-21T06:46:12.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.641+0000 7f0267fff640 1 -- 172.21.15.81:0/852839506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f026001a070 con 0x7f02700b9c00 2024-09-21T06:46:12.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.641+0000 7f0267fff640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0250078bc0 0x7f025007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:12.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.641+0000 7f0267fff640 1 -- 172.21.15.81:0/852839506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f026009a110 con 0x7f02700b9c00 2024-09-21T06:46:12.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.642+0000 7f02667fc640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0250078bc0 0x7f025007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:12.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.642+0000 7f02667fc640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0250078bc0 0x7f025007b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f02700b42b0 tx=0x7f0258009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:12.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.646+0000 7f0267fff640 1 -- 172.21.15.81:0/852839506 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0270074890 con 0x7f02700b9c00 2024-09-21T06:46:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.824+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02700d41a0 con 0x7f0250078bc0 2024-09-21T06:46:12.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.829+0000 7f0267fff640 1 -- 172.21.15.81:0/852839506 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f02700d41a0 con 0x7f0250078bc0 2024-09-21T06:46:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:12.835 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:12.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0250078bc0 msgr2=0x7f025007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0250078bc0 0x7f025007b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f02700b42b0 tx=0x7f0258009260 comp rx=0 tx=0).stop 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02700b9c00 msgr2=0x7f02700b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02700b9c00 0x7f02700b6840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f026000c370 tx=0x7f026000c830 comp rx=0 tx=0).stop 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 shutdown_connections 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0250078bc0 0x7f025007b0d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f027015c450 0x7f027006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f02700d3220 0x7f02701f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 --2- 172.21.15.81:0/852839506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02700b9c00 0x7f02700b6840 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 >> 172.21.15.81:0/852839506 conn(0x7f02700b7330 msgr2=0x7f02700cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 shutdown_connections 2024-09-21T06:46:12.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:12.832+0000 7f0275394640 1 -- 172.21.15.81:0/852839506 wait complete. 2024-09-21T06:46:12.845 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-21T06:46:12.665456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220824,"kb_used_data":4584,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753896,"statfs":{"total":773094113280,"available":772867989504,"internally_reserved":0,"allocated":4694016,"data_stored":2639780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.034052"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651937+0000","last_change":"2024-09-21T06:46:04.653828+0000","last_active":"2024-09-21T06:46:05.651937+0000","last_peered":"2024-09-21T06:46:05.651937+0000","last_clean":"2024-09-21T06:46:05.651937+0000","last_became_active":"2024-09-21T06:46:04.653509+0000","last_became_peered":"2024-09-21T06:46:04.653509+0000","last_unstale":"2024-09-21T06:46:05.651937+0000","last_undegraded":"2024-09-21T06:46:05.651937+0000","last_fullsized":"2024-09-21T06:46:05.651937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:28:22.157120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021625+0000","last_change":"2024-09-21T06:46:04.661867+0000","last_active":"2024-09-21T06:46:06.021625+0000","last_peered":"2024-09-21T06:46:06.021625+0000","last_clean":"2024-09-21T06:46:06.021625+0000","last_became_active":"2024-09-21T06:46:04.661351+0000","last_became_peered":"2024-09-21T06:46:04.661351+0000","last_unstale":"2024-09-21T06:46:06.021625+0000","last_undegraded":"2024-09-21T06:46:06.021625+0000","last_fullsized":"2024-09-21T06:46:06.021625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:11.727185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652680+0000","last_change":"2024-09-21T06:46:04.663927+0000","last_active":"2024-09-21T06:46:05.652680+0000","last_peered":"2024-09-21T06:46:05.652680+0000","last_clean":"2024-09-21T06:46:05.652680+0000","last_became_active":"2024-09-21T06:46:04.663604+0000","last_became_peered":"2024-09-21T06:46:04.663604+0000","last_unstale":"2024-09-21T06:46:05.652680+0000","last_undegraded":"2024-09-21T06:46:05.652680+0000","last_fullsized":"2024-09-21T06:46:05.652680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:38:16.103507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652632+0000","last_change":"2024-09-21T06:46:04.660353+0000","last_active":"2024-09-21T06:46:05.652632+0000","last_peered":"2024-09-21T06:46:05.652632+0000","last_clean":"2024-09-21T06:46:05.652632+0000","last_became_active":"2024-09-21T06:46:04.660017+0000","last_became_peered":"2024-09-21T06:46:04.660017+0000","last_unstale":"2024-09-21T06:46:05.652632+0000","last_undegraded":"2024-09-21T06:46:05.652632+0000","last_fullsized":"2024-09-21T06:46:05.652632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:58.086168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021623+0000","last_change":"2024-09-21T06:46:04.648697+0000","last_active":"2024-09-21T06:46:06.021623+0000","last_peered":"2024-09-21T06:46:06.021623+0000","last_clean":"2024-09-21T06:46:06.021623+0000","last_became_active":"2024-09-21T06:46:04.648378+0000","last_became_peered":"2024-09-21T06:46:04.648378+0000","last_unstale":"2024-09-21T06:46:06.021623+0000","last_undegraded":"2024-09-21T06:46:06.021623+0000","last_fullsized":"2024-09-21T06:46:06.021623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:27.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022222+0000","last_change":"2024-09-21T06:46:04.661899+0000","last_active":"2024-09-21T06:46:06.022222+0000","last_peered":"2024-09-21T06:46:06.022222+0000","last_clean":"2024-09-21T06:46:06.022222+0000","last_became_active":"2024-09-21T06:46:04.661469+0000","last_became_peered":"2024-09-21T06:46:04.661469+0000","last_unstale":"2024-09-21T06:46:06.022222+0000","last_undegraded":"2024-09-21T06:46:06.022222+0000","last_fullsized":"2024-09-21T06:46:06.022222+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:15.051574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021266+0000","last_change":"2024-09-21T06:46:04.645406+0000","last_active":"2024-09-21T06:46:06.021266+0000","last_peered":"2024-09-21T06:46:06.021266+0000","last_clean":"2024-09-21T06:46:06.021266+0000","last_became_active":"2024-09-21T06:46:04.645128+0000","last_became_peered":"2024-09-21T06:46:04.645128+0000","last_unstale":"2024-09-21T06:46:06.021266+0000","last_undegraded":"2024-09-21T06:46:06.021266+0000","last_fullsized":"2024-09-21T06:46:06.021266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:32.289889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652150+0000","last_change":"2024-09-21T06:46:04.667034+0000","last_active":"2024-09-21T06:46:05.652150+0000","last_peered":"2024-09-21T06:46:05.652150+0000","last_clean":"2024-09-21T06:46:05.652150+0000","last_became_active":"2024-09-21T06:46:04.666723+0000","last_became_peered":"2024-09-21T06:46:04.666723+0000","last_unstale":"2024-09-21T06:46:05.652150+0000","last_undegraded":"2024-09-21T06:46:05.652150+0000","last_fullsized":"2024-09-21T06:46:05.652150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:31.904136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021812+0000","last_change":"2024-09-21T06:46:04.654275+0000","last_active":"2024-09-21T06:46:06.021812+0000","last_peered":"2024-09-21T06:46:06.021812+0000","last_clean":"2024-09-21T06:46:06.021812+0000","last_became_active":"2024-09-21T06:46:04.653913+0000","last_became_peered":"2024-09-21T06:46:04.653913+0000","last_unstale":"2024-09-21T06:46:06.021812+0000","last_undegraded":"2024-09-21T06:46:06.021812+0000","last_fullsized":"2024-09-21T06:46:06.021812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:02.434425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022081+0000","last_change":"2024-09-21T06:46:04.656925+0000","last_active":"2024-09-21T06:46:06.022081+0000","last_peered":"2024-09-21T06:46:06.022081+0000","last_clean":"2024-09-21T06:46:06.022081+0000","last_became_active":"2024-09-21T06:46:04.656650+0000","last_became_peered":"2024-09-21T06:46:04.656650+0000","last_unstale":"2024-09-21T06:46:06.022081+0000","last_undegraded":"2024-09-21T06:46:06.022081+0000","last_fullsized":"2024-09-21T06:46:06.022081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:19.238812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.023081+0000","last_change":"2024-09-21T06:46:04.652750+0000","last_active":"2024-09-21T06:46:06.023081+0000","last_peered":"2024-09-21T06:46:06.023081+0000","last_clean":"2024-09-21T06:46:06.023081+0000","last_became_active":"2024-09-21T06:46:04.652455+0000","last_became_peered":"2024-09-21T06:46:04.652455+0000","last_unstale":"2024-09-21T06:46:06.023081+0000","last_undegraded":"2024-09-21T06:46:06.023081+0000","last_fullsized":"2024-09-21T06:46:06.023081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:41.797695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021385+0000","last_change":"2024-09-21T06:46:04.659857+0000","last_active":"2024-09-21T06:46:06.021385+0000","last_peered":"2024-09-21T06:46:06.021385+0000","last_clean":"2024-09-21T06:46:06.021385+0000","last_became_active":"2024-09-21T06:46:04.659546+0000","last_became_peered":"2024-09-21T06:46:04.659546+0000","last_unstale":"2024-09-21T06:46:06.021385+0000","last_undegraded":"2024-09-21T06:46:06.021385+0000","last_fullsized":"2024-09-21T06:46:06.021385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:28.070646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021492+0000","last_change":"2024-09-21T06:46:04.665184+0000","last_active":"2024-09-21T06:46:06.021492+0000","last_peered":"2024-09-21T06:46:06.021492+0000","last_clean":"2024-09-21T06:46:06.021492+0000","last_became_active":"2024-09-21T06:46:04.664894+0000","last_became_peered":"2024-09-21T06:46:04.664894+0000","last_unstale":"2024-09-21T06:46:06.021492+0000","last_undegraded":"2024-09-21T06:46:06.021492+0000","last_fullsized":"2024-09-21T06:46:06.021492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:01.651989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.654275+0000","last_change":"2024-09-21T06:46:04.657132+0000","last_active":"2024-09-21T06:46:05.654275+0000","last_peered":"2024-09-21T06:46:05.654275+0000","last_clean":"2024-09-21T06:46:05.654275+0000","last_became_active":"2024-09-21T06:46:04.656813+0000","last_became_peered":"2024-09-21T06:46:04.656813+0000","last_unstale":"2024-09-21T06:46:05.654275+0000","last_undegraded":"2024-09-21T06:46:05.654275+0000","last_fullsized":"2024-09-21T06:46:05.654275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:37.955133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021622+0000","last_change":"2024-09-21T06:46:04.665994+0000","last_active":"2024-09-21T06:46:06.021622+0000","last_peered":"2024-09-21T06:46:06.021622+0000","last_clean":"2024-09-21T06:46:06.021622+0000","last_became_active":"2024-09-21T06:46:04.665029+0000","last_became_peered":"2024-09-21T06:46:04.665029+0000","last_unstale":"2024-09-21T06:46:06.021622+0000","last_undegraded":"2024-09-21T06:46:06.021622+0000","last_fullsized":"2024-09-21T06:46:06.021622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:43.842401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022032+0000","last_change":"2024-09-21T06:46:04.659354+0000","last_active":"2024-09-21T06:46:06.022032+0000","last_peered":"2024-09-21T06:46:06.022032+0000","last_clean":"2024-09-21T06:46:06.022032+0000","last_became_active":"2024-09-21T06:46:04.659061+0000","last_became_peered":"2024-09-21T06:46:04.659061+0000","last_unstale":"2024-09-21T06:46:06.022032+0000","last_undegraded":"2024-09-21T06:46:06.022032+0000","last_fullsized":"2024-09-21T06:46:06.022032+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:09.386020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021993+0000","last_change":"2024-09-21T06:46:04.655835+0000","last_active":"2024-09-21T06:46:06.021993+0000","last_peered":"2024-09-21T06:46:06.021993+0000","last_clean":"2024-09-21T06:46:06.021993+0000","last_became_active":"2024-09-21T06:46:04.655531+0000","last_became_peered":"2024-09-21T06:46:04.655531+0000","last_unstale":"2024-09-21T06:46:06.021993+0000","last_undegraded":"2024-09-21T06:46:06.021993+0000","last_fullsized":"2024-09-21T06:46:06.021993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:44.246983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022251+0000","last_change":"2024-09-21T06:46:04.647908+0000","last_active":"2024-09-21T06:46:06.022251+0000","last_peered":"2024-09-21T06:46:06.022251+0000","last_clean":"2024-09-21T06:46:06.022251+0000","last_became_active":"2024-09-21T06:46:04.647604+0000","last_became_peered":"2024-09-21T06:46:04.647604+0000","last_unstale":"2024-09-21T06:46:06.022251+0000","last_undegraded":"2024-09-21T06:46:06.022251+0000","last_fullsized":"2024-09-21T06:46:06.022251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:22.429969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651166+0000","last_change":"2024-09-21T06:46:04.658383+0000","last_active":"2024-09-21T06:46:05.651166+0000","last_peered":"2024-09-21T06:46:05.651166+0000","last_clean":"2024-09-21T06:46:05.651166+0000","last_became_active":"2024-09-21T06:46:04.657091+0000","last_became_peered":"2024-09-21T06:46:04.657091+0000","last_unstale":"2024-09-21T06:46:05.651166+0000","last_undegraded":"2024-09-21T06:46:05.651166+0000","last_fullsized":"2024-09-21T06:46:05.651166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.983526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022557+0000","last_change":"2024-09-21T06:46:04.650532+0000","last_active":"2024-09-21T06:46:06.022557+0000","last_peered":"2024-09-21T06:46:06.022557+0000","last_clean":"2024-09-21T06:46:06.022557+0000","last_became_active":"2024-09-21T06:46:04.650203+0000","last_became_peered":"2024-09-21T06:46:04.650203+0000","last_unstale":"2024-09-21T06:46:06.022557+0000","last_undegraded":"2024-09-21T06:46:06.022557+0000","last_fullsized":"2024-09-21T06:46:06.022557+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:26.127375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022533+0000","last_change":"2024-09-21T06:46:04.656788+0000","last_active":"2024-09-21T06:46:06.022533+0000","last_peered":"2024-09-21T06:46:06.022533+0000","last_clean":"2024-09-21T06:46:06.022533+0000","last_became_active":"2024-09-21T06:46:04.656510+0000","last_became_peered":"2024-09-21T06:46:04.656510+0000","last_unstale":"2024-09-21T06:46:06.022533+0000","last_undegraded":"2024-09-21T06:46:06.022533+0000","last_fullsized":"2024-09-21T06:46:06.022533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:14.488876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022653+0000","last_change":"2024-09-21T06:46:04.663037+0000","last_active":"2024-09-21T06:46:06.022653+0000","last_peered":"2024-09-21T06:46:06.022653+0000","last_clean":"2024-09-21T06:46:06.022653+0000","last_became_active":"2024-09-21T06:46:04.662729+0000","last_became_peered":"2024-09-21T06:46:04.662729+0000","last_unstale":"2024-09-21T06:46:06.022653+0000","last_undegraded":"2024-09-21T06:46:06.022653+0000","last_fullsized":"2024-09-21T06:46:06.022653+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:03.444739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021825+0000","last_change":"2024-09-21T06:46:04.657745+0000","last_active":"2024-09-21T06:46:06.021825+0000","last_peered":"2024-09-21T06:46:06.021825+0000","last_clean":"2024-09-21T06:46:06.021825+0000","last_became_active":"2024-09-21T06:46:04.657463+0000","last_became_peered":"2024-09-21T06:46:04.657463+0000","last_unstale":"2024-09-21T06:46:06.021825+0000","last_undegraded":"2024-09-21T06:46:06.021825+0000","last_fullsized":"2024-09-21T06:46:06.021825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:49:26.586630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652114+0000","last_change":"2024-09-21T06:46:04.658260+0000","last_active":"2024-09-21T06:46:05.652114+0000","last_peered":"2024-09-21T06:46:05.652114+0000","last_clean":"2024-09-21T06:46:05.652114+0000","last_became_active":"2024-09-21T06:46:04.657919+0000","last_became_peered":"2024-09-21T06:46:04.657919+0000","last_unstale":"2024-09-21T06:46:05.652114+0000","last_undegraded":"2024-09-21T06:46:05.652114+0000","last_fullsized":"2024-09-21T06:46:05.652114+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:29.074983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.654286+0000","last_change":"2024-09-21T06:46:04.659890+0000","last_active":"2024-09-21T06:46:05.654286+0000","last_peered":"2024-09-21T06:46:05.654286+0000","last_clean":"2024-09-21T06:46:05.654286+0000","last_became_active":"2024-09-21T06:46:04.659569+0000","last_became_peered":"2024-09-21T06:46:04.659569+0000","last_unstale":"2024-09-21T06:46:05.654286+0000","last_undegraded":"2024-09-21T06:46:05.654286+0000","last_fullsized":"2024-09-21T06:46:05.654286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:36.771522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651964+0000","last_change":"2024-09-21T06:46:04.654047+0000","last_active":"2024-09-21T06:46:05.651964+0000","last_peered":"2024-09-21T06:46:05.651964+0000","last_clean":"2024-09-21T06:46:05.651964+0000","last_became_active":"2024-09-21T06:46:04.653726+0000","last_became_peered":"2024-09-21T06:46:04.653726+0000","last_unstale":"2024-09-21T06:46:05.651964+0000","last_undegraded":"2024-09-21T06:46:05.651964+0000","last_fullsized":"2024-09-21T06:46:05.651964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:24.218374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.023287+0000","last_change":"2024-09-21T06:46:04.646467+0000","last_active":"2024-09-21T06:46:06.023287+0000","last_peered":"2024-09-21T06:46:06.023287+0000","last_clean":"2024-09-21T06:46:06.023287+0000","last_became_active":"2024-09-21T06:46:04.646176+0000","last_became_peered":"2024-09-21T06:46:04.646176+0000","last_unstale":"2024-09-21T06:46:06.023287+0000","last_undegraded":"2024-09-21T06:46:06.023287+0000","last_fullsized":"2024-09-21T06:46:06.023287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:54.701222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022077+0000","last_change":"2024-09-21T06:46:04.658468+0000","last_active":"2024-09-21T06:46:06.022077+0000","last_peered":"2024-09-21T06:46:06.022077+0000","last_clean":"2024-09-21T06:46:06.022077+0000","last_became_active":"2024-09-21T06:46:04.658155+0000","last_became_peered":"2024-09-21T06:46:04.658155+0000","last_unstale":"2024-09-21T06:46:06.022077+0000","last_undegraded":"2024-09-21T06:46:06.022077+0000","last_fullsized":"2024-09-21T06:46:06.022077+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:36.149260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021134+0000","last_change":"2024-09-21T06:46:04.653889+0000","last_active":"2024-09-21T06:46:06.021134+0000","last_peered":"2024-09-21T06:46:06.021134+0000","last_clean":"2024-09-21T06:46:06.021134+0000","last_became_active":"2024-09-21T06:46:04.653591+0000","last_became_peered":"2024-09-21T06:46:04.653591+0000","last_unstale":"2024-09-21T06:46:06.021134+0000","last_undegraded":"2024-09-21T06:46:06.021134+0000","last_fullsized":"2024-09-21T06:46:06.021134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:12.737289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022387+0000","last_change":"2024-09-21T06:46:04.654732+0000","last_active":"2024-09-21T06:46:06.022387+0000","last_peered":"2024-09-21T06:46:06.022387+0000","last_clean":"2024-09-21T06:46:06.022387+0000","last_became_active":"2024-09-21T06:46:04.654034+0000","last_became_peered":"2024-09-21T06:46:04.654034+0000","last_unstale":"2024-09-21T06:46:06.022387+0000","last_undegraded":"2024-09-21T06:46:06.022387+0000","last_fullsized":"2024-09-21T06:46:06.022387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.190322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021495+0000","last_change":"2024-09-21T06:46:04.660651+0000","last_active":"2024-09-21T06:46:06.021495+0000","last_peered":"2024-09-21T06:46:06.021495+0000","last_clean":"2024-09-21T06:46:06.021495+0000","last_became_active":"2024-09-21T06:46:04.660353+0000","last_became_peered":"2024-09-21T06:46:04.660353+0000","last_unstale":"2024-09-21T06:46:06.021495+0000","last_undegraded":"2024-09-21T06:46:06.021495+0000","last_fullsized":"2024-09-21T06:46:06.021495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:27.713357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652372+0000","last_change":"2024-09-21T06:46:04.663746+0000","last_active":"2024-09-21T06:46:05.652372+0000","last_peered":"2024-09-21T06:46:05.652372+0000","last_clean":"2024-09-21T06:46:05.652372+0000","last_became_active":"2024-09-21T06:46:04.663442+0000","last_became_peered":"2024-09-21T06:46:04.663442+0000","last_unstale":"2024-09-21T06:46:05.652372+0000","last_undegraded":"2024-09-21T06:46:05.652372+0000","last_fullsized":"2024-09-21T06:46:05.652372+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:34.082130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021478+0000","last_change":"2024-09-21T06:46:04.656029+0000","last_active":"2024-09-21T06:46:06.021478+0000","last_peered":"2024-09-21T06:46:06.021478+0000","last_clean":"2024-09-21T06:46:06.021478+0000","last_became_active":"2024-09-21T06:46:04.655751+0000","last_became_peered":"2024-09-21T06:46:04.655751+0000","last_unstale":"2024-09-21T06:46:06.021478+0000","last_undegraded":"2024-09-21T06:46:06.021478+0000","last_fullsized":"2024-09-21T06:46:06.021478+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:04.064011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.654288+0000","last_change":"2024-09-21T06:46:03.647271+0000","last_active":"2024-09-21T06:46:05.654288+0000","last_peered":"2024-09-21T06:46:05.654288+0000","last_clean":"2024-09-21T06:46:05.654288+0000","last_became_active":"2024-09-21T06:46:03.646987+0000","last_became_peered":"2024-09-21T06:46:03.646987+0000","last_unstale":"2024-09-21T06:46:05.654288+0000","last_undegraded":"2024-09-21T06:46:05.654288+0000","last_fullsized":"2024-09-21T06:46:05.654288+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:24.781731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021604+0000","last_change":"2024-09-21T06:46:04.660925+0000","last_active":"2024-09-21T06:46:06.021604+0000","last_peered":"2024-09-21T06:46:06.021604+0000","last_clean":"2024-09-21T06:46:06.021604+0000","last_became_active":"2024-09-21T06:46:04.660586+0000","last_became_peered":"2024-09-21T06:46:04.660586+0000","last_unstale":"2024-09-21T06:46:06.021604+0000","last_undegraded":"2024-09-21T06:46:06.021604+0000","last_fullsized":"2024-09-21T06:46:06.021604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:26.073993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021594+0000","last_change":"2024-09-21T06:46:03.653877+0000","last_active":"2024-09-21T06:46:06.021594+0000","last_peered":"2024-09-21T06:46:06.021594+0000","last_clean":"2024-09-21T06:46:06.021594+0000","last_became_active":"2024-09-21T06:46:03.653554+0000","last_became_peered":"2024-09-21T06:46:03.653554+0000","last_unstale":"2024-09-21T06:46:06.021594+0000","last_undegraded":"2024-09-21T06:46:06.021594+0000","last_fullsized":"2024-09-21T06:46:06.021594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:23.469489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022151+0000","last_change":"2024-09-21T06:46:04.658125+0000","last_active":"2024-09-21T06:46:06.022151+0000","last_peered":"2024-09-21T06:46:06.022151+0000","last_clean":"2024-09-21T06:46:06.022151+0000","last_became_active":"2024-09-21T06:46:04.655798+0000","last_became_peered":"2024-09-21T06:46:04.655798+0000","last_unstale":"2024-09-21T06:46:06.022151+0000","last_undegraded":"2024-09-21T06:46:06.022151+0000","last_fullsized":"2024-09-21T06:46:06.022151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:16:29.114804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652631+0000","last_change":"2024-09-21T06:46:03.648247+0000","last_active":"2024-09-21T06:46:05.652631+0000","last_peered":"2024-09-21T06:46:05.652631+0000","last_clean":"2024-09-21T06:46:05.652631+0000","last_became_active":"2024-09-21T06:46:03.647153+0000","last_became_peered":"2024-09-21T06:46:03.647153+0000","last_unstale":"2024-09-21T06:46:05.652631+0000","last_undegraded":"2024-09-21T06:46:05.652631+0000","last_fullsized":"2024-09-21T06:46:05.652631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:16.140311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022143+0000","last_change":"2024-09-21T06:46:04.662876+0000","last_active":"2024-09-21T06:46:06.022143+0000","last_peered":"2024-09-21T06:46:06.022143+0000","last_clean":"2024-09-21T06:46:06.022143+0000","last_became_active":"2024-09-21T06:46:04.662576+0000","last_became_peered":"2024-09-21T06:46:04.662576+0000","last_unstale":"2024-09-21T06:46:06.022143+0000","last_undegraded":"2024-09-21T06:46:06.022143+0000","last_fullsized":"2024-09-21T06:46:06.022143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:32.493240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.654105+0000","last_change":"2024-09-21T06:46:03.644181+0000","last_active":"2024-09-21T06:46:05.654105+0000","last_peered":"2024-09-21T06:46:05.654105+0000","last_clean":"2024-09-21T06:46:05.654105+0000","last_became_active":"2024-09-21T06:46:03.643878+0000","last_became_peered":"2024-09-21T06:46:03.643878+0000","last_unstale":"2024-09-21T06:46:05.654105+0000","last_undegraded":"2024-09-21T06:46:05.654105+0000","last_fullsized":"2024-09-21T06:46:05.654105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:26.710054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652393+0000","last_change":"2024-09-21T06:46:04.654929+0000","last_active":"2024-09-21T06:46:05.652393+0000","last_peered":"2024-09-21T06:46:05.652393+0000","last_clean":"2024-09-21T06:46:05.652393+0000","last_became_active":"2024-09-21T06:46:04.654243+0000","last_became_peered":"2024-09-21T06:46:04.654243+0000","last_unstale":"2024-09-21T06:46:05.652393+0000","last_undegraded":"2024-09-21T06:46:05.652393+0000","last_fullsized":"2024-09-21T06:46:05.652393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:18.804337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.654055+0000","last_change":"2024-09-21T06:46:03.641222+0000","last_active":"2024-09-21T06:46:05.654055+0000","last_peered":"2024-09-21T06:46:05.654055+0000","last_clean":"2024-09-21T06:46:05.654055+0000","last_became_active":"2024-09-21T06:46:03.640868+0000","last_became_peered":"2024-09-21T06:46:03.640868+0000","last_unstale":"2024-09-21T06:46:05.654055+0000","last_undegraded":"2024-09-21T06:46:05.654055+0000","last_fullsized":"2024-09-21T06:46:05.654055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:31.286586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021213+0000","last_change":"2024-09-21T06:46:04.645746+0000","last_active":"2024-09-21T06:46:06.021213+0000","last_peered":"2024-09-21T06:46:06.021213+0000","last_clean":"2024-09-21T06:46:06.021213+0000","last_became_active":"2024-09-21T06:46:04.645456+0000","last_became_peered":"2024-09-21T06:46:04.645456+0000","last_unstale":"2024-09-21T06:46:06.021213+0000","last_undegraded":"2024-09-21T06:46:06.021213+0000","last_fullsized":"2024-09-21T06:46:06.021213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:08.446477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021614+0000","last_change":"2024-09-21T06:46:03.646346+0000","last_active":"2024-09-21T06:46:06.021614+0000","last_peered":"2024-09-21T06:46:06.021614+0000","last_clean":"2024-09-21T06:46:06.021614+0000","last_became_active":"2024-09-21T06:46:03.645110+0000","last_became_peered":"2024-09-21T06:46:03.645110+0000","last_unstale":"2024-09-21T06:46:06.021614+0000","last_undegraded":"2024-09-21T06:46:06.021614+0000","last_fullsized":"2024-09-21T06:46:06.021614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:48.647363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022492+0000","last_change":"2024-09-21T06:46:04.655920+0000","last_active":"2024-09-21T06:46:06.022492+0000","last_peered":"2024-09-21T06:46:06.022492+0000","last_clean":"2024-09-21T06:46:06.022492+0000","last_became_active":"2024-09-21T06:46:04.655645+0000","last_became_peered":"2024-09-21T06:46:04.655645+0000","last_unstale":"2024-09-21T06:46:06.022492+0000","last_undegraded":"2024-09-21T06:46:06.022492+0000","last_fullsized":"2024-09-21T06:46:06.022492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:29.627194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651641+0000","last_change":"2024-09-21T06:46:03.653821+0000","last_active":"2024-09-21T06:46:05.651641+0000","last_peered":"2024-09-21T06:46:05.651641+0000","last_clean":"2024-09-21T06:46:05.651641+0000","last_became_active":"2024-09-21T06:46:03.653466+0000","last_became_peered":"2024-09-21T06:46:03.653466+0000","last_unstale":"2024-09-21T06:46:05.651641+0000","last_undegraded":"2024-09-21T06:46:05.651641+0000","last_fullsized":"2024-09-21T06:46:05.651641+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:06.669384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022050+0000","last_change":"2024-09-21T06:46:04.658674+0000","last_active":"2024-09-21T06:46:06.022050+0000","last_peered":"2024-09-21T06:46:06.022050+0000","last_clean":"2024-09-21T06:46:06.022050+0000","last_became_active":"2024-09-21T06:46:04.658375+0000","last_became_peered":"2024-09-21T06:46:04.658375+0000","last_unstale":"2024-09-21T06:46:06.022050+0000","last_undegraded":"2024-09-21T06:46:06.022050+0000","last_fullsized":"2024-09-21T06:46:06.022050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:18.162094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022191+0000","last_change":"2024-09-21T06:46:03.639925+0000","last_active":"2024-09-21T06:46:06.022191+0000","last_peered":"2024-09-21T06:46:06.022191+0000","last_clean":"2024-09-21T06:46:06.022191+0000","last_became_active":"2024-09-21T06:46:03.639624+0000","last_became_peered":"2024-09-21T06:46:03.639624+0000","last_unstale":"2024-09-21T06:46:06.022191+0000","last_undegraded":"2024-09-21T06:46:06.022191+0000","last_fullsized":"2024-09-21T06:46:06.022191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:59.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652525+0000","last_change":"2024-09-21T06:46:04.657543+0000","last_active":"2024-09-21T06:46:05.652525+0000","last_peered":"2024-09-21T06:46:05.652525+0000","last_clean":"2024-09-21T06:46:05.652525+0000","last_became_active":"2024-09-21T06:46:04.656454+0000","last_became_peered":"2024-09-21T06:46:04.656454+0000","last_unstale":"2024-09-21T06:46:05.652525+0000","last_undegraded":"2024-09-21T06:46:05.652525+0000","last_fullsized":"2024-09-21T06:46:05.652525+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.287462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652046+0000","last_change":"2024-09-21T06:46:03.643897+0000","last_active":"2024-09-21T06:46:05.652046+0000","last_peered":"2024-09-21T06:46:05.652046+0000","last_clean":"2024-09-21T06:46:05.652046+0000","last_became_active":"2024-09-21T06:46:03.642845+0000","last_became_peered":"2024-09-21T06:46:03.642845+0000","last_unstale":"2024-09-21T06:46:05.652046+0000","last_undegraded":"2024-09-21T06:46:05.652046+0000","last_fullsized":"2024-09-21T06:46:05.652046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:57.330223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.654208+0000","last_change":"2024-09-21T06:46:04.647039+0000","last_active":"2024-09-21T06:46:05.654208+0000","last_peered":"2024-09-21T06:46:05.654208+0000","last_clean":"2024-09-21T06:46:05.654208+0000","last_became_active":"2024-09-21T06:46:04.646512+0000","last_became_peered":"2024-09-21T06:46:04.646512+0000","last_unstale":"2024-09-21T06:46:05.654208+0000","last_undegraded":"2024-09-21T06:46:05.654208+0000","last_fullsized":"2024-09-21T06:46:05.654208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:07.739824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021599+0000","last_change":"2024-09-21T06:46:03.647428+0000","last_active":"2024-09-21T06:46:06.021599+0000","last_peered":"2024-09-21T06:46:06.021599+0000","last_clean":"2024-09-21T06:46:06.021599+0000","last_became_active":"2024-09-21T06:46:03.647141+0000","last_became_peered":"2024-09-21T06:46:03.647141+0000","last_unstale":"2024-09-21T06:46:06.021599+0000","last_undegraded":"2024-09-21T06:46:06.021599+0000","last_fullsized":"2024-09-21T06:46:06.021599+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:57.867465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652036+0000","last_change":"2024-09-21T06:46:04.654222+0000","last_active":"2024-09-21T06:46:05.652036+0000","last_peered":"2024-09-21T06:46:05.652036+0000","last_clean":"2024-09-21T06:46:05.652036+0000","last_became_active":"2024-09-21T06:46:04.653337+0000","last_became_peered":"2024-09-21T06:46:04.653337+0000","last_unstale":"2024-09-21T06:46:05.652036+0000","last_undegraded":"2024-09-21T06:46:05.652036+0000","last_fullsized":"2024-09-21T06:46:05.652036+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:46:00.246624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021588+0000","last_change":"2024-09-21T06:46:03.652929+0000","last_active":"2024-09-21T06:46:06.021588+0000","last_peered":"2024-09-21T06:46:06.021588+0000","last_clean":"2024-09-21T06:46:06.021588+0000","last_became_active":"2024-09-21T06:46:03.652578+0000","last_became_peered":"2024-09-21T06:46:03.652578+0000","last_unstale":"2024-09-21T06:46:06.021588+0000","last_undegraded":"2024-09-21T06:46:06.021588+0000","last_fullsized":"2024-09-21T06:46:06.021588+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:23.299296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022274+0000","last_change":"2024-09-21T06:46:04.651162+0000","last_active":"2024-09-21T06:46:06.022274+0000","last_peered":"2024-09-21T06:46:06.022274+0000","last_clean":"2024-09-21T06:46:06.022274+0000","last_became_active":"2024-09-21T06:46:04.650789+0000","last_became_peered":"2024-09-21T06:46:04.650789+0000","last_unstale":"2024-09-21T06:46:06.022274+0000","last_undegraded":"2024-09-21T06:46:06.022274+0000","last_fullsized":"2024-09-21T06:46:06.022274+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:05:37.955133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652605+0000","last_change":"2024-09-21T06:46:03.645602+0000","last_active":"2024-09-21T06:46:05.652605+0000","last_peered":"2024-09-21T06:46:05.652605+0000","last_clean":"2024-09-21T06:46:05.652605+0000","last_became_active":"2024-09-21T06:46:03.645130+0000","last_became_peered":"2024-09-21T06:46:03.645130+0000","last_unstale":"2024-09-21T06:46:05.652605+0000","last_undegraded":"2024-09-21T06:46:05.652605+0000","last_fullsized":"2024-09-21T06:46:05.652605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:13:25.387037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652654+0000","last_change":"2024-09-21T06:46:04.659242+0000","last_active":"2024-09-21T06:46:05.652654+0000","last_peered":"2024-09-21T06:46:05.652654+0000","last_clean":"2024-09-21T06:46:05.652654+0000","last_became_active":"2024-09-21T06:46:04.657419+0000","last_became_peered":"2024-09-21T06:46:04.657419+0000","last_unstale":"2024-09-21T06:46:05.652654+0000","last_undegraded":"2024-09-21T06:46:05.652654+0000","last_fullsized":"2024-09-21T06:46:05.652654+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:18.015872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651737+0000","last_change":"2024-09-21T06:46:03.649916+0000","last_active":"2024-09-21T06:46:05.651737+0000","last_peered":"2024-09-21T06:46:05.651737+0000","last_clean":"2024-09-21T06:46:05.651737+0000","last_became_active":"2024-09-21T06:46:03.649612+0000","last_became_peered":"2024-09-21T06:46:03.649612+0000","last_unstale":"2024-09-21T06:46:05.651737+0000","last_undegraded":"2024-09-21T06:46:05.651737+0000","last_fullsized":"2024-09-21T06:46:05.651737+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:10.350057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022147+0000","last_change":"2024-09-21T06:46:04.659602+0000","last_active":"2024-09-21T06:46:06.022147+0000","last_peered":"2024-09-21T06:46:06.022147+0000","last_clean":"2024-09-21T06:46:06.022147+0000","last_became_active":"2024-09-21T06:46:04.659302+0000","last_became_peered":"2024-09-21T06:46:04.659302+0000","last_unstale":"2024-09-21T06:46:06.022147+0000","last_undegraded":"2024-09-21T06:46:06.022147+0000","last_fullsized":"2024-09-21T06:46:06.022147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:42.004616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022075+0000","last_change":"2024-09-21T06:46:03.652325+0000","last_active":"2024-09-21T06:46:06.022075+0000","last_peered":"2024-09-21T06:46:06.022075+0000","last_clean":"2024-09-21T06:46:06.022075+0000","last_became_active":"2024-09-21T06:46:03.651992+0000","last_became_peered":"2024-09-21T06:46:03.651992+0000","last_unstale":"2024-09-21T06:46:06.022075+0000","last_undegraded":"2024-09-21T06:46:06.022075+0000","last_fullsized":"2024-09-21T06:46:06.022075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:57:40.054085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022875+0000","last_change":"2024-09-21T06:46:04.645729+0000","last_active":"2024-09-21T06:46:06.022875+0000","last_peered":"2024-09-21T06:46:06.022875+0000","last_clean":"2024-09-21T06:46:06.022875+0000","last_became_active":"2024-09-21T06:46:04.645412+0000","last_became_peered":"2024-09-21T06:46:04.645412+0000","last_unstale":"2024-09-21T06:46:06.022875+0000","last_undegraded":"2024-09-21T06:46:06.022875+0000","last_fullsized":"2024-09-21T06:46:06.022875+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:07.893336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022033+0000","last_change":"2024-09-21T06:46:03.650829+0000","last_active":"2024-09-21T06:46:06.022033+0000","last_peered":"2024-09-21T06:46:06.022033+0000","last_clean":"2024-09-21T06:46:06.022033+0000","last_became_active":"2024-09-21T06:46:03.650489+0000","last_became_peered":"2024-09-21T06:46:03.650489+0000","last_unstale":"2024-09-21T06:46:06.022033+0000","last_undegraded":"2024-09-21T06:46:06.022033+0000","last_fullsized":"2024-09-21T06:46:06.022033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:40.794392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021401+0000","last_change":"2024-09-21T06:46:04.663113+0000","last_active":"2024-09-21T06:46:06.021401+0000","last_peered":"2024-09-21T06:46:06.021401+0000","last_clean":"2024-09-21T06:46:06.021401+0000","last_became_active":"2024-09-21T06:46:04.662781+0000","last_became_peered":"2024-09-21T06:46:04.662781+0000","last_unstale":"2024-09-21T06:46:06.021401+0000","last_undegraded":"2024-09-21T06:46:06.021401+0000","last_fullsized":"2024-09-21T06:46:06.021401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:32.289889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.654245+0000","last_change":"2024-09-21T06:46:03.646551+0000","last_active":"2024-09-21T06:46:05.654245+0000","last_peered":"2024-09-21T06:46:05.654245+0000","last_clean":"2024-09-21T06:46:05.654245+0000","last_became_active":"2024-09-21T06:46:03.646209+0000","last_became_peered":"2024-09-21T06:46:03.646209+0000","last_unstale":"2024-09-21T06:46:05.654245+0000","last_undegraded":"2024-09-21T06:46:05.654245+0000","last_fullsized":"2024-09-21T06:46:05.654245+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:27.067344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022399+0000","last_change":"2024-09-21T06:46:04.658778+0000","last_active":"2024-09-21T06:46:06.022399+0000","last_peered":"2024-09-21T06:46:06.022399+0000","last_clean":"2024-09-21T06:46:06.022399+0000","last_became_active":"2024-09-21T06:46:04.658327+0000","last_became_peered":"2024-09-21T06:46:04.658327+0000","last_unstale":"2024-09-21T06:46:06.022399+0000","last_undegraded":"2024-09-21T06:46:06.022399+0000","last_fullsized":"2024-09-21T06:46:06.022399+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:47.909007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021861+0000","last_change":"2024-09-21T06:46:03.643628+0000","last_active":"2024-09-21T06:46:06.021861+0000","last_peered":"2024-09-21T06:46:06.021861+0000","last_clean":"2024-09-21T06:46:06.021861+0000","last_became_active":"2024-09-21T06:46:03.643306+0000","last_became_peered":"2024-09-21T06:46:03.643306+0000","last_unstale":"2024-09-21T06:46:06.021861+0000","last_undegraded":"2024-09-21T06:46:06.021861+0000","last_fullsized":"2024-09-21T06:46:06.021861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:57.914977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021943+0000","last_change":"2024-09-21T06:46:04.656103+0000","last_active":"2024-09-21T06:46:06.021943+0000","last_peered":"2024-09-21T06:46:06.021943+0000","last_clean":"2024-09-21T06:46:06.021943+0000","last_became_active":"2024-09-21T06:46:04.655804+0000","last_became_peered":"2024-09-21T06:46:04.655804+0000","last_unstale":"2024-09-21T06:46:06.021943+0000","last_undegraded":"2024-09-21T06:46:06.021943+0000","last_fullsized":"2024-09-21T06:46:06.021943+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:37.301602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022329+0000","last_change":"2024-09-21T06:46:03.646712+0000","last_active":"2024-09-21T06:46:06.022329+0000","last_peered":"2024-09-21T06:46:06.022329+0000","last_clean":"2024-09-21T06:46:06.022329+0000","last_became_active":"2024-09-21T06:46:03.646413+0000","last_became_peered":"2024-09-21T06:46:03.646413+0000","last_unstale":"2024-09-21T06:46:06.022329+0000","last_undegraded":"2024-09-21T06:46:06.022329+0000","last_fullsized":"2024-09-21T06:46:06.022329+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:07.298044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021780+0000","last_change":"2024-09-21T06:46:04.666021+0000","last_active":"2024-09-21T06:46:06.021780+0000","last_peered":"2024-09-21T06:46:06.021780+0000","last_clean":"2024-09-21T06:46:06.021780+0000","last_became_active":"2024-09-21T06:46:04.664930+0000","last_became_peered":"2024-09-21T06:46:04.664930+0000","last_unstale":"2024-09-21T06:46:06.021780+0000","last_undegraded":"2024-09-21T06:46:06.021780+0000","last_fullsized":"2024-09-21T06:46:06.021780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:37:02.434425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021694+0000","last_change":"2024-09-21T06:46:03.651000+0000","last_active":"2024-09-21T06:46:06.021694+0000","last_peered":"2024-09-21T06:46:06.021694+0000","last_clean":"2024-09-21T06:46:06.021694+0000","last_became_active":"2024-09-21T06:46:03.650667+0000","last_became_peered":"2024-09-21T06:46:03.650667+0000","last_unstale":"2024-09-21T06:46:06.021694+0000","last_undegraded":"2024-09-21T06:46:06.021694+0000","last_fullsized":"2024-09-21T06:46:06.021694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:57.914977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651472+0000","last_change":"2024-09-21T06:46:04.655207+0000","last_active":"2024-09-21T06:46:05.651472+0000","last_peered":"2024-09-21T06:46:05.651472+0000","last_clean":"2024-09-21T06:46:05.651472+0000","last_became_active":"2024-09-21T06:46:04.654864+0000","last_became_peered":"2024-09-21T06:46:04.654864+0000","last_unstale":"2024-09-21T06:46:05.651472+0000","last_undegraded":"2024-09-21T06:46:05.651472+0000","last_fullsized":"2024-09-21T06:46:05.651472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:41.749439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.650828+0000","last_change":"2024-09-21T06:46:03.641140+0000","last_active":"2024-09-21T06:46:05.650828+0000","last_peered":"2024-09-21T06:46:05.650828+0000","last_clean":"2024-09-21T06:46:05.650828+0000","last_became_active":"2024-09-21T06:46:03.640811+0000","last_became_peered":"2024-09-21T06:46:03.640811+0000","last_unstale":"2024-09-21T06:46:05.650828+0000","last_undegraded":"2024-09-21T06:46:05.650828+0000","last_fullsized":"2024-09-21T06:46:05.650828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:18.235509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021060+0000","last_change":"2024-09-21T06:46:04.665427+0000","last_active":"2024-09-21T06:46:06.021060+0000","last_peered":"2024-09-21T06:46:06.021060+0000","last_clean":"2024-09-21T06:46:06.021060+0000","last_became_active":"2024-09-21T06:46:04.665076+0000","last_became_peered":"2024-09-21T06:46:04.665076+0000","last_unstale":"2024-09-21T06:46:06.021060+0000","last_undegraded":"2024-09-21T06:46:06.021060+0000","last_fullsized":"2024-09-21T06:46:06.021060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:00.222120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651028+0000","last_change":"2024-09-21T06:46:03.640499+0000","last_active":"2024-09-21T06:46:05.651028+0000","last_peered":"2024-09-21T06:46:05.651028+0000","last_clean":"2024-09-21T06:46:05.651028+0000","last_became_active":"2024-09-21T06:46:03.640205+0000","last_became_peered":"2024-09-21T06:46:03.640205+0000","last_unstale":"2024-09-21T06:46:05.651028+0000","last_undegraded":"2024-09-21T06:46:05.651028+0000","last_fullsized":"2024-09-21T06:46:05.651028+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:34.540855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651938+0000","last_change":"2024-09-21T06:46:04.667436+0000","last_active":"2024-09-21T06:46:05.651938+0000","last_peered":"2024-09-21T06:46:05.651938+0000","last_clean":"2024-09-21T06:46:05.651938+0000","last_became_active":"2024-09-21T06:46:04.667136+0000","last_became_peered":"2024-09-21T06:46:04.667136+0000","last_unstale":"2024-09-21T06:46:05.651938+0000","last_undegraded":"2024-09-21T06:46:05.651938+0000","last_fullsized":"2024-09-21T06:46:05.651938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:55.347574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022157+0000","last_change":"2024-09-21T06:46:03.650652+0000","last_active":"2024-09-21T06:46:06.022157+0000","last_peered":"2024-09-21T06:46:06.022157+0000","last_clean":"2024-09-21T06:46:06.022157+0000","last_became_active":"2024-09-21T06:46:03.650301+0000","last_became_peered":"2024-09-21T06:46:03.650301+0000","last_unstale":"2024-09-21T06:46:06.022157+0000","last_undegraded":"2024-09-21T06:46:06.022157+0000","last_fullsized":"2024-09-21T06:46:06.022157+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:54:15.761508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022803+0000","last_change":"2024-09-21T06:46:04.642385+0000","last_active":"2024-09-21T06:46:06.022803+0000","last_peered":"2024-09-21T06:46:06.022803+0000","last_clean":"2024-09-21T06:46:06.022803+0000","last_became_active":"2024-09-21T06:46:04.642079+0000","last_became_peered":"2024-09-21T06:46:04.642079+0000","last_unstale":"2024-09-21T06:46:06.022803+0000","last_undegraded":"2024-09-21T06:46:06.022803+0000","last_fullsized":"2024-09-21T06:46:06.022803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:17.143080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021646+0000","last_change":"2024-09-21T06:46:03.643663+0000","last_active":"2024-09-21T06:46:06.021646+0000","last_peered":"2024-09-21T06:46:06.021646+0000","last_clean":"2024-09-21T06:46:06.021646+0000","last_became_active":"2024-09-21T06:46:03.643355+0000","last_became_peered":"2024-09-21T06:46:03.643355+0000","last_unstale":"2024-09-21T06:46:06.021646+0000","last_undegraded":"2024-09-21T06:46:06.021646+0000","last_fullsized":"2024-09-21T06:46:06.021646+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:18.709196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651882+0000","last_change":"2024-09-21T06:46:04.666300+0000","last_active":"2024-09-21T06:46:05.651882+0000","last_peered":"2024-09-21T06:46:05.651882+0000","last_clean":"2024-09-21T06:46:05.651882+0000","last_became_active":"2024-09-21T06:46:04.665888+0000","last_became_peered":"2024-09-21T06:46:04.665888+0000","last_unstale":"2024-09-21T06:46:05.651882+0000","last_undegraded":"2024-09-21T06:46:05.651882+0000","last_fullsized":"2024-09-21T06:46:05.651882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:10.919709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021264+0000","last_change":"2024-09-21T06:46:03.648142+0000","last_active":"2024-09-21T06:46:06.021264+0000","last_peered":"2024-09-21T06:46:06.021264+0000","last_clean":"2024-09-21T06:46:06.021264+0000","last_became_active":"2024-09-21T06:46:03.647606+0000","last_became_peered":"2024-09-21T06:46:03.647606+0000","last_unstale":"2024-09-21T06:46:06.021264+0000","last_undegraded":"2024-09-21T06:46:06.021264+0000","last_fullsized":"2024-09-21T06:46:06.021264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:51:26.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021769+0000","last_change":"2024-09-21T06:46:04.642387+0000","last_active":"2024-09-21T06:46:06.021769+0000","last_peered":"2024-09-21T06:46:06.021769+0000","last_clean":"2024-09-21T06:46:06.021769+0000","last_became_active":"2024-09-21T06:46:04.642071+0000","last_became_peered":"2024-09-21T06:46:04.642071+0000","last_unstale":"2024-09-21T06:46:06.021769+0000","last_undegraded":"2024-09-21T06:46:06.021769+0000","last_fullsized":"2024-09-21T06:46:06.021769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:25.785034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022132+0000","last_change":"2024-09-21T06:46:03.652711+0000","last_active":"2024-09-21T06:46:06.022132+0000","last_peered":"2024-09-21T06:46:06.022132+0000","last_clean":"2024-09-21T06:46:06.022132+0000","last_became_active":"2024-09-21T06:46:03.652296+0000","last_became_peered":"2024-09-21T06:46:03.652296+0000","last_unstale":"2024-09-21T06:46:06.022132+0000","last_undegraded":"2024-09-21T06:46:06.022132+0000","last_fullsized":"2024-09-21T06:46:06.022132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:12:53.697919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.023128+0000","last_change":"2024-09-21T06:46:04.642711+0000","last_active":"2024-09-21T06:46:06.023128+0000","last_peered":"2024-09-21T06:46:06.023128+0000","last_clean":"2024-09-21T06:46:06.023128+0000","last_became_active":"2024-09-21T06:46:04.642168+0000","last_became_peered":"2024-09-21T06:46:04.642168+0000","last_unstale":"2024-09-21T06:46:06.023128+0000","last_undegraded":"2024-09-21T06:46:06.023128+0000","last_fullsized":"2024-09-21T06:46:06.023128+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:08.941779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021469+0000","last_change":"2024-09-21T06:46:03.643980+0000","last_active":"2024-09-21T06:46:06.021469+0000","last_peered":"2024-09-21T06:46:06.021469+0000","last_clean":"2024-09-21T06:46:06.021469+0000","last_became_active":"2024-09-21T06:46:03.643648+0000","last_became_peered":"2024-09-21T06:46:03.643648+0000","last_unstale":"2024-09-21T06:46:06.021469+0000","last_undegraded":"2024-09-21T06:46:06.021469+0000","last_fullsized":"2024-09-21T06:46:06.021469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:59.993371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.651361+0000","last_change":"2024-09-21T06:46:04.656420+0000","last_active":"2024-09-21T06:46:05.651361+0000","last_peered":"2024-09-21T06:46:05.651361+0000","last_clean":"2024-09-21T06:46:05.651361+0000","last_became_active":"2024-09-21T06:46:04.656113+0000","last_became_peered":"2024-09-21T06:46:04.656113+0000","last_unstale":"2024-09-21T06:46:05.651361+0000","last_undegraded":"2024-09-21T06:46:05.651361+0000","last_fullsized":"2024-09-21T06:46:05.651361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:58.937793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021830+0000","last_change":"2024-09-21T06:46:03.647357+0000","last_active":"2024-09-21T06:46:06.021830+0000","last_peered":"2024-09-21T06:46:06.021830+0000","last_clean":"2024-09-21T06:46:06.021830+0000","last_became_active":"2024-09-21T06:46:03.647005+0000","last_became_peered":"2024-09-21T06:46:03.647005+0000","last_unstale":"2024-09-21T06:46:06.021830+0000","last_undegraded":"2024-09-21T06:46:06.021830+0000","last_fullsized":"2024-09-21T06:46:06.021830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:12.471909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021169+0000","last_change":"2024-09-21T06:46:04.656652+0000","last_active":"2024-09-21T06:46:06.021169+0000","last_peered":"2024-09-21T06:46:06.021169+0000","last_clean":"2024-09-21T06:46:06.021169+0000","last_became_active":"2024-09-21T06:46:04.656322+0000","last_became_peered":"2024-09-21T06:46:04.656322+0000","last_unstale":"2024-09-21T06:46:06.021169+0000","last_undegraded":"2024-09-21T06:46:06.021169+0000","last_fullsized":"2024-09-21T06:46:06.021169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:20.501586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652019+0000","last_change":"2024-09-21T06:46:03.649908+0000","last_active":"2024-09-21T06:46:05.652019+0000","last_peered":"2024-09-21T06:46:05.652019+0000","last_clean":"2024-09-21T06:46:05.652019+0000","last_became_active":"2024-09-21T06:46:03.649595+0000","last_became_peered":"2024-09-21T06:46:03.649595+0000","last_unstale":"2024-09-21T06:46:05.652019+0000","last_undegraded":"2024-09-21T06:46:05.652019+0000","last_fullsized":"2024-09-21T06:46:05.652019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:26.657306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022261+0000","last_change":"2024-09-21T06:46:04.665360+0000","last_active":"2024-09-21T06:46:06.022261+0000","last_peered":"2024-09-21T06:46:06.022261+0000","last_clean":"2024-09-21T06:46:06.022261+0000","last_became_active":"2024-09-21T06:46:04.663777+0000","last_became_peered":"2024-09-21T06:46:04.663777+0000","last_unstale":"2024-09-21T06:46:06.022261+0000","last_undegraded":"2024-09-21T06:46:06.022261+0000","last_fullsized":"2024-09-21T06:46:06.022261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:07.180410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022911+0000","last_change":"2024-09-21T06:46:03.650579+0000","last_active":"2024-09-21T06:46:06.022911+0000","last_peered":"2024-09-21T06:46:06.022911+0000","last_clean":"2024-09-21T06:46:06.022911+0000","last_became_active":"2024-09-21T06:46:03.650243+0000","last_became_peered":"2024-09-21T06:46:03.650243+0000","last_unstale":"2024-09-21T06:46:06.022911+0000","last_undegraded":"2024-09-21T06:46:06.022911+0000","last_fullsized":"2024-09-21T06:46:06.022911+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:31.594139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022594+0000","last_change":"2024-09-21T06:46:04.656767+0000","last_active":"2024-09-21T06:46:06.022594+0000","last_peered":"2024-09-21T06:46:06.022594+0000","last_clean":"2024-09-21T06:46:06.022594+0000","last_became_active":"2024-09-21T06:46:04.656495+0000","last_became_peered":"2024-09-21T06:46:04.656495+0000","last_unstale":"2024-09-21T06:46:06.022594+0000","last_undegraded":"2024-09-21T06:46:06.022594+0000","last_fullsized":"2024-09-21T06:46:06.022594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:21.200301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022128+0000","last_change":"2024-09-21T06:46:03.652588+0000","last_active":"2024-09-21T06:46:06.022128+0000","last_peered":"2024-09-21T06:46:06.022128+0000","last_clean":"2024-09-21T06:46:06.022128+0000","last_became_active":"2024-09-21T06:46:03.652237+0000","last_became_peered":"2024-09-21T06:46:03.652237+0000","last_unstale":"2024-09-21T06:46:06.022128+0000","last_undegraded":"2024-09-21T06:46:06.022128+0000","last_fullsized":"2024-09-21T06:46:06.022128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:07.938476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022791+0000","last_change":"2024-09-21T06:46:04.648165+0000","last_active":"2024-09-21T06:46:06.022791+0000","last_peered":"2024-09-21T06:46:06.022791+0000","last_clean":"2024-09-21T06:46:06.022791+0000","last_became_active":"2024-09-21T06:46:04.647669+0000","last_became_peered":"2024-09-21T06:46:04.647669+0000","last_unstale":"2024-09-21T06:46:06.022791+0000","last_undegraded":"2024-09-21T06:46:06.022791+0000","last_fullsized":"2024-09-21T06:46:06.022791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:26:47.507387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:05.652543+0000","last_change":"2024-09-21T06:46:03.650389+0000","last_active":"2024-09-21T06:46:05.652543+0000","last_peered":"2024-09-21T06:46:05.652543+0000","last_clean":"2024-09-21T06:46:05.652543+0000","last_became_active":"2024-09-21T06:46:03.650078+0000","last_became_peered":"2024-09-21T06:46:03.650078+0000","last_unstale":"2024-09-21T06:46:05.652543+0000","last_undegraded":"2024-09-21T06:46:05.652543+0000","last_fullsized":"2024-09-21T06:46:05.652543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:19.252522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.021792+0000","last_change":"2024-09-21T06:46:04.653862+0000","last_active":"2024-09-21T06:46:06.021792+0000","last_peered":"2024-09-21T06:46:06.021792+0000","last_clean":"2024-09-21T06:46:06.021792+0000","last_became_active":"2024-09-21T06:46:04.653576+0000","last_became_peered":"2024-09-21T06:46:04.653576+0000","last_unstale":"2024-09-21T06:46:06.021792+0000","last_undegraded":"2024-09-21T06:46:06.021792+0000","last_fullsized":"2024-09-21T06:46:06.021792+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:03.622420+0000","last_clean_scrub_stamp":"2024-09-21T06:46:03.622420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:22.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022714+0000","last_change":"2024-09-21T06:46:03.651097+0000","last_active":"2024-09-21T06:46:06.022714+0000","last_peered":"2024-09-21T06:46:06.022714+0000","last_clean":"2024-09-21T06:46:06.022714+0000","last_became_active":"2024-09-21T06:46:03.650544+0000","last_became_peered":"2024-09-21T06:46:03.650544+0000","last_unstale":"2024-09-21T06:46:06.022714+0000","last_undegraded":"2024-09-21T06:46:06.022714+0000","last_fullsized":"2024-09-21T06:46:06.022714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:02.619118+0000","last_clean_scrub_stamp":"2024-09-21T06:46:02.619118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:58.805376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":140,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T06:46:06.022293+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:06.022293+0000","last_peered":"2024-09-21T06:46:06.022293+0000","last_clean":"2024-09-21T06:46:06.022293+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:06.022293+0000","last_undegraded":"2024-09-21T06:46:06.022293+0000","last_fullsized":"2024-09-21T06:46:06.022293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":181868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":183972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1028096,"data_stored":772168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":181870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":181848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":181812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1028096,"data_stored":772728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":183514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:12.849 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:46:12.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:46:13.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.004+0000 7f23192ce640 1 -- 172.21.15.81:0/1712427439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 msgr2=0x7f2300003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.004+0000 7f23192ce640 1 --2- 172.21.15.81:0/1712427439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 0x7f2300003ea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2304009b20 tx=0x7f2300005830 comp rx=0 tx=0).stop 2024-09-21T06:46:13.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.004+0000 7f23137fe640 1 -- 172.21.15.81:0/1712427439 reap_dead start 2024-09-21T06:46:13.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.004+0000 7f23192ce640 1 -- 172.21.15.81:0/1712427439 shutdown_connections 2024-09-21T06:46:13.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.004+0000 7f23192ce640 1 -- 172.21.15.81:0/1712427439 >> 172.21.15.81:0/1712427439 conn(0x7f23140b7330 msgr2=0x7f23140b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:13.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.004+0000 7f23192ce640 1 -- 172.21.15.81:0/1712427439 shutdown_connections 2024-09-21T06:46:13.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.004+0000 7f23192ce640 1 -- 172.21.15.81:0/1712427439 wait complete. 2024-09-21T06:46:13.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.006+0000 7f23192ce640 1 Processor -- start 2024-09-21T06:46:13.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.006+0000 7f23192ce640 1 -- start start 2024-09-21T06:46:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f23192ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 0x7f23140b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f23192ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f231414fa20 0x7f231406f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f23192ce640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2314150260 0x7f2314150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f23192ce640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23140b3230 con 0x7f2300003a30 2024-09-21T06:46:13.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f23192ce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f23140d36d0 con 0x7f231414fa20 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f23192ce640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f23140b33b0 con 0x7f2314150260 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 0x7f23140b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 0x7f23140b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56758/0 (socket says 172.21.15.81:56758) 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 -- 172.21.15.81:0/1008355387 learned_addr learned my addr 172.21.15.81:0/1008355387 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 -- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2314150260 msgr2=0x7f2314150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2314150260 0x7f2314150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 -- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f231414fa20 msgr2=0x7f231406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f231414fa20 0x7f231406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 -- 172.21.15.81:0/1008355387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23140b4400 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f2312ffd640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 0x7f23140b54a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2304009b20 tx=0x7f2304033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f230bfff640 1 -- 172.21.15.81:0/1008355387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304038040 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f230bfff640 1 -- 172.21.15.81:0/1008355387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2304005020 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23140b46e0 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.008+0000 7f230bfff640 1 -- 172.21.15.81:0/1008355387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304005430 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.009+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23140b4ca0 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.009+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231408d110 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.010+0000 7f230bfff640 1 -- 172.21.15.81:0/1008355387 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2304045020 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.011+0000 7f230bfff640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f22f4078b90 0x7f22f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.011+0000 7f230bfff640 1 -- 172.21.15.81:0/1008355387 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f23040bb880 con 0x7f2300003a30 2024-09-21T06:46:13.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.011+0000 7f230a7fc640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f22f4078b90 0x7f22f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:13.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.011+0000 7f230a7fc640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f22f4078b90 0x7f22f407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006fd0 tx=0x7f22fc006920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:13.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.015+0000 7f230bfff640 1 -- 172.21.15.81:0/1008355387 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f231408d110 con 0x7f2300003a30 2024-09-21T06:46:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.260+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f23140b3910 con 0x7f2300003a30 2024-09-21T06:46:13.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.263+0000 7f230bfff640 1 -- 172.21.15.81:0/1008355387 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v33) ==== 190+0+147 (secure 0 0 0) 0x7f2304083ab0 con 0x7f2300003a30 2024-09-21T06:46:13.265 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:13.265 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:13.265 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-21T06:46:13.265 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:13.265 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:46:13.265 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:13.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f22f4078b90 msgr2=0x7f22f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f22f4078b90 0x7f22f407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f22fc006fd0 tx=0x7f22fc006920 comp rx=0 tx=0).stop 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 msgr2=0x7f23140b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 0x7f23140b54a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2304009b20 tx=0x7f2304033670 comp rx=0 tx=0).stop 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 shutdown_connections 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f22f4078b90 0x7f22f407b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2314150260 0x7f2314150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f231414fa20 0x7f231406f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 --2- 172.21.15.81:0/1008355387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2300003a30 0x7f23140b54a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 >> 172.21.15.81:0/1008355387 conn(0x7f23140b7330 msgr2=0x7f231415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 shutdown_connections 2024-09-21T06:46:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.265+0000 7f23192ce640 1 -- 172.21.15.81:0/1008355387 wait complete. 2024-09-21T06:46:13.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.389+0000 7f58a56ec640 1 -- 172.21.15.81:0/2824013629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588c004800 msgr2=0x7f588c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.389+0000 7f58a56ec640 1 --2- 172.21.15.81:0/2824013629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588c004800 0x7f588c004c10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f58a00b3e10 tx=0x7f588c005830 comp rx=0 tx=0).stop 2024-09-21T06:46:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.389+0000 7f58a56ec640 1 -- 172.21.15.81:0/2824013629 shutdown_connections 2024-09-21T06:46:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.389+0000 7f58a56ec640 1 --2- 172.21.15.81:0/2824013629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588c004800 0x7f588c004c10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.389+0000 7f58a56ec640 1 -- 172.21.15.81:0/2824013629 >> 172.21.15.81:0/2824013629 conn(0x7f58a00b7330 msgr2=0x7f58a00b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.389+0000 7f58a56ec640 1 -- 172.21.15.81:0/2824013629 shutdown_connections 2024-09-21T06:46:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.389+0000 7f58a56ec640 1 -- 172.21.15.81:0/2824013629 wait complete. 2024-09-21T06:46:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.391+0000 7f58a56ec640 1 Processor -- start 2024-09-21T06:46:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.391+0000 7f58a56ec640 1 -- start start 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58a56ec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f588c004800 0x7f58a00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58a56ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a015b8e0 0x7f58a0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58a56ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a006e5c0 0x7f58a006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58a56ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00d4940 con 0x7f58a015b8e0 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58a56ec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00d47c0 con 0x7f58a006e5c0 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58a56ec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f58a00d4ac0 con 0x7f588c004800 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58967fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a015b8e0 0x7f58a0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58967fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a015b8e0 0x7f58a0153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56774/0 (socket says 172.21.15.81:56774) 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.392+0000 7f58967fc640 1 -- 172.21.15.81:0/1406846531 learned_addr learned my addr 172.21.15.81:0/1406846531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f589f7fe640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a006e5c0 0x7f58a006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f589effd640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f588c004800 0x7f58a00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58967fc640 1 -- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f588c004800 msgr2=0x7f58a00ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58967fc640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f588c004800 0x7f58a00ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58967fc640 1 -- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a006e5c0 msgr2=0x7f58a006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58967fc640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a006e5c0 0x7f58a006e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58967fc640 1 -- 172.21.15.81:0/1406846531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a006ef10 con 0x7f58a015b8e0 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58967fc640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a015b8e0 0x7f58a0153af0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f588802b0a0 tx=0x7f5888001d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f5897fff640 1 -- 172.21.15.81:0/1406846531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880037f0 con 0x7f58a015b8e0 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f5897fff640 1 -- 172.21.15.81:0/1406846531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5888003a80 con 0x7f58a015b8e0 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a00cd670 con 0x7f58a015b8e0 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f5897fff640 1 -- 172.21.15.81:0/1406846531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588802e480 con 0x7f58a015b8e0 2024-09-21T06:46:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.393+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a00cdc30 con 0x7f58a015b8e0 2024-09-21T06:46:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.394+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a008d110 con 0x7f58a015b8e0 2024-09-21T06:46:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.395+0000 7f5897fff640 1 -- 172.21.15.81:0/1406846531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5888035020 con 0x7f58a015b8e0 2024-09-21T06:46:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.395+0000 7f5897fff640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5880078b90 0x7f588007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.395+0000 7f5897fff640 1 -- 172.21.15.81:0/1406846531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f58880bb370 con 0x7f58a015b8e0 2024-09-21T06:46:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.396+0000 7f589effd640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5880078b90 0x7f588007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:13.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.396+0000 7f589effd640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5880078b90 0x7f588007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58a0075650 tx=0x7f5890005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:13.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.400+0000 7f5897fff640 1 -- 172.21.15.81:0/1406846531 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58a008d110 con 0x7f58a015b8e0 2024-09-21T06:46:13.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.615+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58a00cd2a0 con 0x7f58a015b8e0 2024-09-21T06:46:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.616+0000 7f5897fff640 1 -- 172.21.15.81:0/1406846531 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7f5888047030 con 0x7f58a015b8e0 2024-09-21T06:46:13.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:13.618 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"btime":"2024-09-21T06:46:07:052774+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:03.998544+0000","modified":"2024-09-21T06:46:06.408923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/3622751302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":3622751302},{"type":"v1","addr":"172.21.15.89:6837","nonce":3622751302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":2}]} 2024-09-21T06:46:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5880078b90 msgr2=0x7f588007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5880078b90 0x7f588007b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58a0075650 tx=0x7f5890005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a015b8e0 msgr2=0x7f58a0153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a015b8e0 0x7f58a0153af0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f588802b0a0 tx=0x7f5888001d50 comp rx=0 tx=0).stop 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 shutdown_connections 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5880078b90 0x7f588007b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a006e5c0 0x7f58a006e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58a015b8e0 0x7f58a0153af0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 --2- 172.21.15.81:0/1406846531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f588c004800 0x7f58a00ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 >> 172.21.15.81:0/1406846531 conn(0x7f58a00b7330 msgr2=0x7f58a00cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.618+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 shutdown_connections 2024-09-21T06:46:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:13.619+0000 7f58a56ec640 1 -- 172.21.15.81:0/1406846531 wait complete. 2024-09-21T06:46:14.034 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:46:03.998544+0000', 'modified': '2024-09-21T06:46:06.408923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4882}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4882': {'gid': 4882, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6837/3622751302', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6835', 'nonce': 3622751302}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 3622751302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4882, 'qdb_cluster': [4882]} 2024-09-21T06:46:14.035 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:46:14.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-21T06:46:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 -- 172.21.15.81:0/2493528909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 msgr2=0x7f8aa015d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/2493528909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa015d6d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a98005fd0 tx=0x7f8a9802a9c0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 -- 172.21.15.81:0/2493528909 shutdown_connections 2024-09-21T06:46:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/2493528909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa015d6d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/2493528909 >> v2:172.21.15.89:3300/0 conn(0x7f8aa00d19a0 0x7f8aa015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 -- 172.21.15.81:0/2493528909 >> 172.21.15.81:0/2493528909 conn(0x7f8aa00d25e0 msgr2=0x7f8aa00d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 -- 172.21.15.81:0/2493528909 shutdown_connections 2024-09-21T06:46:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.150+0000 7f8aa7b21640 1 -- 172.21.15.81:0/2493528909 wait complete. 2024-09-21T06:46:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.152+0000 7f8aa7b21640 1 Processor -- start 2024-09-21T06:46:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.152+0000 7f8aa7b21640 1 -- start start 2024-09-21T06:46:14.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa7b21640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa00d19a0 0x7f8aa006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa7b21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa00b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa7b21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa01601c0 0x7f8aa014a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa7b21640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa00730d0 con 0x7f8aa015d2c0 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa7b21640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa0072f50 con 0x7f8aa01601c0 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa7b21640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa0073250 con 0x7f8aa00d19a0 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa50bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa00b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa50bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa00b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56782/0 (socket says 172.21.15.81:56782) 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa50bc640 1 -- 172.21.15.81:0/807273785 learned_addr learned my addr 172.21.15.81:0/807273785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa60be640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa01601c0 0x7f8aa014a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa00d19a0 0x7f8aa006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa50bc640 1 -- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa00d19a0 msgr2=0x7f8aa006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa00d19a0 0x7f8aa006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa50bc640 1 -- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa01601c0 msgr2=0x7f8aa014a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.153+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa01601c0 0x7f8aa014a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.154+0000 7f8aa50bc640 1 -- 172.21.15.81:0/807273785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa00ca380 con 0x7f8aa015d2c0 2024-09-21T06:46:14.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.154+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa00b5100 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000b410 tx=0x7f8a9000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.154+0000 7f8a967fc640 1 -- 172.21.15.81:0/807273785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90015020 con 0x7f8aa015d2c0 2024-09-21T06:46:14.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.154+0000 7f8a967fc640 1 -- 172.21.15.81:0/807273785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a90011920 con 0x7f8aa015d2c0 2024-09-21T06:46:14.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.154+0000 7f8a967fc640 1 -- 172.21.15.81:0/807273785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90011d70 con 0x7f8aa015d2c0 2024-09-21T06:46:14.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.154+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa00c6de0 con 0x7f8aa015d2c0 2024-09-21T06:46:14.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.154+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa00c7080 con 0x7f8aa015d2c0 2024-09-21T06:46:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.156+0000 7f8a967fc640 1 -- 172.21.15.81:0/807273785 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a90018020 con 0x7f8aa015d2c0 2024-09-21T06:46:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.156+0000 7f8a967fc640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a84078b90 0x7f8a8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.156+0000 7f8a967fc640 1 -- 172.21.15.81:0/807273785 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8a9009ad80 con 0x7f8aa015d2c0 2024-09-21T06:46:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.156+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a84078b90 0x7f8a8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.157+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a84078b90 0x7f8a8407b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0098e0 tx=0x7f8a9c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.157+0000 7f8aaea89740 1 Processor -- start 2024-09-21T06:46:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.157+0000 7f8aaea89740 1 -- start start 2024-09-21T06:46:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.158+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594d5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.158+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594d64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.158+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.158+0000 7f8aaea89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55675941e820 con 0x5567590e3590 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.158+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55675940dc50 con 0x556759104270 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.158+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x556759411a60 con 0x5567590db3b0 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56796/0 (socket says 172.21.15.81:56796) 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 -- 172.21.15.81:0/2204816121 learned_addr learned my addr 172.21.15.81:0/2204816121 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594d5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594d64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 -- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 msgr2=0x5567594d64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594d64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 -- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 msgr2=0x5567594d5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594d5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 -- 172.21.15.81:0/2204816121 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675916f850 con 0x5567590e3590 2024-09-21T06:46:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8aa60be640 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f33e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a98033040 tx=0x7f8a98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b887e83f63246b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8a837fe640 1 -- 172.21.15.81:0/2204816121 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98048070 con 0x5567590e3590 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8a837fe640 1 -- 172.21.15.81:0/2204816121 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a98030b30 con 0x5567590e3590 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.159+0000 7f8a837fe640 1 -- 172.21.15.81:0/2204816121 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98034040 con 0x5567590e3590 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 -- 172.21.15.81:0/2204816121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 msgr2=0x5567594f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f33e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8a98033040 tx=0x7f8a98004a40 comp rx=0 tx=0).stop 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 -- 172.21.15.81:0/2204816121 shutdown_connections 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594d64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f33e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2204816121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594d5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 -- 172.21.15.81:0/2204816121 >> 172.21.15.81:0/2204816121 conn(0x5567590f83c0 msgr2=0x5567594ac260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 -- 172.21.15.81:0/2204816121 shutdown_connections 2024-09-21T06:46:14.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.160+0000 7f8aaea89740 1 -- 172.21.15.81:0/2204816121 wait complete. 2024-09-21T06:46:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.161+0000 7f8aaea89740 1 -- start start 2024-09-21T06:46:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.161+0000 7f8aaea89740 1 Processor -- start 2024-09-21T06:46:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594e6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594f6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55675917e620 con 0x5567590e3590 2024-09-21T06:46:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x5567593b35f0 con 0x556759104270 2024-09-21T06:46:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x5567594d6a20 con 0x5567590db3b0 2024-09-21T06:46:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 10 client.0 _ll_register_callbacks cb 0x5567593b70a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56810/0 (socket says 172.21.15.81:56810) 2024-09-21T06:46:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 -- 172.21.15.81:0/2576488849 learned_addr learned my addr 172.21.15.81:0/2576488849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa60be640 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 -- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 msgr2=0x5567594e6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594e6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 -- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 msgr2=0x5567594f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 -- 172.21.15.81:0/2576488849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567591e66b0 con 0x5567590e3590 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f61c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8a90062970 tx=0x7f8a900624f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22c168eb04cc85a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8a80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8a80ff9640 1 -- 172.21.15.81:0/2576488849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9007c020 con 0x5567590e3590 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8a80ff9640 1 -- 172.21.15.81:0/2576488849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8a90078ae0 con 0x5567590e3590 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a98030b30 con 0x5567590e3590 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.163+0000 7f8a80ff9640 1 -- 172.21.15.81:0/2576488849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8a90067410 con 0x5567590e3590 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 10 client.5190 fetch_fsmap learned FSMap version 17 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5567594f59c0 con 0x5567590e3590 2024-09-21T06:46:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8a80ff9640 1 -- 172.21.15.81:0/2576488849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a98030b30 con 0x5567590e3590 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8a80ff9640 1 -- 172.21.15.81:0/2576488849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f8a90078ce0 con 0x5567590e3590 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 10 client.5190 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 10 client.5190 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 20 client.5190 populate_metadata read hostname 'smithi081' 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x5567590c2e40 0x5567594ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 4 client.5190 mds_command: new command op to 4882 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 --> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556759420770 con 0x5567590c2e40 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x5567590c2e40 0x5567594ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8a80ff9640 10 client.5190 ms_handle_connect on v2:172.21.15.89:6835/3622751302 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.164+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x5567590c2e40 0x5567594ffe60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db4adb3631d3b2af server_cookie=61abddec2e3f96a6 in_seq=0 out_seq=0 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.165+0000 7f8a80ff9640 1 -- 172.21.15.81:0/2576488849 <== mds.0 v2:172.21.15.89:6835/3622751302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556759420770 con 0x5567590c2e40 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.165+0000 7f8a80ff9640 10 client.5190 handle_command_reply: tid=0 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.165+0000 7f8aaea89740 1 client.5190 shutdown 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 msgr2=0x5567594f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f61c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8a90062970 tx=0x7f8a900624f0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 shutdown_connections 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x5567590c2e40 0x5567594ffe60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x556759104270 0x5567594f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590e3590 0x5567594f61c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8a80ff9640 0 client.5190 ms_handle_reset on v2:172.21.15.89:6835/3622751302 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2576488849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590db3b0 0x5567594e6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 >> 172.21.15.81:0/2576488849 conn(0x5567590f83c0 msgr2=0x5567594a6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 shutdown_connections 2024-09-21T06:46:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 1 -- 172.21.15.81:0/2576488849 wait complete. 2024-09-21T06:46:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.166+0000 7f8aaea89740 20 client.5190 trim_cache size 0 max 16384 2024-09-21T06:46:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.184+0000 7f8aaea89740 1 Processor -- start 2024-09-21T06:46:14.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.184+0000 7f8aaea89740 1 -- start start 2024-09-21T06:46:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x5567594a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x556759513b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x556759514060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aaea89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa02017f0 con 0x5567590c2e40 2024-09-21T06:46:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa00c9f00 con 0x5567590db3b0 2024-09-21T06:46:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa02011a0 con 0x5567590e3590 2024-09-21T06:46:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aa58bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x5567594a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aa58bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x5567594a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56818/0 (socket says 172.21.15.81:56818) 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.185+0000 7f8aa58bd640 1 -- 172.21.15.81:0/2844346583 learned_addr learned my addr 172.21.15.81:0/2844346583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa60be640 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x556759514060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x556759513b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa58bd640 1 -- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 msgr2=0x556759514060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x556759514060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa58bd640 1 -- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 msgr2=0x556759513b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x556759513b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa58bd640 1 -- 172.21.15.81:0/2844346583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567594f2260 con 0x5567590c2e40 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x5567594a9fd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00efe0 tx=0x7f8a9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2412ccdf8c463f68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8a82ffd640 1 -- 172.21.15.81:0/2844346583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c01b040 con 0x5567590c2e40 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8a82ffd640 1 -- 172.21.15.81:0/2844346583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a9c00ea90 con 0x5567590c2e40 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.186+0000 7f8a82ffd640 1 -- 172.21.15.81:0/2844346583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c022690 con 0x5567590c2e40 2024-09-21T06:46:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 -- 172.21.15.81:0/2844346583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 msgr2=0x5567594a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x5567594a9fd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00efe0 tx=0x7f8a9c016000 comp rx=0 tx=0).stop 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 -- 172.21.15.81:0/2844346583 shutdown_connections 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x556759514060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x556759513b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 --2- 172.21.15.81:0/2844346583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x5567594a9fd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 -- 172.21.15.81:0/2844346583 >> 172.21.15.81:0/2844346583 conn(0x5567590f83c0 msgr2=0x5567594a1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 -- 172.21.15.81:0/2844346583 shutdown_connections 2024-09-21T06:46:14.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.187+0000 7f8aaea89740 1 -- 172.21.15.81:0/2844346583 wait complete. 2024-09-21T06:46:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.188+0000 7f8aaea89740 1 -- start start 2024-09-21T06:46:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.188+0000 7f8aaea89740 1 Processor -- start 2024-09-21T06:46:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x556759559490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x5567594f0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aaea89740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x5567594f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aaea89740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5567594e7e30 con 0x5567590c2e40 2024-09-21T06:46:14.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x55675917e620 con 0x5567590db3b0 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aaea89740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x556759503790 con 0x5567590e3590 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aaea89740 10 client.0 _ll_register_callbacks cb 0x7f8a9000b360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aa58bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x556759559490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aa58bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x556759559490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56822/0 (socket says 172.21.15.81:56822) 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aa58bd640 1 -- 172.21.15.81:0/434046845 learned_addr learned my addr 172.21.15.81:0/434046845 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x5567594f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.189+0000 7f8aa60be640 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x5567594f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aa58bd640 1 -- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 msgr2=0x5567594f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x5567594f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aa58bd640 1 -- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 msgr2=0x5567594f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x5567594f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aa58bd640 1 -- 172.21.15.81:0/434046845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556759514510 con 0x5567590c2e40 2024-09-21T06:46:14.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aa58bd640 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x556759559490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c022660 tx=0x7f8a9c022690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45047b873eb8f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8a80ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8a80ff9640 1 -- 172.21.15.81:0/434046845 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c036070 con 0x5567590c2e40 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8a80ff9640 1 -- 172.21.15.81:0/434046845 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8a9c022ac0 con 0x5567590c2e40 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a9c00ea90 con 0x5567590c2e40 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8a80ff9640 1 -- 172.21.15.81:0/434046845 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8a9c041050 con 0x5567590c2e40 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 10 client.5196 fetch_fsmap learned FSMap version 17 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5567595599d0 con 0x5567590c2e40 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8a80ff9640 1 -- 172.21.15.81:0/434046845 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a9c00ea90 con 0x5567590c2e40 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8a80ff9640 1 -- 172.21.15.81:0/434046845 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f8a9c044020 con 0x5567590c2e40 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 10 client.5196 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 10 client.5196 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 20 client.5196 populate_metadata read hostname 'smithi081' 2024-09-21T06:46:14.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x556759098280 0x556759570e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 4 client.5196 mds_command: new command op to 4882 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.190+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 --> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] -- command(tid 0: {"prefix": "status"}) -- 0x55675941c220 con 0x556759098280 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x556759098280 0x556759570e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8a80ff9640 10 client.5196 ms_handle_connect on v2:172.21.15.89:6835/3622751302 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aa50bc640 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x556759098280 0x556759570e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d418e4588c0eb521 server_cookie=a315eb34dbb48f26 in_seq=0 out_seq=0 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8a80ff9640 1 -- 172.21.15.81:0/434046845 <== mds.0 v2:172.21.15.89:6835/3622751302 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55675941c220 con 0x556759098280 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8a80ff9640 10 client.5196 handle_command_reply: tid=0 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 client.5196 shutdown 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 msgr2=0x556759559490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x556759559490 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c022660 tx=0x7f8a9c022690 comp rx=0 tx=0).stop 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 shutdown_connections 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:6835/3622751302,v1:172.21.15.89:6837/3622751302] conn(0x556759098280 0x556759570e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5567590e3590 0x5567594f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8a80ff9640 0 client.5196 ms_handle_reset on v2:172.21.15.89:6835/3622751302 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5567590db3b0 0x5567594f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 --2- 172.21.15.81:0/434046845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567590c2e40 0x556759559490 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 >> 172.21.15.81:0/434046845 conn(0x5567590f83c0 msgr2=0x5567594c4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 shutdown_connections 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.191+0000 7f8aaea89740 1 -- 172.21.15.81:0/434046845 wait complete. 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aaea89740 20 client.5196 trim_cache size 0 max 16384 2024-09-21T06:46:14.199 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "5acf265c-1f37-45bc-9438-eb9ad71b6190", 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4882, 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 9.5604346249999992, 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 17, 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 38, 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 38, 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16.762159594 2024-09-21T06:46:14.200 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:46:14.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a84078b90 msgr2=0x7f8a8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a84078b90 0x7f8a8407b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0098e0 tx=0x7f8a9c009060 comp rx=0 tx=0).stop 2024-09-21T06:46:14.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 msgr2=0x7f8aa00b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa00b5100 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8a9000b410 tx=0x7f8a9000b8d0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 shutdown_connections 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8a84078b90 0x7f8a8407b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8aa01601c0 0x7f8aa014a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8aa015d2c0 0x7f8aa00b5100 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 --2- 172.21.15.81:0/807273785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8aa00d19a0 0x7f8aa006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 >> 172.21.15.81:0/807273785 conn(0x7f8aa00d25e0 msgr2=0x7f8aa00d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 shutdown_connections 2024-09-21T06:46:14.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.192+0000 7f8aa7b21640 1 -- 172.21.15.81:0/807273785 wait complete. 2024-09-21T06:46:14.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.314+0000 7fe9cee30640 1 -- 172.21.15.81:0/2759629080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80b9c00 msgr2=0x7fe9c80d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.314+0000 7fe9cee30640 1 --2- 172.21.15.81:0/2759629080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80b9c00 0x7fe9c80d41a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80b91a0 tx=0x7fe9c002a820 comp rx=0 tx=0).stop 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.315+0000 7fe9cee30640 1 -- 172.21.15.81:0/2759629080 shutdown_connections 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.315+0000 7fe9cee30640 1 --2- 172.21.15.81:0/2759629080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80b9c00 0x7fe9c80d41a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.315+0000 7fe9cee30640 1 --2- 172.21.15.81:0/2759629080 >> v2:172.21.15.89:3300/0 conn(0x7fe9c80d3220 0x7fe9c80b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.315+0000 7fe9cee30640 1 -- 172.21.15.81:0/2759629080 >> 172.21.15.81:0/2759629080 conn(0x7fe9c80b7330 msgr2=0x7fe9c80b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.315+0000 7fe9cee30640 1 -- 172.21.15.81:0/2759629080 shutdown_connections 2024-09-21T06:46:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.315+0000 7fe9cee30640 1 -- 172.21.15.81:0/2759629080 wait complete. 2024-09-21T06:46:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.316+0000 7fe9cee30640 1 Processor -- start 2024-09-21T06:46:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.316+0000 7fe9cee30640 1 -- start start 2024-09-21T06:46:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9cee30640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9c80b9c00 0x7fe9c806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9cee30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d3220 0x7fe9c8159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9cee30640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9c815c450 0x7fe9c80cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9cee30640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c80b3440 con 0x7fe9c80d3220 2024-09-21T06:46:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9cee30640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c80d4b40 con 0x7fe9c80b9c00 2024-09-21T06:46:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9cee30640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c80b35c0 con 0x7fe9c815c450 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d3220 0x7fe9c8159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d3220 0x7fe9c8159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56844/0 (socket says 172.21.15.81:56844) 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 -- 172.21.15.81:0/1762063131 learned_addr learned my addr 172.21.15.81:0/1762063131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9cd3cd640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9c815c450 0x7fe9c80cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9ccbcc640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9c80b9c00 0x7fe9c806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 -- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9c815c450 msgr2=0x7fe9c80cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9c815c450 0x7fe9c80cfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 -- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9c80b9c00 msgr2=0x7fe9c806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9c80b9c00 0x7fe9c806d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 -- 172.21.15.81:0/1762063131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c80c7f90 con 0x7fe9c80d3220 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9ccbcc640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9c80b9c00 0x7fe9c806d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.318+0000 7fe9c7fff640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d3220 0x7fe9c8159930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400e790 tx=0x7fe9b400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.319+0000 7fe9c57fa640 1 -- 172.21.15.81:0/1762063131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400eea0 con 0x7fe9c80d3220 2024-09-21T06:46:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.319+0000 7fe9c57fa640 1 -- 172.21.15.81:0/1762063131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b400ccc0 con 0x7fe9c80d3220 2024-09-21T06:46:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.319+0000 7fe9c57fa640 1 -- 172.21.15.81:0/1762063131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4005280 con 0x7fe9c80d3220 2024-09-21T06:46:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.319+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c80c8270 con 0x7fe9c80d3220 2024-09-21T06:46:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.319+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c80c9c80 con 0x7fe9c80d3220 2024-09-21T06:46:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.320+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c808d110 con 0x7fe9c80d3220 2024-09-21T06:46:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.320+0000 7fe9c57fa640 1 -- 172.21.15.81:0/1762063131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9b4005420 con 0x7fe9c80d3220 2024-09-21T06:46:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.321+0000 7fe9c57fa640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe9ac078bc0 0x7fe9ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.321+0000 7fe9c57fa640 1 -- 172.21.15.81:0/1762063131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe9b409b720 con 0x7fe9c80d3220 2024-09-21T06:46:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.321+0000 7fe9ccbcc640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe9ac078bc0 0x7fe9ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.322+0000 7fe9ccbcc640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe9ac078bc0 0x7fe9ac07b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000f60 tx=0x7fe9bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.326+0000 7fe9c57fa640 1 -- 172.21.15.81:0/1762063131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe9c808d110 con 0x7fe9c80d3220 2024-09-21T06:46:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.537+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe9c80b3ae0 con 0x7fe9c80d3220 2024-09-21T06:46:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.538+0000 7fe9c57fa640 1 -- 172.21.15.81:0/1762063131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fe9b4063a60 con 0x7fe9c80d3220 2024-09-21T06:46:14.540 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:46:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe9ac078bc0 msgr2=0x7fe9ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe9ac078bc0 0x7fe9ac07b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000f60 tx=0x7fe9bc009040 comp rx=0 tx=0).stop 2024-09-21T06:46:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d3220 msgr2=0x7fe9c8159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d3220 0x7fe9c8159930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400e790 tx=0x7fe9b400ec50 comp rx=0 tx=0).stop 2024-09-21T06:46:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 shutdown_connections 2024-09-21T06:46:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe9ac078bc0 0x7fe9ac07b0d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe9c815c450 0x7fe9c80cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9c80d3220 0x7fe9c8159930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 --2- 172.21.15.81:0/1762063131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9c80b9c00 0x7fe9c806d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 >> 172.21.15.81:0/1762063131 conn(0x7fe9c80b7330 msgr2=0x7fe9c815fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 shutdown_connections 2024-09-21T06:46:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14.540+0000 7fe9cee30640 1 -- 172.21.15.81:0/1762063131 wait complete. 2024-09-21T06:46:14.553 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:46:14.553 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:46:14.553 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:46:14.553 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:46:14.553 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:14.554 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:46:14.554 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:46:14.554 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:46:14.554 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:14.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:14.554 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:46:14.570 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:14.571 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5807:98ff:feed:57f8/64 scope link 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1029:45ff:fefa:d01b/64 scope link 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ea:d1:bd:3b:72:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e8d1:bdff:fe3b:7274/64 scope link 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:14.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:14.572 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:46:14.633 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:46:14.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:14.635 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:46:14.691 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:46:14.691 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:46:14.691 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:46:14.691 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:46:14.691 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:46:14.691 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:46:14.691 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:46:14.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:46:14.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:46:14.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:46:14.692 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:46:14.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:46:14.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:14.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:14.817 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:46:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:46:14.832 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:46:14.832 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:14.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:14.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:46:14.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:14.897 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:14.952 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:14.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:14.952 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:15.006 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:46:15.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:15.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:15.102 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:15.102 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:15.112 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:15.112 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:15.112 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:46:15.112 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:46:15.112 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:46:15.113 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:46:15.113 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:46:15.113 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:46:15.113 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:46:15.113 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:46:15.114 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:46:15.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:15.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:15.139 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:46:15.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:46:15.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:15.247 INFO:teuthology.orchestra.run.smithi081.stdout:client5208 2024-09-21T06:46:15.248 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:15.248 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:15.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 -- 172.21.15.81:0/3470599022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a006d9a0 msgr2=0x7fb6a015b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 --2- 172.21.15.81:0/3470599022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a006d9a0 0x7fb6a015b570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00afcf0 tx=0x7fb69002a5f0 comp rx=0 tx=0).stop 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 -- 172.21.15.81:0/3470599022 shutdown_connections 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 --2- 172.21.15.81:0/3470599022 >> v2:172.21.15.89:3300/0 conn(0x7fb6a00cdfc0 0x7fb6a00ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 --2- 172.21.15.81:0/3470599022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a006d9a0 0x7fb6a015b570 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 -- 172.21.15.81:0/3470599022 >> 172.21.15.81:0/3470599022 conn(0x7fb6a00b3390 msgr2=0x7fb6a00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 -- 172.21.15.81:0/3470599022 shutdown_connections 2024-09-21T06:46:15.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.421+0000 7fb6a527e640 1 -- 172.21.15.81:0/3470599022 wait complete. 2024-09-21T06:46:15.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.423+0000 7fb6a527e640 1 Processor -- start 2024-09-21T06:46:15.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.423+0000 7fb6a527e640 1 -- start start 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6a006d9a0 0x7fb6a014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6a00cdfc0 0x7fb6a00aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a00d0430 0x7fb6a009d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a0073610 con 0x7fb6a00d0430 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb6a0073490 con 0x7fb6a00cdfc0 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fb6a0073790 con 0x7fb6a006d9a0 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a00d0430 0x7fb6a009d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a00d0430 0x7fb6a009d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56856/0 (socket says 172.21.15.81:56856) 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 -- 172.21.15.81:0/4067328406 learned_addr learned my addr 172.21.15.81:0/4067328406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69e7fc640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6a00cdfc0 0x7fb6a00aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69effd640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6a006d9a0 0x7fb6a014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 -- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6a006d9a0 msgr2=0x7fb6a014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6a006d9a0 0x7fb6a014c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 -- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6a00cdfc0 msgr2=0x7fb6a00aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6a00cdfc0 0x7fb6a00aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 -- 172.21.15.81:0/4067328406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a01f7bf0 con 0x7fb6a00d0430 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb69f7fe640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a00d0430 0x7fb6a009d400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c760 tx=0x7fb69800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6877fe640 1 -- 172.21.15.81:0/4067328406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb698017070 con 0x7fb6a00d0430 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6877fe640 1 -- 172.21.15.81:0/4067328406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb69800ce10 con 0x7fb6a00d0430 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a014c940 con 0x7fb6a00d0430 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6877fe640 1 -- 172.21.15.81:0/4067328406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6980052b0 con 0x7fb6a00d0430 2024-09-21T06:46:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.425+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6a01f7110 con 0x7fb6a00d0430 2024-09-21T06:46:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.426+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6a0073c60 con 0x7fb6a00d0430 2024-09-21T06:46:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.427+0000 7fb6877fe640 1 -- 172.21.15.81:0/4067328406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb69801a070 con 0x7fb6a00d0430 2024-09-21T06:46:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.428+0000 7fb6877fe640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb68c078bc0 0x7fb68c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.428+0000 7fb6877fe640 1 -- 172.21.15.81:0/4067328406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb69809a890 con 0x7fb6a00d0430 2024-09-21T06:46:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.428+0000 7fb69effd640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb68c078bc0 0x7fb68c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:15.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.429+0000 7fb69effd640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb68c078bc0 0x7fb68c07b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb690033000 tx=0x7fb690004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.432+0000 7fb6877fe640 1 -- 172.21.15.81:0/4067328406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb698021020 con 0x7fb6a00d0430 2024-09-21T06:46:15.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:15.617+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) -- 0x7fb6a00af4a0 con 0x7fb6a00d0430 2024-09-21T06:46:16.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.080+0000 7fb6877fe640 1 -- 172.21.15.81:0/4067328406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v39) ==== 124+0+0 (secure 0 0 0) 0x7fb698062bd0 con 0x7fb6a00d0430 2024-09-21T06:46:16.083 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'data_new' created 2024-09-21T06:46:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb68c078bc0 msgr2=0x7fb68c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb68c078bc0 0x7fb68c07b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb690033000 tx=0x7fb690004730 comp rx=0 tx=0).stop 2024-09-21T06:46:16.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a00d0430 msgr2=0x7fb6a009d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a00d0430 0x7fb6a009d400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c760 tx=0x7fb69800cc20 comp rx=0 tx=0).stop 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 shutdown_connections 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb68c078bc0 0x7fb68c07b0d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6a00d0430 0x7fb6a009d400 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6a00cdfc0 0x7fb6a00aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 --2- 172.21.15.81:0/4067328406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6a006d9a0 0x7fb6a014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 >> 172.21.15.81:0/4067328406 conn(0x7fb6a00b3390 msgr2=0x7fb6a015a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 shutdown_connections 2024-09-21T06:46:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.083+0000 7fb6a527e640 1 -- 172.21.15.81:0/4067328406 wait complete. 2024-09-21T06:46:16.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-09-21T06:46:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 -- 172.21.15.81:0/3040012444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac0d1a50 msgr2=0x7ff3ac15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/3040012444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac0d1a50 0x7ff3ac15d730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0c9210 tx=0x7ff39c02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 -- 172.21.15.81:0/3040012444 shutdown_connections 2024-09-21T06:46:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/3040012444 >> v2:172.21.15.89:3300/0 conn(0x7ff3ac15e0b0 0x7ff3ac15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/3040012444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac0d1a50 0x7ff3ac15d730 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 -- 172.21.15.81:0/3040012444 >> 172.21.15.81:0/3040012444 conn(0x7ff3ac0b4210 msgr2=0x7ff3ac0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 -- 172.21.15.81:0/3040012444 shutdown_connections 2024-09-21T06:46:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.214+0000 7ff3b12b2640 1 -- 172.21.15.81:0/3040012444 wait complete. 2024-09-21T06:46:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.216+0000 7ff3b12b2640 1 Processor -- start 2024-09-21T06:46:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.216+0000 7ff3b12b2640 1 -- start start 2024-09-21T06:46:16.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3b12b2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ac0cfda0 0x7ff3ac0ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:16.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3b12b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ac15e0b0 0x7ff3ac1f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3b12b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac1f2f50 0x7ff3ac151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3b12b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac15ed90 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3b12b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ac15ec10 con 0x7ff3ac15e0b0 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3b12b2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff3ac15ef10 con 0x7ff3ac0cfda0 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac1f2f50 0x7ff3ac151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac1f2f50 0x7ff3ac151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56880/0 (socket says 172.21.15.81:56880) 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3ab7fe640 1 -- 172.21.15.81:0/2058823590 learned_addr learned my addr 172.21.15.81:0/2058823590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3aa7fc640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ac15e0b0 0x7ff3ac1f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.217+0000 7ff3aaffd640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ac0cfda0 0x7ff3ac0ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3ab7fe640 1 -- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ac0cfda0 msgr2=0x7ff3ac0ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3ab7fe640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ac0cfda0 0x7ff3ac0ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3ab7fe640 1 -- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ac15e0b0 msgr2=0x7ff3ac1f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3ab7fe640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ac15e0b0 0x7ff3ac1f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3ab7fe640 1 -- 172.21.15.81:0/2058823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ac0ca7f0 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3ab7fe640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac1f2f50 0x7ff3ac151d30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400e9c0 tx=0x7ff3a400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3a37fe640 1 -- 172.21.15.81:0/2058823590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4004d20 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3a37fe640 1 -- 172.21.15.81:0/2058823590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3a400cb20 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ac1f78f0 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3a37fe640 1 -- 172.21.15.81:0/2058823590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4005020 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.218+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ac151250 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.219+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3ac1f7660 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.220+0000 7ff3a37fe640 1 -- 172.21.15.81:0/2058823590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff3a40051c0 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.221+0000 7ff3a37fe640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff38c078bc0 0x7ff38c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:16.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.221+0000 7ff3a37fe640 1 -- 172.21.15.81:0/2058823590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6464+0+0 (secure 0 0 0) 0x7ff3a409bbd0 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.221+0000 7ff3aaffd640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff38c078bc0 0x7ff38c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:16.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.222+0000 7ff3aaffd640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff38c078bc0 0x7ff38c07b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0cfd50 tx=0x7ff394009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:16.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.225+0000 7ff3a37fe640 1 -- 172.21.15.81:0/2058823590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff3a4016030 con 0x7ff3ac1f2f50 2024-09-21T06:46:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:16.442+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) -- 0x7ff3ac15d730 con 0x7ff3ac1f2f50 2024-09-21T06:46:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.098+0000 7ff3a37fe640 1 -- 172.21.15.81:0/2058823590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v18) ==== 131+0+0 (secure 0 0 0) 0x7ff3a40637d0 con 0x7ff3ac1f2f50 2024-09-21T06:46:17.101 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 7 to fsmap 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.101+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff38c078bc0 msgr2=0x7ff38c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.101+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff38c078bc0 0x7ff38c07b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0cfd50 tx=0x7ff394009040 comp rx=0 tx=0).stop 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac1f2f50 msgr2=0x7ff3ac151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac1f2f50 0x7ff3ac151d30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400e9c0 tx=0x7ff3a400ee80 comp rx=0 tx=0).stop 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 shutdown_connections 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff38c078bc0 0x7ff38c07b0d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ac1f2f50 0x7ff3ac151d30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3ac15e0b0 0x7ff3ac1f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 --2- 172.21.15.81:0/2058823590 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3ac0cfda0 0x7ff3ac0ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 >> 172.21.15.81:0/2058823590 conn(0x7ff3ac0b4210 msgr2=0x7ff3ac0ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 shutdown_connections 2024-09-21T06:46:17.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.102+0000 7ff3b12b2640 1 -- 172.21.15.81:0/2058823590 wait complete. 2024-09-21T06:46:17.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 -- 172.21.15.81:0/2982642333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 msgr2=0x7f4bfc0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 --2- 172.21.15.81:0/2982642333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0d3220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4bec005fd0 tx=0x7f4bec02a5d0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 -- 172.21.15.81:0/2982642333 shutdown_connections 2024-09-21T06:46:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 --2- 172.21.15.81:0/2982642333 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bfc15eda0 0x7f4bfc0b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 --2- 172.21.15.81:0/2982642333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0d3220 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 -- 172.21.15.81:0/2982642333 >> 172.21.15.81:0/2982642333 conn(0x7f4bfc0b7330 msgr2=0x7f4bfc0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 -- 172.21.15.81:0/2982642333 shutdown_connections 2024-09-21T06:46:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.230+0000 7f4c00a77640 1 -- 172.21.15.81:0/2982642333 wait complete. 2024-09-21T06:46:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.232+0000 7f4c00a77640 1 Processor -- start 2024-09-21T06:46:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.232+0000 7f4c00a77640 1 -- start start 2024-09-21T06:46:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.233+0000 7f4c00a77640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bfc0b9c00 0x7f4bfc06f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.233+0000 7f4c00a77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.233+0000 7f4c00a77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc15eda0 0x7f4bfc0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.233+0000 7f4c00a77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0b35c0 con 0x7f4bfc15c450 2024-09-21T06:46:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.233+0000 7f4c00a77640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0b3440 con 0x7f4bfc15eda0 2024-09-21T06:46:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.233+0000 7f4c00a77640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0b3740 con 0x7f4bfc0b9c00 2024-09-21T06:46:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56898/0 (socket says 172.21.15.81:56898) 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 -- 172.21.15.81:0/3093527668 learned_addr learned my addr 172.21.15.81:0/3093527668 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bfa59c640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bfc0b9c00 0x7f4bfc06f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bfad9d640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc15eda0 0x7f4bfc0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 -- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bfc0b9c00 msgr2=0x7f4bfc06f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bfc0b9c00 0x7f4bfc06f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 -- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc15eda0 msgr2=0x7f4bfc0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc15eda0 0x7f4bfc0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 -- 172.21.15.81:0/3093527668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc1f5fc0 con 0x7f4bfc15c450 2024-09-21T06:46:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bfa59c640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bfc0b9c00 0x7f4bfc06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4bf9d9b640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0ca440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000d740 tx=0x7f4bf000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4beaffd640 1 -- 172.21.15.81:0/3093527668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0017070 con 0x7f4bfc15c450 2024-09-21T06:46:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4beaffd640 1 -- 172.21.15.81:0/3093527668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bf0009d20 con 0x7f4bfc15c450 2024-09-21T06:46:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc06def0 con 0x7f4bfc15c450 2024-09-21T06:46:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4beaffd640 1 -- 172.21.15.81:0/3093527668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00106c0 con 0x7f4bfc15c450 2024-09-21T06:46:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.234+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc0cb130 con 0x7f4bfc15c450 2024-09-21T06:46:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.235+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc08d110 con 0x7f4bfc15c450 2024-09-21T06:46:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.236+0000 7f4beaffd640 1 -- 172.21.15.81:0/3093527668 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4bf001a070 con 0x7f4bfc15c450 2024-09-21T06:46:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.236+0000 7f4beaffd640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4bdc078b90 0x7f4bdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.236+0000 7f4beaffd640 1 -- 172.21.15.81:0/3093527668 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7f4bf009b1a0 con 0x7f4bfc15c450 2024-09-21T06:46:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.237+0000 7f4bfa59c640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4bdc078b90 0x7f4bdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.237+0000 7f4bfa59c640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4bdc078b90 0x7f4bdc07b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4bec033000 tx=0x7f4bec004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.241+0000 7f4beaffd640 1 -- 172.21.15.81:0/3093527668 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4bfc08d110 con 0x7f4bfc15c450 2024-09-21T06:46:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.457+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bfc0d3220 con 0x7f4bfc15c450 2024-09-21T06:46:17.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.458+0000 7f4beaffd640 1 -- 172.21.15.81:0/3093527668 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5225 (secure 0 0 0) 0x7f4bfc1f5fc0 con 0x7f4bfc15c450 2024-09-21T06:46:17.460 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:17.460 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-21T06:46:17:090247+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:03.998544+0000","modified":"2024-09-21T06:46:16.444751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/3622751302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":3622751302},{"type":"v1","addr":"172.21.15.89:6837","nonce":3622751302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":2}]} 2024-09-21T06:46:17.461 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-21T06:46:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4bdc078b90 msgr2=0x7f4bdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4bdc078b90 0x7f4bdc07b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4bec033000 tx=0x7f4bec004730 comp rx=0 tx=0).stop 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 msgr2=0x7f4bfc0ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0ca440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000d740 tx=0x7f4bf000dc00 comp rx=0 tx=0).stop 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 shutdown_connections 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4bdc078b90 0x7f4bdc07b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4bfc15eda0 0x7f4bfc0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc15c450 0x7f4bfc0ca440 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 --2- 172.21.15.81:0/3093527668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4bfc0b9c00 0x7f4bfc06f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 >> 172.21.15.81:0/3093527668 conn(0x7f4bfc0b7330 msgr2=0x7f4bfc0cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:17.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 shutdown_connections 2024-09-21T06:46:17.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.460+0000 7f4c00a77640 1 -- 172.21.15.81:0/3093527668 wait complete. 2024-09-21T06:46:17.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 -- 172.21.15.81:0/1234734064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015eda0 msgr2=0x7f66100b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 --2- 172.21.15.81:0/1234734064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015eda0 0x7f66100b96c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f66100d3e70 tx=0x7f660002a560 comp rx=0 tx=0).stop 2024-09-21T06:46:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 -- 172.21.15.81:0/1234734064 shutdown_connections 2024-09-21T06:46:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 --2- 172.21.15.81:0/1234734064 >> v2:172.21.15.89:3300/0 conn(0x7f66100b9c00 0x7f66100d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 --2- 172.21.15.81:0/1234734064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015eda0 0x7f66100b96c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 --2- 172.21.15.81:0/1234734064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f661015c450 0x7f66100d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 -- 172.21.15.81:0/1234734064 >> 172.21.15.81:0/1234734064 conn(0x7f66100b7330 msgr2=0x7f66100b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 -- 172.21.15.81:0/1234734064 shutdown_connections 2024-09-21T06:46:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.583+0000 7f661847e640 1 -- 172.21.15.81:0/1234734064 wait complete. 2024-09-21T06:46:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.585+0000 7f661847e640 1 Processor -- start 2024-09-21T06:46:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.585+0000 7f661847e640 1 -- start start 2024-09-21T06:46:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661847e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66100b9c00 0x7f661006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661847e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015c450 0x7f66101f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661847e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f661015eda0 0x7f66100b6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661847e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66100b3230 con 0x7f661015c450 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661847e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f66100d4ae0 con 0x7f661015eda0 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661847e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f66100b33b0 con 0x7f66100b9c00 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015c450 0x7f66101f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015c450 0x7f66101f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56920/0 (socket says 172.21.15.81:56920) 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 -- 172.21.15.81:0/3646104163 learned_addr learned my addr 172.21.15.81:0/3646104163 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6616a1b640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f661015eda0 0x7f66100b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661621a640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66100b9c00 0x7f661006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 -- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66100b9c00 msgr2=0x7f661006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66100b9c00 0x7f661006d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 -- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f661015eda0 msgr2=0x7f66100b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f661015eda0 0x7f66100b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f6615a19640 1 -- 172.21.15.81:0/3646104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66100b52e0 con 0x7f661015c450 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.586+0000 7f661621a640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66100b9c00 0x7f661006d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.587+0000 7f6615a19640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015c450 0x7f66101f5300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6600034040 tx=0x7f66000039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.587+0000 7f6606ffd640 1 -- 172.21.15.81:0/3646104163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660003e030 con 0x7f661015c450 2024-09-21T06:46:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.587+0000 7f6606ffd640 1 -- 172.21.15.81:0/3646104163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66000047a0 con 0x7f661015c450 2024-09-21T06:46:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.587+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66100b55c0 con 0x7f661015c450 2024-09-21T06:46:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.587+0000 7f6606ffd640 1 -- 172.21.15.81:0/3646104163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600035040 con 0x7f661015c450 2024-09-21T06:46:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.587+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66100b5b80 con 0x7f661015c450 2024-09-21T06:46:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.588+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66100b5050 con 0x7f661015c450 2024-09-21T06:46:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.588+0000 7f6606ffd640 1 -- 172.21.15.81:0/3646104163 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6600041030 con 0x7f661015c450 2024-09-21T06:46:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.589+0000 7f6606ffd640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f65f4078b90 0x7f65f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.589+0000 7f6606ffd640 1 -- 172.21.15.81:0/3646104163 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7f66000bb860 con 0x7f661015c450 2024-09-21T06:46:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.589+0000 7f661621a640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f65f4078b90 0x7f65f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.590+0000 7f661621a640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f65f4078b90 0x7f65f407b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f661008c9c0 tx=0x7f660c005d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.594+0000 7f6606ffd640 1 -- 172.21.15.81:0/3646104163 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6600083990 con 0x7f661015c450 2024-09-21T06:46:17.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.771+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66100b3870 con 0x7f661015c450 2024-09-21T06:46:17.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.773+0000 7f6606ffd640 1 -- 172.21.15.81:0/3646104163 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+18811 (secure 0 0 0) 0x7f6600083290 con 0x7f661015c450 2024-09-21T06:46:17.775 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:17.775 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:16.444522+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:01.666905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:02.952864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-09-21T06:46:15.622557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f65f4078b90 msgr2=0x7f65f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f65f4078b90 0x7f65f407b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f661008c9c0 tx=0x7f660c005d50 comp rx=0 tx=0).stop 2024-09-21T06:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015c450 msgr2=0x7f66101f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015c450 0x7f66101f5300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6600034040 tx=0x7f66000039e0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 shutdown_connections 2024-09-21T06:46:17.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f65f4078b90 0x7f65f407b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f661015eda0 0x7f66100b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661015c450 0x7f66101f5300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 --2- 172.21.15.81:0/3646104163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66100b9c00 0x7f661006d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 >> 172.21.15.81:0/3646104163 conn(0x7f66100b7330 msgr2=0x7f66100cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 shutdown_connections 2024-09-21T06:46:17.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:17.775+0000 7f661847e640 1 -- 172.21.15.81:0/3646104163 wait complete. 2024-09-21T06:46:17.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:17.789 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2024-09-21T06:46:17.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:17.808 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2024-09-21T06:46:17.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-09-21T06:46:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 -- 172.21.15.81:0/2858568787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15a290 msgr2=0x7f479c1601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 --2- 172.21.15.81:0/2858568787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15a290 0x7f479c1601c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f479c074d80 tx=0x7f479002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 -- 172.21.15.81:0/2858568787 shutdown_connections 2024-09-21T06:46:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 --2- 172.21.15.81:0/2858568787 >> v2:172.21.15.89:3300/0 conn(0x7f479c15d2c0 0x7f479c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 --2- 172.21.15.81:0/2858568787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15a290 0x7f479c1601c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 -- 172.21.15.81:0/2858568787 >> 172.21.15.81:0/2858568787 conn(0x7f479c0d25e0 msgr2=0x7f479c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 -- 172.21.15.81:0/2858568787 shutdown_connections 2024-09-21T06:46:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.023+0000 7f47a20de640 1 -- 172.21.15.81:0/2858568787 wait complete. 2024-09-21T06:46:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.025+0000 7f47a20de640 1 Processor -- start 2024-09-21T06:46:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.025+0000 7f47a20de640 1 -- start start 2024-09-21T06:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f47a20de640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c0d19a0 0x7f479c0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f47a20de640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c15a290 0x7f479c1f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f47a20de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15d2c0 0x7f479c1f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f47a20de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f479c072ec0 con 0x7f479c15d2c0 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f47a20de640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f479c072d40 con 0x7f479c15a290 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f47a20de640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f479c073040 con 0x7f479c0d19a0 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f479bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15d2c0 0x7f479c1f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f479bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15d2c0 0x7f479c1f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56938/0 (socket says 172.21.15.81:56938) 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f479bfff640 1 -- 172.21.15.81:0/13189354 learned_addr learned my addr 172.21.15.81:0/13189354 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f479affd640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c15a290 0x7f479c1f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.026+0000 7f479b7fe640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c0d19a0 0x7f479c0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f479bfff640 1 -- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c0d19a0 msgr2=0x7f479c0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f479bfff640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c0d19a0 0x7f479c0cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f479bfff640 1 -- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c15a290 msgr2=0x7f479c1f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f479bfff640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c15a290 0x7f479c1f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f479bfff640 1 -- 172.21.15.81:0/13189354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c0cbf30 con 0x7f479c15d2c0 2024-09-21T06:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f479b7fe640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c0d19a0 0x7f479c0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f479bfff640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15d2c0 0x7f479c1f4f70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f479400e960 tx=0x7f479400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f4783fff640 1 -- 172.21.15.81:0/13189354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794004d20 con 0x7f479c15d2c0 2024-09-21T06:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f4783fff640 1 -- 172.21.15.81:0/13189354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f479400cb20 con 0x7f479c15d2c0 2024-09-21T06:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479c0b6c50 con 0x7f479c15d2c0 2024-09-21T06:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f4783fff640 1 -- 172.21.15.81:0/13189354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794005020 con 0x7f479c15d2c0 2024-09-21T06:46:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.027+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479c0b7210 con 0x7f479c15d2c0 2024-09-21T06:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.028+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c0b3480 con 0x7f479c15d2c0 2024-09-21T06:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.029+0000 7f4783fff640 1 -- 172.21.15.81:0/13189354 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47940051c0 con 0x7f479c15d2c0 2024-09-21T06:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.029+0000 7f4783fff640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4788078bc0 0x7f478807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.029+0000 7f4783fff640 1 -- 172.21.15.81:0/13189354 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6496+0+0 (secure 0 0 0) 0x7f479409b7e0 con 0x7f479c15d2c0 2024-09-21T06:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.029+0000 7f479b7fe640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4788078bc0 0x7f478807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.030+0000 7f479b7fe640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4788078bc0 0x7f478807b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f478c006fd0 tx=0x7f478c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.034+0000 7f4783fff640 1 -- 172.21.15.81:0/13189354 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f479c0b3480 con 0x7f479c15d2c0 2024-09-21T06:46:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.281+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7f479c073590 con 0x7f479c15d2c0 2024-09-21T06:46:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.284+0000 7f4783fff640 1 -- 172.21.15.81:0/13189354 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v34) ==== 210+0+167 (secure 0 0 0) 0x7f4794099e20 con 0x7f479c15d2c0 2024-09-21T06:46:18.286 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:18.286 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:18.286 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow rw" 2024-09-21T06:46:18.286 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:18.286 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-09-21T06:46:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:18.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4788078bc0 msgr2=0x7f478807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4788078bc0 0x7f478807b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f478c006fd0 tx=0x7f478c008040 comp rx=0 tx=0).stop 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15d2c0 msgr2=0x7f479c1f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15d2c0 0x7f479c1f4f70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f479400e960 tx=0x7f479400ee20 comp rx=0 tx=0).stop 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 shutdown_connections 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4788078bc0 0x7f478807b0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479c15d2c0 0x7f479c1f4f70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f479c15a290 0x7f479c1f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 --2- 172.21.15.81:0/13189354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f479c0d19a0 0x7f479c0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 >> 172.21.15.81:0/13189354 conn(0x7f479c0d25e0 msgr2=0x7f479c15aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 shutdown_connections 2024-09-21T06:46:18.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.286+0000 7f47a20de640 1 -- 172.21.15.81:0/13189354 wait complete. 2024-09-21T06:46:18.299 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:18.299 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:18.315 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:18.315 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:18.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:46:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 -- 172.21.15.81:0/358543098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7134152810 msgr2=0x7f71340afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 --2- 172.21.15.81:0/358543098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7134152810 0x7f71340afe00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7130005fd0 tx=0x7f713002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 -- 172.21.15.81:0/358543098 shutdown_connections 2024-09-21T06:46:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 --2- 172.21.15.81:0/358543098 >> v2:172.21.15.89:3300/0 conn(0x7f713406f6e0 0x7f713406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 --2- 172.21.15.81:0/358543098 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7134152810 0x7f71340afe00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 -- 172.21.15.81:0/358543098 >> 172.21.15.81:0/358543098 conn(0x7f71340cd370 msgr2=0x7f71340cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 -- 172.21.15.81:0/358543098 shutdown_connections 2024-09-21T06:46:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.522+0000 7f713be25640 1 -- 172.21.15.81:0/358543098 wait complete. 2024-09-21T06:46:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.524+0000 7f713be25640 1 Processor -- start 2024-09-21T06:46:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.524+0000 7f713be25640 1 -- start start 2024-09-21T06:46:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f713be25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f713406f6e0 0x7f71341f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f713be25640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f713415f100 0x7f713414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f713be25640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71340c9c40 0x7f71340ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f713be25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71340701b0 con 0x7f713406f6e0 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f713be25640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f7134070030 con 0x7f713415f100 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f713be25640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f7134070330 con 0x7f71340c9c40 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f7139bc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f713406f6e0 0x7f71341f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f7139bc1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f713406f6e0 0x7f71341f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60576/0 (socket says 172.21.15.81:60576) 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f7139bc1640 1 -- 172.21.15.81:0/659425152 learned_addr learned my addr 172.21.15.81:0/659425152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f713a3c2640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71340c9c40 0x7f71340ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.525+0000 7f71393c0640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f713415f100 0x7f713414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f7139bc1640 1 -- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71340c9c40 msgr2=0x7f71340ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f7139bc1640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71340c9c40 0x7f71340ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f7139bc1640 1 -- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f713415f100 msgr2=0x7f713414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f7139bc1640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f713415f100 0x7f713414d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f7139bc1640 1 -- 172.21.15.81:0/659425152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71341fa0d0 con 0x7f713406f6e0 2024-09-21T06:46:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f7139bc1640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f713406f6e0 0x7f71341f9b90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7130034040 tx=0x7f71300035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f712a7fc640 1 -- 172.21.15.81:0/659425152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713003e030 con 0x7f713406f6e0 2024-09-21T06:46:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71340ca590 con 0x7f713406f6e0 2024-09-21T06:46:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f712a7fc640 1 -- 172.21.15.81:0/659425152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7130003b00 con 0x7f713406f6e0 2024-09-21T06:46:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f712a7fc640 1 -- 172.21.15.81:0/659425152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130035040 con 0x7f713406f6e0 2024-09-21T06:46:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.526+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7134151c90 con 0x7f713406f6e0 2024-09-21T06:46:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.527+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71341520b0 con 0x7f713406f6e0 2024-09-21T06:46:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.528+0000 7f712a7fc640 1 -- 172.21.15.81:0/659425152 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7130041030 con 0x7f713406f6e0 2024-09-21T06:46:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.529+0000 7f712a7fc640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7118078bc0 0x7f711807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.529+0000 7f712a7fc640 1 -- 172.21.15.81:0/659425152 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f71300bb4a0 con 0x7f713406f6e0 2024-09-21T06:46:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.529+0000 7f71393c0640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7118078bc0 0x7f711807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.530+0000 7f71393c0640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7118078bc0 0x7f711807b0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f713406d8a0 tx=0x7f7124009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.533+0000 7f712a7fc640 1 -- 172.21.15.81:0/659425152 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71341520b0 con 0x7f713406f6e0 2024-09-21T06:46:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.725+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f71340707e0 con 0x7f713406f6e0 2024-09-21T06:46:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.725+0000 7f712a7fc640 1 -- 172.21.15.81:0/659425152 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7f71340ca590 con 0x7f713406f6e0 2024-09-21T06:46:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:46:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7118078bc0 msgr2=0x7f711807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7118078bc0 0x7f711807b0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f713406d8a0 tx=0x7f7124009040 comp rx=0 tx=0).stop 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f713406f6e0 msgr2=0x7f71341f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f713406f6e0 0x7f71341f9b90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7130034040 tx=0x7f71300035f0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 shutdown_connections 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7118078bc0 0x7f711807b0d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71340c9c40 0x7f71340ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f713415f100 0x7f713414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 --2- 172.21.15.81:0/659425152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f713406f6e0 0x7f71341f9b90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 >> 172.21.15.81:0/659425152 conn(0x7f71340cd370 msgr2=0x7f71340b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 shutdown_connections 2024-09-21T06:46:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.727+0000 7f713be25640 1 -- 172.21.15.81:0/659425152 wait complete. 2024-09-21T06:46:18.740 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:46:18.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:18.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:18.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:46:18.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:18.774 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:46:18.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 -- 172.21.15.81:0/1772515456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84200b9c00 msgr2=0x7f84200d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 --2- 172.21.15.81:0/1772515456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84200b9c00 0x7f84200d41a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8418005fd0 tx=0x7f841802aa00 comp rx=0 tx=0).stop 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 -- 172.21.15.81:0/1772515456 shutdown_connections 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 --2- 172.21.15.81:0/1772515456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84200b9c00 0x7f84200d41a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 --2- 172.21.15.81:0/1772515456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84200d3220 0x7f84200b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 -- 172.21.15.81:0/1772515456 >> 172.21.15.81:0/1772515456 conn(0x7f84200b7330 msgr2=0x7f84200b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 -- 172.21.15.81:0/1772515456 shutdown_connections 2024-09-21T06:46:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.979+0000 7f8425520640 1 -- 172.21.15.81:0/1772515456 wait complete. 2024-09-21T06:46:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.981+0000 7f8425520640 1 Processor -- start 2024-09-21T06:46:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.981+0000 7f8425520640 1 -- start start 2024-09-21T06:46:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.982+0000 7f8425520640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84200b9c00 0x7f842014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8425520640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84200d3220 0x7f84200cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8425520640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842015c450 0x7f84200b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8425520640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84200b35c0 con 0x7f842015c450 2024-09-21T06:46:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8425520640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f84200b3440 con 0x7f84200b9c00 2024-09-21T06:46:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8425520640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f84200b3740 con 0x7f84200d3220 2024-09-21T06:46:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842015c450 0x7f84200b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842015c450 0x7f84200b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60588/0 (socket says 172.21.15.81:60588) 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 -- 172.21.15.81:0/3587377920 learned_addr learned my addr 172.21.15.81:0/3587377920 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f84167fc640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84200d3220 0x7f84200cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841effd640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84200b9c00 0x7f842014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 -- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84200d3220 msgr2=0x7f84200cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84200d3220 0x7f84200cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 -- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84200b9c00 msgr2=0x7f842014eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84200b9c00 0x7f842014eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 -- 172.21.15.81:0/3587377920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8420150100 con 0x7f842015c450 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f84167fc640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84200d3220 0x7f84200cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f841f7fe640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842015c450 0x7f84200b1fc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8418006010 tx=0x7f841802f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8417fff640 1 -- 172.21.15.81:0/3587377920 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418046070 con 0x7f842015c450 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8417fff640 1 -- 172.21.15.81:0/3587377920 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84180045c0 con 0x7f842015c450 2024-09-21T06:46:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8417fff640 1 -- 172.21.15.81:0/3587377920 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418033070 con 0x7f842015c450 2024-09-21T06:46:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842014f580 con 0x7f842015c450 2024-09-21T06:46:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.983+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842014fb40 con 0x7f842015c450 2024-09-21T06:46:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.984+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84200b6cd0 con 0x7f842015c450 2024-09-21T06:46:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.985+0000 7f8417fff640 1 -- 172.21.15.81:0/3587377920 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8418049070 con 0x7f842015c450 2024-09-21T06:46:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.986+0000 7f8417fff640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8400078b90 0x7f840007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.986+0000 7f8417fff640 1 -- 172.21.15.81:0/3587377920 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f84180bc200 con 0x7f842015c450 2024-09-21T06:46:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.986+0000 7f841effd640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8400078b90 0x7f840007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.986+0000 7f841effd640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8400078b90 0x7f840007b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f842008c9c0 tx=0x7f8410008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:18.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:18.990+0000 7f8417fff640 1 -- 172.21.15.81:0/3587377920 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f84200b6cd0 con 0x7f842015c450 2024-09-21T06:46:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.203+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84200d41a0 con 0x7f842015c450 2024-09-21T06:46:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.203+0000 7f8417fff640 1 -- 172.21.15.81:0/3587377920 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+82 (secure 0 0 0) 0x7f841803e070 con 0x7f842015c450 2024-09-21T06:46:19.206 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-09-21T06:46:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8400078b90 msgr2=0x7f840007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8400078b90 0x7f840007b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f842008c9c0 tx=0x7f8410008040 comp rx=0 tx=0).stop 2024-09-21T06:46:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842015c450 msgr2=0x7f84200b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842015c450 0x7f84200b1fc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8418006010 tx=0x7f841802f6d0 comp rx=0 tx=0).stop 2024-09-21T06:46:19.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 shutdown_connections 2024-09-21T06:46:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8400078b90 0x7f840007b0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84200d3220 0x7f84200cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f842015c450 0x7f84200b1fc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 --2- 172.21.15.81:0/3587377920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84200b9c00 0x7f842014eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.205+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 >> 172.21.15.81:0/3587377920 conn(0x7f84200b7330 msgr2=0x7f8420068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.206+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 shutdown_connections 2024-09-21T06:46:19.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19.206+0000 7f8425520640 1 -- 172.21.15.81:0/3587377920 wait complete. 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:46:19.219 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:19.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.220 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:46:19.235 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:46:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:46:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42691sec preferred_lft 42691sec 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5807:98ff:feed:57f8/64 scope link 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1029:45ff:fefa:d01b/64 scope link 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:19.237 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ea:d1:bd:3b:72:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:46:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e8d1:bdff:fe3b:7274/64 scope link 2024-09-21T06:46:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:19.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.238 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:46:19.299 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:46:19.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.300 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:46:19.357 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:46:19.357 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:46:19.357 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:46:19.357 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:46:19.357 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:46:19.357 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:46:19.358 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:46:19.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:46:19.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:46:19.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:46:19.358 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:46:19.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:46:19.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:19.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.483 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:46:19.498 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:46:19.498 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:46:19.498 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:19.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:46:19.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:19.562 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:19.618 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:19.619 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:19.619 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:19.674 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:46:19.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:19.768 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:19.768 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:19.776 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:19.777 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:19.777 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:46:19.777 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:46:19.777 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:46:19.778 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:46:19.778 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:46:19.778 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:46:19.778 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:46:19.778 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:46:19.779 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:46:19.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:19.804 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:46:19.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:46:19.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:19.900 INFO:teuthology.orchestra.run.smithi081.stdout:client4859 2024-09-21T06:46:19.900 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:19.900 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:19.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.916 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-09-21T06:46:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:setfattr: layoutfile: Permission denied 2024-09-21T06:46:19.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:46:19.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:19.973 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-09-21T06:46:20.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:46:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:setfattr: layoutdir: Permission denied 2024-09-21T06:46:20.029 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:20.029 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:20.086 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:20.086 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:20.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:46:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.294+0000 7fe67108b640 1 -- 172.21.15.81:0/1499500826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6580053a0 msgr2=0x7fe65800ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.294+0000 7fe67108b640 1 --2- 172.21.15.81:0/1499500826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6580053a0 0x7fe65800ba50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe664001dc0 tx=0x7fe658005830 comp rx=0 tx=0).stop 2024-09-21T06:46:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.294+0000 7fe67108b640 1 -- 172.21.15.81:0/1499500826 shutdown_connections 2024-09-21T06:46:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.294+0000 7fe67108b640 1 --2- 172.21.15.81:0/1499500826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6580053a0 0x7fe65800ba50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.294+0000 7fe67108b640 1 -- 172.21.15.81:0/1499500826 >> 172.21.15.81:0/1499500826 conn(0x7fe66c0d25e0 msgr2=0x7fe66c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.294+0000 7fe67108b640 1 -- 172.21.15.81:0/1499500826 shutdown_connections 2024-09-21T06:46:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.294+0000 7fe67108b640 1 -- 172.21.15.81:0/1499500826 wait complete. 2024-09-21T06:46:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.296+0000 7fe67108b640 1 Processor -- start 2024-09-21T06:46:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.297+0000 7fe67108b640 1 -- start start 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe67108b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6580053a0 0x7fe66c14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe67108b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe66c0c74b0 0x7fe66c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe67108b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe66c15fae0 0x7fe66c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe67108b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1601c0 con 0x7fe66c0c74b0 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe67108b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c15dbb0 con 0x7fe66c15fae0 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe67108b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c160340 con 0x7fe6580053a0 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe66c0c74b0 0x7fe66c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe66c0c74b0 0x7fe66c0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60620/0 (socket says 172.21.15.81:60620) 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 -- 172.21.15.81:0/791739478 learned_addr learned my addr 172.21.15.81:0/791739478 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66ad9d640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6580053a0 0x7fe66c14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66b59e640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe66c15fae0 0x7fe66c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 -- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6580053a0 msgr2=0x7fe66c14f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6580053a0 0x7fe66c14f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 -- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe66c15fae0 msgr2=0x7fe66c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe66c15fae0 0x7fe66c0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 -- 172.21.15.81:0/791739478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c06dea0 con 0x7fe66c0c74b0 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66b59e640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe66c15fae0 0x7fe66c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.298+0000 7fe66259c640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe66c0c74b0 0x7fe66c0c7b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe654003f50 tx=0x7fe65400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.299+0000 7fe663fff640 1 -- 172.21.15.81:0/791739478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654010770 con 0x7fe66c0c74b0 2024-09-21T06:46:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.299+0000 7fe663fff640 1 -- 172.21.15.81:0/791739478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe654010910 con 0x7fe66c0c74b0 2024-09-21T06:46:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.299+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c0c6a70 con 0x7fe66c0c74b0 2024-09-21T06:46:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.299+0000 7fe663fff640 1 -- 172.21.15.81:0/791739478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654010d40 con 0x7fe66c0c74b0 2024-09-21T06:46:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.299+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c0c7030 con 0x7fe66c0c74b0 2024-09-21T06:46:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.300+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66c0b1be0 con 0x7fe66c0c74b0 2024-09-21T06:46:20.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.300+0000 7fe663fff640 1 -- 172.21.15.81:0/791739478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe654023440 con 0x7fe66c0c74b0 2024-09-21T06:46:20.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.301+0000 7fe663fff640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe64c078bc0 0x7fe64c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.301+0000 7fe663fff640 1 -- 172.21.15.81:0/791739478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fe65409bb80 con 0x7fe66c0c74b0 2024-09-21T06:46:20.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.301+0000 7fe66ad9d640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe64c078bc0 0x7fe64c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.302+0000 7fe66ad9d640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe64c078bc0 0x7fe64c07b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe65c001850 tx=0x7fe65c0067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.306+0000 7fe663fff640 1 -- 172.21.15.81:0/791739478 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe654063d50 con 0x7fe66c0c74b0 2024-09-21T06:46:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.493+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe66c159c60 con 0x7fe66c0c74b0 2024-09-21T06:46:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.493+0000 7fe663fff640 1 -- 172.21.15.81:0/791739478 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7fe654063650 con 0x7fe66c0c74b0 2024-09-21T06:46:20.496 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:46:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.495+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe64c078bc0 msgr2=0x7fe64c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.495+0000 7fe67108b640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe64c078bc0 0x7fe64c07b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe65c001850 tx=0x7fe65c0067a0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.495+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe66c0c74b0 msgr2=0x7fe66c0c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.495+0000 7fe67108b640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe66c0c74b0 0x7fe66c0c7b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe654003f50 tx=0x7fe65400ba40 comp rx=0 tx=0).stop 2024-09-21T06:46:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 shutdown_connections 2024-09-21T06:46:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe64c078bc0 0x7fe64c07b0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe66c15fae0 0x7fe66c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe66c0c74b0 0x7fe66c0c7b90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 --2- 172.21.15.81:0/791739478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6580053a0 0x7fe66c14f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 >> 172.21.15.81:0/791739478 conn(0x7fe66c0d25e0 msgr2=0x7fe66c15ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 shutdown_connections 2024-09-21T06:46:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.496+0000 7fe67108b640 1 -- 172.21.15.81:0/791739478 wait complete. 2024-09-21T06:46:20.509 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:46:20.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:20.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:20.538 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:46:20.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:20.538 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:46:20.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2024-09-21T06:46:20.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.753+0000 7f747a63f640 1 -- 172.21.15.81:0/1430504121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f747415dd10 msgr2=0x7f74741607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.753+0000 7f747a63f640 1 --2- 172.21.15.81:0/1430504121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f747415dd10 0x7f74741607c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7468009830 tx=0x7f746802a510 comp rx=0 tx=0).stop 2024-09-21T06:46:20.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.753+0000 7f747a63f640 1 -- 172.21.15.81:0/1430504121 shutdown_connections 2024-09-21T06:46:20.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.753+0000 7f747a63f640 1 --2- 172.21.15.81:0/1430504121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f747415dd10 0x7f74741607c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.753+0000 7f747a63f640 1 --2- 172.21.15.81:0/1430504121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7474160d00 0x7f74740ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.753+0000 7f747a63f640 1 -- 172.21.15.81:0/1430504121 >> 172.21.15.81:0/1430504121 conn(0x7f74740d2250 msgr2=0x7f74740d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:20.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.754+0000 7f747a63f640 1 -- 172.21.15.81:0/1430504121 shutdown_connections 2024-09-21T06:46:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.754+0000 7f747a63f640 1 -- 172.21.15.81:0/1430504121 wait complete. 2024-09-21T06:46:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.755+0000 7f747a63f640 1 Processor -- start 2024-09-21T06:46:20.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.755+0000 7f747a63f640 1 -- start start 2024-09-21T06:46:20.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f747a63f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74740cfe20 0x7f7474151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f747a63f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415dd10 0x7f74741f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f747a63f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7474160d00 0x7f74741f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f747a63f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74740d1590 con 0x7f747415dd10 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f747a63f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f74740d1410 con 0x7f7474160d00 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f747a63f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f74740d1710 con 0x7f74740cfe20 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415dd10 0x7f74741f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415dd10 0x7f74741f6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60622/0 (socket says 172.21.15.81:60622) 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 -- 172.21.15.81:0/4161542542 learned_addr learned my addr 172.21.15.81:0/4161542542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f7478bdc640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7474160d00 0x7f74741f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f7473fff640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74740cfe20 0x7f7474151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 -- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74740cfe20 msgr2=0x7f7474151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74740cfe20 0x7f7474151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 -- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7474160d00 msgr2=0x7f74741f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7474160d00 0x7f74741f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 -- 172.21.15.81:0/4161542542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747414f7b0 con 0x7f747415dd10 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.757+0000 7f74737fe640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415dd10 0x7f74741f6ab0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7468009950 tx=0x7f7468033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:20.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.758+0000 7f7470ff9640 1 -- 172.21.15.81:0/4161542542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468031d60 con 0x7f747415dd10 2024-09-21T06:46:20.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.758+0000 7f7470ff9640 1 -- 172.21.15.81:0/4161542542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7468033e10 con 0x7f747415dd10 2024-09-21T06:46:20.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.758+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747414fa90 con 0x7f747415dd10 2024-09-21T06:46:20.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.758+0000 7f7470ff9640 1 -- 172.21.15.81:0/4161542542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468005260 con 0x7f747415dd10 2024-09-21T06:46:20.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.758+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7474150050 con 0x7f747415dd10 2024-09-21T06:46:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.759+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74740d1bc0 con 0x7f747415dd10 2024-09-21T06:46:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.759+0000 7f7470ff9640 1 -- 172.21.15.81:0/4161542542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7468005400 con 0x7f747415dd10 2024-09-21T06:46:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.760+0000 7f7470ff9640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7460078b90 0x7f746007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.760+0000 7f7470ff9640 1 -- 172.21.15.81:0/4161542542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f74680bc060 con 0x7f747415dd10 2024-09-21T06:46:20.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.760+0000 7f7473fff640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7460078b90 0x7f746007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.761+0000 7f7473fff640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7460078b90 0x7f746007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74740d2130 tx=0x7f7464009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:20.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:20.765+0000 7f7470ff9640 1 -- 172.21.15.81:0/4161542542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f746803f030 con 0x7f747415dd10 2024-09-21T06:46:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.010+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) -- 0x7f7474157a00 con 0x7f747415dd10 2024-09-21T06:46:21.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.012+0000 7f7470ff9640 1 -- 172.21.15.81:0/4161542542 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v35) ==== 211+0+168 (secure 0 0 0) 0x7f7468083bd0 con 0x7f747415dd10 2024-09-21T06:46:21.015 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:21.015 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:21.015 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow rwp" 2024-09-21T06:46:21.015 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:21.015 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2024-09-21T06:46:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7460078b90 msgr2=0x7f746007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7460078b90 0x7f746007b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74740d2130 tx=0x7f7464009040 comp rx=0 tx=0).stop 2024-09-21T06:46:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415dd10 msgr2=0x7f74741f6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415dd10 0x7f74741f6ab0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7468009950 tx=0x7f7468033c20 comp rx=0 tx=0).stop 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 shutdown_connections 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f7460078b90 0x7f746007b0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7474160d00 0x7f74741f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415dd10 0x7f74741f6ab0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 --2- 172.21.15.81:0/4161542542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f74740cfe20 0x7f7474151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.014+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 >> 172.21.15.81:0/4161542542 conn(0x7f74740d2250 msgr2=0x7f7474071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.015+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 shutdown_connections 2024-09-21T06:46:21.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.015+0000 7f747a63f640 1 -- 172.21.15.81:0/4161542542 wait complete. 2024-09-21T06:46:21.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:46:21.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.140+0000 7f59628c5640 1 -- 172.21.15.81:0/2370672304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 msgr2=0x7f594400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.140+0000 7f59628c5640 1 --2- 172.21.15.81:0/2370672304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f594400b9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5954009ed0 tx=0x7f5944005830 comp rx=0 tx=0).stop 2024-09-21T06:46:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.140+0000 7f59628c5640 1 -- 172.21.15.81:0/2370672304 shutdown_connections 2024-09-21T06:46:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.140+0000 7f59628c5640 1 --2- 172.21.15.81:0/2370672304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f594400b9c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.140+0000 7f59628c5640 1 -- 172.21.15.81:0/2370672304 >> 172.21.15.81:0/2370672304 conn(0x7f595c0d1260 msgr2=0x7f595c073680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.140+0000 7f59628c5640 1 -- 172.21.15.81:0/2370672304 shutdown_connections 2024-09-21T06:46:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.140+0000 7f59628c5640 1 -- 172.21.15.81:0/2370672304 wait complete. 2024-09-21T06:46:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.142+0000 7f59628c5640 1 Processor -- start 2024-09-21T06:46:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.142+0000 7f59628c5640 1 -- start start 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f59628c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f595c158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f59628c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595c0cf080 0x7f595c1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f59628c5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f595c155840 0x7f595c168920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f59628c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f595c06aec0 con 0x7f5944005280 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f59628c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f595c06ad40 con 0x7f595c0cf080 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f59628c5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f595c06b040 con 0x7f595c155840 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f595bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f595c158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f595bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f595c158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60638/0 (socket says 172.21.15.81:60638) 2024-09-21T06:46:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f595bfff640 1 -- 172.21.15.81:0/3326730977 learned_addr learned my addr 172.21.15.81:0/3326730977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f5960e62640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f595c155840 0x7f595c168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.143+0000 7f595b7fe640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595c0cf080 0x7f595c1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f595bfff640 1 -- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f595c155840 msgr2=0x7f595c168920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f595bfff640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f595c155840 0x7f595c168920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f595bfff640 1 -- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595c0cf080 msgr2=0x7f595c1491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f595bfff640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595c0cf080 0x7f595c1491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f595bfff640 1 -- 172.21.15.81:0/3326730977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c0d0030 con 0x7f5944005280 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f595bfff640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f595c158740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f594c003d60 tx=0x7f594c001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f5958ff9640 1 -- 172.21.15.81:0/3326730977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c011640 con 0x7f5944005280 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f5958ff9640 1 -- 172.21.15.81:0/3326730977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f594c016020 con 0x7f5944005280 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c0d0310 con 0x7f5944005280 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f5958ff9640 1 -- 172.21.15.81:0/3326730977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c011a60 con 0x7f5944005280 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.144+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c149730 con 0x7f5944005280 2024-09-21T06:46:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.145+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595c0af7e0 con 0x7f5944005280 2024-09-21T06:46:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.146+0000 7f5958ff9640 1 -- 172.21.15.81:0/3326730977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f594c011c00 con 0x7f5944005280 2024-09-21T06:46:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.146+0000 7f5958ff9640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5948078b90 0x7f594807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.146+0000 7f5958ff9640 1 -- 172.21.15.81:0/3326730977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f594c09bc60 con 0x7f5944005280 2024-09-21T06:46:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.146+0000 7f595b7fe640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5948078b90 0x7f594807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.147+0000 7f595b7fe640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5948078b90 0x7f594807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5950001860 tx=0x7f5950001150 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.151+0000 7f5958ff9640 1 -- 172.21.15.81:0/3326730977 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f594c020020 con 0x7f5944005280 2024-09-21T06:46:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.365+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f595c1563d0 con 0x7f5944005280 2024-09-21T06:46:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.365+0000 7f5958ff9640 1 -- 172.21.15.81:0/3326730977 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+82 (secure 0 0 0) 0x7f594c063eb0 con 0x7f5944005280 2024-09-21T06:46:21.368 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2024-09-21T06:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5948078b90 msgr2=0x7f594807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5948078b90 0x7f594807b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5950001860 tx=0x7f5950001150 comp rx=0 tx=0).stop 2024-09-21T06:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 msgr2=0x7f595c158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f595c158740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f594c003d60 tx=0x7f594c001800 comp rx=0 tx=0).stop 2024-09-21T06:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 shutdown_connections 2024-09-21T06:46:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5948078b90 0x7f594807b0a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f595c155840 0x7f595c168920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f595c0cf080 0x7f595c1491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 --2- 172.21.15.81:0/3326730977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5944005280 0x7f595c158740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 >> 172.21.15.81:0/3326730977 conn(0x7f595c0d1260 msgr2=0x7f595c15a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 shutdown_connections 2024-09-21T06:46:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21.368+0000 7f59628c5640 1 -- 172.21.15.81:0/3326730977 wait complete. 2024-09-21T06:46:21.381 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:46:21.381 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:46:21.382 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:46:21.382 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:46:21.382 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:21.382 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:46:21.382 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:46:21.382 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:46:21.382 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:21.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:21.382 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:46:21.398 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:46:21.398 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:46:21.398 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:46:21.398 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:21.398 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:46:21.398 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:21.398 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42689sec preferred_lft 42689sec 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:46:21.399 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5807:98ff:feed:57f8/64 scope link 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1029:45ff:fefa:d01b/64 scope link 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ea:d1:bd:3b:72:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e8d1:bdff:fe3b:7274/64 scope link 2024-09-21T06:46:21.400 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:21.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:21.401 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:46:21.461 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:46:21.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:21.463 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:46:21.519 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:46:21.519 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:46:21.520 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:46:21.520 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:46:21.520 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:46:21.520 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:46:21.520 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:46:21.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:46:21.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:46:21.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:46:21.520 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:46:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:46:21.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:21.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:21.645 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:46:21.661 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:46:21.661 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:46:21.661 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:21.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:21.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:46:21.727 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:21.727 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:21.782 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:21.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:21.782 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:21.836 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:46:21.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:21.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:21.931 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:21.931 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:21.939 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:21.939 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:21.939 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:46:21.939 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:46:21.939 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:46:21.940 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:46:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:46:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:46:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:46:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:46:21.941 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:46:21.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:21.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:21.970 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:46:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:46:22.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:22.066 INFO:teuthology.orchestra.run.smithi081.stdout:client4871 2024-09-21T06:46:22.067 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:22.067 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:22.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:22.084 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2024-09-21T06:46:22.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:22.141 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2024-09-21T06:46:22.201 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:22.201 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:22.258 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:22.258 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:22.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:46:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.465+0000 7fd27216e640 1 -- 172.21.15.81:0/2449271993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd254004d40 msgr2=0x7fd254005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.465+0000 7fd27216e640 1 --2- 172.21.15.81:0/2449271993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd254004d40 0x7fd254005150 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd26400c610 tx=0x7fd254005830 comp rx=0 tx=0).stop 2024-09-21T06:46:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.465+0000 7fd26bfff640 1 -- 172.21.15.81:0/2449271993 reap_dead start 2024-09-21T06:46:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.465+0000 7fd27216e640 1 -- 172.21.15.81:0/2449271993 shutdown_connections 2024-09-21T06:46:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.465+0000 7fd27216e640 1 -- 172.21.15.81:0/2449271993 >> 172.21.15.81:0/2449271993 conn(0x7fd26c0b7330 msgr2=0x7fd26c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.465+0000 7fd27216e640 1 -- 172.21.15.81:0/2449271993 shutdown_connections 2024-09-21T06:46:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.465+0000 7fd27216e640 1 -- 172.21.15.81:0/2449271993 wait complete. 2024-09-21T06:46:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.467+0000 7fd27216e640 1 Processor -- start 2024-09-21T06:46:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.467+0000 7fd27216e640 1 -- start start 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd27216e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd254004d40 0x7fd26c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd27216e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd26c06f2f0 0x7fd26c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd27216e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c06ceb0 0x7fd26c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd27216e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c0b9840 con 0x7fd26c06ceb0 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd27216e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c0b96c0 con 0x7fd254004d40 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd27216e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd26c0b99c0 con 0x7fd26c06f2f0 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c06ceb0 0x7fd26c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c06ceb0 0x7fd26c06d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60652/0 (socket says 172.21.15.81:60652) 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 -- 172.21.15.81:0/3829620813 learned_addr learned my addr 172.21.15.81:0/3829620813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26affd640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd26c06f2f0 0x7fd26c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26b7fe640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd254004d40 0x7fd26c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 -- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd26c06f2f0 msgr2=0x7fd26c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd26c06f2f0 0x7fd26c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 -- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd254004d40 msgr2=0x7fd26c0b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd254004d40 0x7fd26c0b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.468+0000 7fd26bfff640 1 -- 172.21.15.81:0/3829620813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c154330 con 0x7fd26c06ceb0 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.469+0000 7fd26bfff640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c06ceb0 0x7fd26c06d2c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd26400c700 tx=0x7fd264004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.469+0000 7fd253fff640 1 -- 172.21.15.81:0/3829620813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26402ba10 con 0x7fd26c06ceb0 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.469+0000 7fd253fff640 1 -- 172.21.15.81:0/3829620813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd26402bbb0 con 0x7fd26c06ceb0 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.469+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26c0b59b0 con 0x7fd26c06ceb0 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.469+0000 7fd253fff640 1 -- 172.21.15.81:0/3829620813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264006070 con 0x7fd26c06ceb0 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.469+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26c1e99e0 con 0x7fd26c06ceb0 2024-09-21T06:46:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.470+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26c08d110 con 0x7fd26c06ceb0 2024-09-21T06:46:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.471+0000 7fd253fff640 1 -- 172.21.15.81:0/3829620813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd26403d030 con 0x7fd26c06ceb0 2024-09-21T06:46:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.471+0000 7fd253fff640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd258078b90 0x7fd25807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.471+0000 7fd253fff640 1 -- 172.21.15.81:0/3829620813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fd2640bacc0 con 0x7fd26c06ceb0 2024-09-21T06:46:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.471+0000 7fd26b7fe640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd258078b90 0x7fd25807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.472+0000 7fd26b7fe640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd258078b90 0x7fd25807b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd26c08c9c0 tx=0x7fd25c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.475+0000 7fd253fff640 1 -- 172.21.15.81:0/3829620813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd26c08d110 con 0x7fd26c06ceb0 2024-09-21T06:46:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.663+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd26c06fcd0 con 0x7fd26c06ceb0 2024-09-21T06:46:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.663+0000 7fd253fff640 1 -- 172.21.15.81:0/3829620813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) ==== 80+0+0 (secure 0 0 0) 0x7fd26c154330 con 0x7fd26c06ceb0 2024-09-21T06:46:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:46:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd258078b90 msgr2=0x7fd25807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd258078b90 0x7fd25807b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd26c08c9c0 tx=0x7fd25c005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c06ceb0 msgr2=0x7fd26c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c06ceb0 0x7fd26c06d2c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd26400c700 tx=0x7fd264004bb0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 shutdown_connections 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd258078b90 0x7fd25807b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd26c06f2f0 0x7fd26c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c06ceb0 0x7fd26c06d2c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 --2- 172.21.15.81:0/3829620813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd254004d40 0x7fd26c0b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 >> 172.21.15.81:0/3829620813 conn(0x7fd26c0b7330 msgr2=0x7fd26c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 shutdown_connections 2024-09-21T06:46:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.665+0000 7fd27216e640 1 -- 172.21.15.81:0/3829620813 wait complete. 2024-09-21T06:46:22.679 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:46:22.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:22.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:22.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:46:22.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:22.707 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:46:22.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-09-21T06:46:22.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.921+0000 7fa3a699d640 1 -- 172.21.15.81:0/1106168844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388004800 msgr2=0x7fa388004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.921+0000 7fa3a699d640 1 --2- 172.21.15.81:0/1106168844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388004800 0x7fa388004c10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa39400c6e0 tx=0x7fa388005830 comp rx=0 tx=0).stop 2024-09-21T06:46:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.921+0000 7fa3a699d640 1 -- 172.21.15.81:0/1106168844 shutdown_connections 2024-09-21T06:46:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.921+0000 7fa3a699d640 1 --2- 172.21.15.81:0/1106168844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa388004800 0x7fa388004c10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.921+0000 7fa3a699d640 1 -- 172.21.15.81:0/1106168844 >> 172.21.15.81:0/1106168844 conn(0x7fa3a00d17d0 msgr2=0x7fa3a00d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.921+0000 7fa3a699d640 1 -- 172.21.15.81:0/1106168844 shutdown_connections 2024-09-21T06:46:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.921+0000 7fa3a699d640 1 -- 172.21.15.81:0/1106168844 wait complete. 2024-09-21T06:46:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.923+0000 7fa3a699d640 1 Processor -- start 2024-09-21T06:46:22.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.923+0000 7fa3a699d640 1 -- start start 2024-09-21T06:46:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a699d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa388004800 0x7fa3a01583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a699d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a0154440 0x7fa3a01f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a699d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a01f9180 0x7fa3a014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a699d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0162210 con 0x7fa3a01f9180 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a699d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a015eab0 con 0x7fa3a0154440 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a699d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a0162390 con 0x7fa388004800 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a01f9180 0x7fa3a014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a01f9180 0x7fa3a014ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60664/0 (socket says 172.21.15.81:60664) 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 -- 172.21.15.81:0/2087954440 learned_addr learned my addr 172.21.15.81:0/2087954440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a599b640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa388004800 0x7fa3a01583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a519a640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a0154440 0x7fa3a01f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 -- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa388004800 msgr2=0x7fa3a01583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa388004800 0x7fa3a01583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 -- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a0154440 msgr2=0x7fa3a01f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a0154440 0x7fa3a01f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a619c640 1 -- 172.21.15.81:0/2087954440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a01f9590 con 0x7fa3a01f9180 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.924+0000 7fa3a519a640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a0154440 0x7fa3a01f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.925+0000 7fa3a619c640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a01f9180 0x7fa3a014ad00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00cfe00 tx=0x7fa3980039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.925+0000 7fa39e7fc640 1 -- 172.21.15.81:0/2087954440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398011900 con 0x7fa3a01f9180 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.925+0000 7fa39e7fc640 1 -- 172.21.15.81:0/2087954440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa398018070 con 0x7fa3a01f9180 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.925+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a0158d90 con 0x7fa3a01f9180 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.925+0000 7fa39e7fc640 1 -- 172.21.15.81:0/2087954440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398011d40 con 0x7fa3a01f9180 2024-09-21T06:46:22.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.925+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a0159350 con 0x7fa3a01f9180 2024-09-21T06:46:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.926+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a01628f0 con 0x7fa3a01f9180 2024-09-21T06:46:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.926+0000 7fa39e7fc640 1 -- 172.21.15.81:0/2087954440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa39801d460 con 0x7fa3a01f9180 2024-09-21T06:46:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.927+0000 7fa39e7fc640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa38c078b90 0x7fa38c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.927+0000 7fa39e7fc640 1 -- 172.21.15.81:0/2087954440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7fa39809b710 con 0x7fa3a01f9180 2024-09-21T06:46:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.927+0000 7fa3a599b640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa38c078b90 0x7fa38c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.928+0000 7fa3a599b640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa38c078b90 0x7fa38c07b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006b7c0 tx=0x7fa390003c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:22.932+0000 7fa39e7fc640 1 -- 172.21.15.81:0/2087954440 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa3a01f9590 con 0x7fa3a01f9180 2024-09-21T06:46:23.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.179+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7fa3a0158b20 con 0x7fa3a01f9180 2024-09-21T06:46:23.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.182+0000 7fa39e7fc640 1 -- 172.21.15.81:0/2087954440 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v36) ==== 184+0+141 (secure 0 0 0) 0x7fa3980638d0 con 0x7fa3a01f9180 2024-09-21T06:46:23.184 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-21T06:46:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:23.184 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw pool=cephfs_data" 2024-09-21T06:46:23.184 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa38c078b90 msgr2=0x7fa38c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa38c078b90 0x7fa38c07b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006b7c0 tx=0x7fa390003c90 comp rx=0 tx=0).stop 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a01f9180 msgr2=0x7fa3a014ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a01f9180 0x7fa3a014ad00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00cfe00 tx=0x7fa3980039c0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 shutdown_connections 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa38c078b90 0x7fa38c07b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a01f9180 0x7fa3a014ad00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3a0154440 0x7fa3a01f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 --2- 172.21.15.81:0/2087954440 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa388004800 0x7fa3a01583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 >> 172.21.15.81:0/2087954440 conn(0x7fa3a00d17d0 msgr2=0x7fa3a00c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 shutdown_connections 2024-09-21T06:46:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.184+0000 7fa3a699d640 1 -- 172.21.15.81:0/2087954440 wait complete. 2024-09-21T06:46:23.198 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:46:23.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:46:23.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:46:23.278 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:46:23.279 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:23.279 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:23.279 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:23.295 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=10698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:46:23.295 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:23.295 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:46:23.295 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:23.336 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:46:23.336 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:23.337 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:23.337 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:23.352 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=10698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:46:23.352 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:23.352 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:46:23.352 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:23.394 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:46:23.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 -- 172.21.15.81:0/1295056680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 msgr2=0x7f40dc15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/1295056680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 0x7f40dc15e690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f40dc06edc0 tx=0x7f40cc02a510 comp rx=0 tx=0).stop 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 -- 172.21.15.81:0/1295056680 shutdown_connections 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/1295056680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc162920 0x7f40dc0d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/1295056680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 0x7f40dc15e690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 -- 172.21.15.81:0/1295056680 >> 172.21.15.81:0/1295056680 conn(0x7f40dc0d17d0 msgr2=0x7f40dc0d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 -- 172.21.15.81:0/1295056680 shutdown_connections 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.505+0000 7f40e0d9d640 1 -- 172.21.15.81:0/1295056680 wait complete. 2024-09-21T06:46:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.507+0000 7f40e0d9d640 1 Processor -- start 2024-09-21T06:46:23.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.507+0000 7f40e0d9d640 1 -- start start 2024-09-21T06:46:23.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40e0d9d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc0b2c90 0x7f40dc0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40e0d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 0x7f40dc1ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40e0d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc1f5f50 0x7f40dc0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40e0d9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc0d2c60 con 0x7f40dc1f5f50 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40e0d9d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc0d2ae0 con 0x7f40dc0b3200 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40e0d9d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f40dc0d2de0 con 0x7f40dc0b2c90 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc1f5f50 0x7f40dc0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc1f5f50 0x7f40dc0ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60676/0 (socket says 172.21.15.81:60676) 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40dbfff640 1 -- 172.21.15.81:0/2521582673 learned_addr learned my addr 172.21.15.81:0/2521582673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40db7fe640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc0b2c90 0x7f40dc0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.508+0000 7f40daffd640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 0x7f40dc1ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40dbfff640 1 -- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc0b2c90 msgr2=0x7f40dc0b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40dbfff640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc0b2c90 0x7f40dc0b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40dbfff640 1 -- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 msgr2=0x7f40dc1ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40dbfff640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 0x7f40dc1ea1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40dbfff640 1 -- 172.21.15.81:0/2521582673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc0cd900 con 0x7f40dc1f5f50 2024-09-21T06:46:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40dbfff640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc1f5f50 0x7f40dc0ce9a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009fd0 tx=0x7f40d400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40c3fff640 1 -- 172.21.15.81:0/2521582673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4003970 con 0x7f40dc1f5f50 2024-09-21T06:46:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40c3fff640 1 -- 172.21.15.81:0/2521582673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40d4003c20 con 0x7f40dc1f5f50 2024-09-21T06:46:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40c3fff640 1 -- 172.21.15.81:0/2521582673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4004280 con 0x7f40dc1f5f50 2024-09-21T06:46:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc0cdbe0 con 0x7f40dc1f5f50 2024-09-21T06:46:23.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.509+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc0ce1a0 con 0x7f40dc1f5f50 2024-09-21T06:46:23.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.510+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40dc0d3290 con 0x7f40dc1f5f50 2024-09-21T06:46:23.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.511+0000 7f40c3fff640 1 -- 172.21.15.81:0/2521582673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40d4004420 con 0x7f40dc1f5f50 2024-09-21T06:46:23.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.511+0000 7f40c3fff640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f40c8078bc0 0x7f40c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.512+0000 7f40c3fff640 1 -- 172.21.15.81:0/2521582673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f40d409b860 con 0x7f40dc1f5f50 2024-09-21T06:46:23.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.512+0000 7f40db7fe640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f40c8078bc0 0x7f40c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.513+0000 7f40db7fe640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f40c8078bc0 0x7f40c807b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40cc034000 tx=0x7f40cc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.516+0000 7f40c3fff640 1 -- 172.21.15.81:0/2521582673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f40d40632c0 con 0x7f40dc1f5f50 2024-09-21T06:46:23.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.729+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40dc0cd680 con 0x7f40dc1f5f50 2024-09-21T06:46:23.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.729+0000 7f40c3fff640 1 -- 172.21.15.81:0/2521582673 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5225 (secure 0 0 0) 0x7f40dc0cd680 con 0x7f40dc1f5f50 2024-09-21T06:46:23.731 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:23.732 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-21T06:46:17:090247+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:03.998544+0000","modified":"2024-09-21T06:46:16.444751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/3622751302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":3622751302},{"type":"v1","addr":"172.21.15.89:6837","nonce":3622751302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":2}]} 2024-09-21T06:46:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-21T06:46:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.731+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f40c8078bc0 msgr2=0x7f40c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.731+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f40c8078bc0 0x7f40c807b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f40cc034000 tx=0x7f40cc004730 comp rx=0 tx=0).stop 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.731+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc1f5f50 msgr2=0x7f40dc0ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.731+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc1f5f50 0x7f40dc0ce9a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009fd0 tx=0x7f40d400c740 comp rx=0 tx=0).stop 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 shutdown_connections 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f40c8078bc0 0x7f40c807b0d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40dc1f5f50 0x7f40dc0ce9a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b3200 0x7f40dc1ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 --2- 172.21.15.81:0/2521582673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc0b2c90 0x7f40dc0b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 >> 172.21.15.81:0/2521582673 conn(0x7f40dc0d17d0 msgr2=0x7f40dc15f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 shutdown_connections 2024-09-21T06:46:23.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.732+0000 7f40e0d9d640 1 -- 172.21.15.81:0/2521582673 wait complete. 2024-09-21T06:46:23.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 -- 172.21.15.81:0/3198350067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cfe20 msgr2=0x7f969815d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 --2- 172.21.15.81:0/3198350067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cfe20 0x7f969815d590 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9698069a00 tx=0x7f968802a560 comp rx=0 tx=0).stop 2024-09-21T06:46:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 -- 172.21.15.81:0/3198350067 shutdown_connections 2024-09-21T06:46:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 --2- 172.21.15.81:0/3198350067 >> v2:172.21.15.89:3300/0 conn(0x7f96980cd1d0 0x7f96980d1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 --2- 172.21.15.81:0/3198350067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f969815dd10 0x7f96980ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 --2- 172.21.15.81:0/3198350067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cfe20 0x7f969815d590 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 -- 172.21.15.81:0/3198350067 >> 172.21.15.81:0/3198350067 conn(0x7f96980d2250 msgr2=0x7f96980d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 -- 172.21.15.81:0/3198350067 shutdown_connections 2024-09-21T06:46:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.855+0000 7f969cd2b640 1 -- 172.21.15.81:0/3198350067 wait complete. 2024-09-21T06:46:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.857+0000 7f969cd2b640 1 Processor -- start 2024-09-21T06:46:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.857+0000 7f969cd2b640 1 -- start start 2024-09-21T06:46:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969cd2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cd1d0 0x7f969814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969cd2b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96980cfe20 0x7f96981f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969cd2b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969815dd10 0x7f96981f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969cd2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96980d1ce0 con 0x7f96980cd1d0 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969cd2b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f96980d1b60 con 0x7f969815dd10 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969cd2b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f96980d1e60 con 0x7f96980cfe20 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cd1d0 0x7f969814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cd1d0 0x7f969814b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60706/0 (socket says 172.21.15.81:60706) 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 -- 172.21.15.81:0/2913771250 learned_addr learned my addr 172.21.15.81:0/2913771250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 -- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96980cfe20 msgr2=0x7f96981f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96980cfe20 0x7f96981f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 -- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969815dd10 msgr2=0x7f96981f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f9696d9d640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969815dd10 0x7f96981f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969815dd10 0x7f96981f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.858+0000 7f969659c640 1 -- 172.21.15.81:0/2913771250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96980cb520 con 0x7f96980cd1d0 2024-09-21T06:46:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.859+0000 7f9696d9d640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969815dd10 0x7f96981f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.859+0000 7f969659c640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cd1d0 0x7f969814b660 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9688034040 tx=0x7f96880039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.859+0000 7f968f7fe640 1 -- 172.21.15.81:0/2913771250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968803e030 con 0x7f96980cd1d0 2024-09-21T06:46:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.859+0000 7f968f7fe640 1 -- 172.21.15.81:0/2913771250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96880047a0 con 0x7f96980cd1d0 2024-09-21T06:46:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.859+0000 7f968f7fe640 1 -- 172.21.15.81:0/2913771250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688035040 con 0x7f96980cd1d0 2024-09-21T06:46:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.859+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96980cb800 con 0x7f96980cd1d0 2024-09-21T06:46:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.859+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96980c5d90 con 0x7f96980cd1d0 2024-09-21T06:46:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.860+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969815d590 con 0x7f96980cd1d0 2024-09-21T06:46:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.861+0000 7f968f7fe640 1 -- 172.21.15.81:0/2913771250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9688041030 con 0x7f96980cd1d0 2024-09-21T06:46:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.861+0000 7f968f7fe640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9678078bc0 0x7f967807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.861+0000 7f968f7fe640 1 -- 172.21.15.81:0/2913771250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f96880bb7f0 con 0x7f96980cd1d0 2024-09-21T06:46:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.861+0000 7f968dd9b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9678078bc0 0x7f967807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.862+0000 7f968dd9b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9678078bc0 0x7f967807b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9698156c40 tx=0x7f9680005b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:23.866+0000 7f968f7fe640 1 -- 172.21.15.81:0/2913771250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9688083a40 con 0x7f96980cd1d0 2024-09-21T06:46:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.076+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9698152b40 con 0x7f96980cd1d0 2024-09-21T06:46:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.076+0000 7f968f7fe640 1 -- 172.21.15.81:0/2913771250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5225 (secure 0 0 0) 0x7f9688083340 con 0x7f96980cd1d0 2024-09-21T06:46:24.079 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:24.079 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-21T06:46:17:090247+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:03.998544+0000","modified":"2024-09-21T06:46:16.444751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/3622751302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":3622751302},{"type":"v1","addr":"172.21.15.89:6837","nonce":3622751302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":2}]} 2024-09-21T06:46:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9678078bc0 msgr2=0x7f967807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9678078bc0 0x7f967807b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9698156c40 tx=0x7f9680005b70 comp rx=0 tx=0).stop 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cd1d0 msgr2=0x7f969814b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cd1d0 0x7f969814b660 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9688034040 tx=0x7f96880039e0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 shutdown_connections 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9678078bc0 0x7f967807b0d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96980cfe20 0x7f96981f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969815dd10 0x7f96981f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 --2- 172.21.15.81:0/2913771250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96980cd1d0 0x7f969814b660 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 >> 172.21.15.81:0/2913771250 conn(0x7f96980d2250 msgr2=0x7f969814e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 shutdown_connections 2024-09-21T06:46:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.079+0000 7f969cd2b640 1 -- 172.21.15.81:0/2913771250 wait complete. 2024-09-21T06:46:24.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 -- 172.21.15.81:0/3866600826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440cfda0 msgr2=0x7f3d4415d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 --2- 172.21.15.81:0/3866600826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440cfda0 0x7f3d4415d730 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d440d1030 tx=0x7f3d3402a510 comp rx=0 tx=0).stop 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 -- 172.21.15.81:0/3866600826 shutdown_connections 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 --2- 172.21.15.81:0/3866600826 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d440d1340 0x7f3d440d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 --2- 172.21.15.81:0/3866600826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440cfda0 0x7f3d4415d730 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 -- 172.21.15.81:0/3866600826 >> 172.21.15.81:0/3866600826 conn(0x7f3d440b4210 msgr2=0x7f3d440b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 -- 172.21.15.81:0/3866600826 shutdown_connections 2024-09-21T06:46:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.202+0000 7f3d49b20640 1 -- 172.21.15.81:0/3866600826 wait complete. 2024-09-21T06:46:24.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.204+0000 7f3d49b20640 1 Processor -- start 2024-09-21T06:46:24.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.204+0000 7f3d49b20640 1 -- start start 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d49b20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d440cfda0 0x7f3d44153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d49b20640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440d1340 0x7f3d441f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d49b20640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d441602a0 0x7f3d44140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d49b20640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4415f240 con 0x7f3d440d1340 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d49b20640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4415f0c0 con 0x7f3d440cfda0 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d49b20640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4415f3c0 con 0x7f3d441602a0 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440d1340 0x7f3d441f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440d1340 0x7f3d441f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60724/0 (socket says 172.21.15.81:60724) 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 -- 172.21.15.81:0/4046866445 learned_addr learned my addr 172.21.15.81:0/4046866445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d437fe640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d440cfda0 0x7f3d44153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d43fff640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d441602a0 0x7f3d44140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 -- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d441602a0 msgr2=0x7f3d44140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d441602a0 0x7f3d44140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 -- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d440cfda0 msgr2=0x7f3d44153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d440cfda0 0x7f3d44153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 -- 172.21.15.81:0/4046866445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d44152390 con 0x7f3d440d1340 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d437fe640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d440cfda0 0x7f3d44153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d43fff640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d441602a0 0x7f3d44140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d42ffd640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440d1340 0x7f3d441f3170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d700 tx=0x7f3d3800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d2bfff640 1 -- 172.21.15.81:0/4046866445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38017070 con 0x7f3d440d1340 2024-09-21T06:46:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d2bfff640 1 -- 172.21.15.81:0/4046866445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d38009b10 con 0x7f3d440d1340 2024-09-21T06:46:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d44152670 con 0x7f3d440d1340 2024-09-21T06:46:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.206+0000 7f3d2bfff640 1 -- 172.21.15.81:0/4046866445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38010460 con 0x7f3d440d1340 2024-09-21T06:46:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.207+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d44152c30 con 0x7f3d440d1340 2024-09-21T06:46:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.208+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d44153070 con 0x7f3d440d1340 2024-09-21T06:46:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.208+0000 7f3d2bfff640 1 -- 172.21.15.81:0/4046866445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d3801a070 con 0x7f3d440d1340 2024-09-21T06:46:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.209+0000 7f3d2bfff640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d30078bc0 0x7f3d3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.209+0000 7f3d2bfff640 1 -- 172.21.15.81:0/4046866445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f3d3809b1d0 con 0x7f3d440d1340 2024-09-21T06:46:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.209+0000 7f3d437fe640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d30078bc0 0x7f3d3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.210+0000 7f3d437fe640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d30078bc0 0x7f3d3007b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d34034000 tx=0x7f3d34004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.213+0000 7f3d2bfff640 1 -- 172.21.15.81:0/4046866445 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3d38063280 con 0x7f3d440d1340 2024-09-21T06:46:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.390+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d44152120 con 0x7f3d440d1340 2024-09-21T06:46:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.391+0000 7f3d2bfff640 1 -- 172.21.15.81:0/4046866445 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18798 (secure 0 0 0) 0x7f3d38062b80 con 0x7f3d440d1340 2024-09-21T06:46:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:24.394 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:18.100020+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:01.666905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:02.952864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-09-21T06:46:15.622557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.393+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d30078bc0 msgr2=0x7f3d3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.393+0000 7f3d49b20640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d30078bc0 0x7f3d3007b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3d34034000 tx=0x7f3d34004730 comp rx=0 tx=0).stop 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.393+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440d1340 msgr2=0x7f3d441f3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.393+0000 7f3d49b20640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440d1340 0x7f3d441f3170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d700 tx=0x7f3d3800dbc0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 shutdown_connections 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3d30078bc0 0x7f3d3007b0d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d441602a0 0x7f3d44140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d440d1340 0x7f3d441f3170 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 --2- 172.21.15.81:0/4046866445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d440cfda0 0x7f3d44153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 >> 172.21.15.81:0/4046866445 conn(0x7f3d440b4210 msgr2=0x7f3d440b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 shutdown_connections 2024-09-21T06:46:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.394+0000 7f3d49b20640 1 -- 172.21.15.81:0/4046866445 wait complete. 2024-09-21T06:46:24.407 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:46:24.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.517+0000 7f49fdaa4640 1 -- 172.21.15.81:0/231576661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 msgr2=0x7f49f8167380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.517+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/231576661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f8167380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f49f8074930 tx=0x7f49f002a740 comp rx=0 tx=0).stop 2024-09-21T06:46:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.517+0000 7f49fdaa4640 1 -- 172.21.15.81:0/231576661 shutdown_connections 2024-09-21T06:46:24.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.517+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/231576661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f8167380 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.517+0000 7f49fdaa4640 1 -- 172.21.15.81:0/231576661 >> 172.21.15.81:0/231576661 conn(0x7f49f80740a0 msgr2=0x7f49f80b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:24.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.517+0000 7f49fdaa4640 1 -- 172.21.15.81:0/231576661 shutdown_connections 2024-09-21T06:46:24.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.517+0000 7f49fdaa4640 1 -- 172.21.15.81:0/231576661 wait complete. 2024-09-21T06:46:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.519+0000 7f49fdaa4640 1 Processor -- start 2024-09-21T06:46:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.519+0000 7f49fdaa4640 1 -- start start 2024-09-21T06:46:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49fdaa4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f81f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49fdaa4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f80d15b0 0x7f49f80b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49fdaa4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f81539d0 0x7f49f80b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49fdaa4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49f8167ad0 con 0x7f49f806f1d0 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49fdaa4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80b0b70 con 0x7f49f80d15b0 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49fdaa4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f49f8167c50 con 0x7f49f81539d0 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f81f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f81f8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60732/0 (socket says 172.21.15.81:60732) 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 -- 172.21.15.81:0/78478380 learned_addr learned my addr 172.21.15.81:0/78478380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f7fff640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f81539d0 0x7f49f80b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f6ffd640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f80d15b0 0x7f49f80b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 -- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f81539d0 msgr2=0x7f49f80b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f81539d0 0x7f49f80b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 -- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f80d15b0 msgr2=0x7f49f80b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f80d15b0 0x7f49f80b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.520+0000 7f49f77fe640 1 -- 172.21.15.81:0/78478380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f80ae030 con 0x7f49f806f1d0 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49f6ffd640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f80d15b0 0x7f49f80b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49f7fff640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f81539d0 0x7f49f80b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49f77fe640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f81f8e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b420 tx=0x7f49e800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49dffff640 1 -- 172.21.15.81:0/78478380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8011830 con 0x7f49f806f1d0 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49dffff640 1 -- 172.21.15.81:0/78478380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49e8016070 con 0x7f49f806f1d0 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f81f96a0 con 0x7f49f806f1d0 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49dffff640 1 -- 172.21.15.81:0/78478380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8011d60 con 0x7f49f806f1d0 2024-09-21T06:46:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.521+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f81f9c60 con 0x7f49f806f1d0 2024-09-21T06:46:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.522+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f806eac0 con 0x7f49f806f1d0 2024-09-21T06:46:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.522+0000 7f49dffff640 1 -- 172.21.15.81:0/78478380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49e801b460 con 0x7f49f806f1d0 2024-09-21T06:46:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.523+0000 7f49dffff640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f49e4078b90 0x7f49e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.523+0000 7f49dffff640 1 -- 172.21.15.81:0/78478380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f49e809ab00 con 0x7f49f806f1d0 2024-09-21T06:46:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.523+0000 7f49f6ffd640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f49e4078b90 0x7f49e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.524+0000 7f49f6ffd640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f49e4078b90 0x7f49e407b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f49f8167890 tx=0x7f49ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.528+0000 7f49dffff640 1 -- 172.21.15.81:0/78478380 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f49e8020020 con 0x7f49f806f1d0 2024-09-21T06:46:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.740+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49f80b0370 con 0x7f49f806f1d0 2024-09-21T06:46:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.740+0000 7f49dffff640 1 -- 172.21.15.81:0/78478380 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5225 (secure 0 0 0) 0x7f49e8062cc0 con 0x7f49f806f1d0 2024-09-21T06:46:24.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:24.743 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-21T06:46:17:090247+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:03.998544+0000","modified":"2024-09-21T06:46:16.444751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/3622751302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":3622751302},{"type":"v1","addr":"172.21.15.89:6837","nonce":3622751302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":2}]} 2024-09-21T06:46:24.743 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f49e4078b90 msgr2=0x7f49e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f49e4078b90 0x7f49e407b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f49f8167890 tx=0x7f49ec009040 comp rx=0 tx=0).stop 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 msgr2=0x7f49f81f8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f81f8e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f49e800b420 tx=0x7f49e800b8e0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 shutdown_connections 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f49e4078b90 0x7f49e407b0a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49f81539d0 0x7f49f80b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49f80d15b0 0x7f49f80b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 --2- 172.21.15.81:0/78478380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49f806f1d0 0x7f49f81f8e50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 >> 172.21.15.81:0/78478380 conn(0x7f49f80740a0 msgr2=0x7f49f8150680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 shutdown_connections 2024-09-21T06:46:24.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.742+0000 7f49fdaa4640 1 -- 172.21.15.81:0/78478380 wait complete. 2024-09-21T06:46:24.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:24.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 -- 172.21.15.81:0/2952647544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3048072190 msgr2=0x7f3048074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2952647544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3048072190 0x7f3048074b60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3040005fd0 tx=0x7f304002a5d0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 -- 172.21.15.81:0/2952647544 shutdown_connections 2024-09-21T06:46:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2952647544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30480ae4b0 0x7f30480ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2952647544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3048072190 0x7f3048074b60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 -- 172.21.15.81:0/2952647544 >> 172.21.15.81:0/2952647544 conn(0x7f30480b2cc0 msgr2=0x7f30480b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 -- 172.21.15.81:0/2952647544 shutdown_connections 2024-09-21T06:46:24.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.866+0000 7f304d5f1640 1 -- 172.21.15.81:0/2952647544 wait complete. 2024-09-21T06:46:24.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.868+0000 7f304d5f1640 1 Processor -- start 2024-09-21T06:46:24.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.868+0000 7f304d5f1640 1 -- start start 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.869+0000 7f304d5f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3048072190 0x7f304814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.869+0000 7f304d5f1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30480ae4b0 0x7f3048168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.869+0000 7f304d5f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304815be40 0x7f30480b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.869+0000 7f304d5f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30481669f0 con 0x7f304815be40 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.869+0000 7f304d5f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3048166870 con 0x7f3048072190 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.869+0000 7f304d5f1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3048166b70 con 0x7f30480ae4b0 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.869+0000 7f30477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304815be40 0x7f30480b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304815be40 0x7f30480b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60754/0 (socket says 172.21.15.81:60754) 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 -- 172.21.15.81:0/2969950964 learned_addr learned my addr 172.21.15.81:0/2969950964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f3046ffd640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3048072190 0x7f304814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30467fc640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30480ae4b0 0x7f3048168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 -- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30480ae4b0 msgr2=0x7f3048168730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30480ae4b0 0x7f3048168730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 -- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3048072190 msgr2=0x7f304814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3048072190 0x7f304814a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 -- 172.21.15.81:0/2969950964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3048167690 con 0x7f304815be40 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f30477fe640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304815be40 0x7f30480b6410 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f303800c3c0 tx=0x7f303800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f302f7fe640 1 -- 172.21.15.81:0/2969950964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038017070 con 0x7f304815be40 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f302f7fe640 1 -- 172.21.15.81:0/2969950964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30380053c0 con 0x7f304815be40 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3048167970 con 0x7f304815be40 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f302f7fe640 1 -- 172.21.15.81:0/2969950964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3038003850 con 0x7f304815be40 2024-09-21T06:46:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.870+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3048167f30 con 0x7f304815be40 2024-09-21T06:46:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.871+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3048167090 con 0x7f304815be40 2024-09-21T06:46:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.872+0000 7f302f7fe640 1 -- 172.21.15.81:0/2969950964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f303801a070 con 0x7f304815be40 2024-09-21T06:46:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.872+0000 7f302f7fe640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3034078b90 0x7f303407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.872+0000 7f302f7fe640 1 -- 172.21.15.81:0/2969950964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f303809a360 con 0x7f304815be40 2024-09-21T06:46:24.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.873+0000 7f3046ffd640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3034078b90 0x7f303407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.873+0000 7f3046ffd640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3034078b90 0x7f303407b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3040033000 tx=0x7f3040004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:24.877+0000 7f302f7fe640 1 -- 172.21.15.81:0/2969950964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f30480aee00 con 0x7f304815be40 2024-09-21T06:46:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.091+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30480753d0 con 0x7f304815be40 2024-09-21T06:46:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.091+0000 7f302f7fe640 1 -- 172.21.15.81:0/2969950964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5225 (secure 0 0 0) 0x7f3038062490 con 0x7f304815be40 2024-09-21T06:46:25.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:25.094 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-21T06:46:17:090247+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:03.998544+0000","modified":"2024-09-21T06:46:16.444751+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/3622751302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":3622751302},{"type":"v1","addr":"172.21.15.89:6837","nonce":3622751302}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":2}]} 2024-09-21T06:46:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-21T06:46:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3034078b90 msgr2=0x7f303407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3034078b90 0x7f303407b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3040033000 tx=0x7f3040004730 comp rx=0 tx=0).stop 2024-09-21T06:46:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304815be40 msgr2=0x7f30480b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304815be40 0x7f30480b6410 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f303800c3c0 tx=0x7f303800c880 comp rx=0 tx=0).stop 2024-09-21T06:46:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 shutdown_connections 2024-09-21T06:46:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3034078b90 0x7f303407b0a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30480ae4b0 0x7f3048168730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304815be40 0x7f30480b6410 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 --2- 172.21.15.81:0/2969950964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3048072190 0x7f304814a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 >> 172.21.15.81:0/2969950964 conn(0x7f30480b2cc0 msgr2=0x7f30480b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 shutdown_connections 2024-09-21T06:46:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.094+0000 7f304d5f1640 1 -- 172.21.15.81:0/2969950964 wait complete. 2024-09-21T06:46:25.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.218+0000 7f0d2fe12640 1 -- 172.21.15.81:0/2993853664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 msgr2=0x7f0d28072d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.218+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/2993853664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d28072d40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0d20005fd0 tx=0x7f0d2002a8b0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.218+0000 7f0d2fe12640 1 -- 172.21.15.81:0/2993853664 shutdown_connections 2024-09-21T06:46:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.218+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/2993853664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d28072d40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.218+0000 7f0d2fe12640 1 -- 172.21.15.81:0/2993853664 >> 172.21.15.81:0/2993853664 conn(0x7f0d280d25e0 msgr2=0x7f0d280d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.218+0000 7f0d2fe12640 1 -- 172.21.15.81:0/2993853664 shutdown_connections 2024-09-21T06:46:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.218+0000 7f0d2fe12640 1 -- 172.21.15.81:0/2993853664 wait complete. 2024-09-21T06:46:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.219+0000 7f0d2fe12640 1 Processor -- start 2024-09-21T06:46:25.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.219+0000 7f0d2fe12640 1 -- start start 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2fe12640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d280d19a0 0x7f0d280c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2fe12640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2815a290 0x7f0d28148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2fe12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d281f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2fe12640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2815db50 con 0x7f0d281601c0 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2fe12640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2815d9d0 con 0x7f0d2815a290 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2fe12640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0d28073280 con 0x7f0d280d19a0 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2e3af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d281f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2e3af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d281f6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60762/0 (socket says 172.21.15.81:60762) 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.220+0000 7f0d2e3af640 1 -- 172.21.15.81:0/1890408607 learned_addr learned my addr 172.21.15.81:0/1890408607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2dbae640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d280d19a0 0x7f0d280c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2d3ad640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2815a290 0x7f0d28148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2e3af640 1 -- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d280d19a0 msgr2=0x7f0d280c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2e3af640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d280d19a0 0x7f0d280c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2e3af640 1 -- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2815a290 msgr2=0x7f0d28148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2e3af640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2815a290 0x7f0d28148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2e3af640 1 -- 172.21.15.81:0/1890408607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d280c6540 con 0x7f0d281601c0 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2e3af640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d281f6d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0d2002aea0 tx=0x7f0d20003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d1e7fc640 1 -- 172.21.15.81:0/1890408607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20031b90 con 0x7f0d281601c0 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d1e7fc640 1 -- 172.21.15.81:0/1890408607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d20031e20 con 0x7f0d281601c0 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d280c6820 con 0x7f0d281601c0 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d1e7fc640 1 -- 172.21.15.81:0/1890408607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200332f0 con 0x7f0d281601c0 2024-09-21T06:46:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.222+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d280c6de0 con 0x7f0d281601c0 2024-09-21T06:46:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.223+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d28072d40 con 0x7f0d281601c0 2024-09-21T06:46:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.224+0000 7f0d1e7fc640 1 -- 172.21.15.81:0/1890408607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d20033490 con 0x7f0d281601c0 2024-09-21T06:46:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.224+0000 7f0d1e7fc640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d0c078bc0 0x7f0d0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.225+0000 7f0d1e7fc640 1 -- 172.21.15.81:0/1890408607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f0d200bc630 con 0x7f0d281601c0 2024-09-21T06:46:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.225+0000 7f0d2dbae640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d0c078bc0 0x7f0d0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.225+0000 7f0d2dbae640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d0c078bc0 0x7f0d0c07b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d24000f60 tx=0x7f0d24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.229+0000 7f0d1e7fc640 1 -- 172.21.15.81:0/1890408607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0d2003f030 con 0x7f0d281601c0 2024-09-21T06:46:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.406+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d280b8070 con 0x7f0d281601c0 2024-09-21T06:46:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.408+0000 7f0d1e7fc640 1 -- 172.21.15.81:0/1890408607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18798 (secure 0 0 0) 0x7f0d20084760 con 0x7f0d281601c0 2024-09-21T06:46:25.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:25.409 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:18.100020+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:01.666905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:02.952864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2024-09-21T06:46:15.622557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d0c078bc0 msgr2=0x7f0d0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d0c078bc0 0x7f0d0c07b0d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d24000f60 tx=0x7f0d24009040 comp rx=0 tx=0).stop 2024-09-21T06:46:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 msgr2=0x7f0d281f6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d281f6d90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0d2002aea0 tx=0x7f0d20003a10 comp rx=0 tx=0).stop 2024-09-21T06:46:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 shutdown_connections 2024-09-21T06:46:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d0c078bc0 0x7f0d0c07b0d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d281601c0 0x7f0d281f6d90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d2815a290 0x7f0d28148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 --2- 172.21.15.81:0/1890408607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d280d19a0 0x7f0d280c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 >> 172.21.15.81:0/1890408607 conn(0x7f0d280d25e0 msgr2=0x7f0d280700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 shutdown_connections 2024-09-21T06:46:25.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.410+0000 7f0d2fe12640 1 -- 172.21.15.81:0/1890408607 wait complete. 2024-09-21T06:46:25.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:46:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.534+0000 7f0d2180a640 1 -- 172.21.15.81:0/2655221588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 msgr2=0x7f0d1c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.534+0000 7f0d2180a640 1 --2- 172.21.15.81:0/2655221588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c15a290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009ca0 tx=0x7f0d0c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:46:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.535+0000 7f0d2180a640 1 -- 172.21.15.81:0/2655221588 shutdown_connections 2024-09-21T06:46:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.535+0000 7f0d2180a640 1 --2- 172.21.15.81:0/2655221588 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d1c15d2c0 0x7f0d1c15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.535+0000 7f0d2180a640 1 --2- 172.21.15.81:0/2655221588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c15a290 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.535+0000 7f0d2180a640 1 -- 172.21.15.81:0/2655221588 >> 172.21.15.81:0/2655221588 conn(0x7f0d1c0d25e0 msgr2=0x7f0d1c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.535+0000 7f0d2180a640 1 -- 172.21.15.81:0/2655221588 shutdown_connections 2024-09-21T06:46:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.535+0000 7f0d2180a640 1 -- 172.21.15.81:0/2655221588 wait complete. 2024-09-21T06:46:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.536+0000 7f0d2180a640 1 Processor -- start 2024-09-21T06:46:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.537+0000 7f0d2180a640 1 -- start start 2024-09-21T06:46:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d2180a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d2180a640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d1c15d2c0 0x7f0d1c14bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d2180a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d1c1601c0 0x7f0d1c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d2180a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c072ec0 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d2180a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c072d40 con 0x7f0d1c1601c0 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d2180a640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1c073040 con 0x7f0d1c15d2c0 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60784/0 (socket says 172.21.15.81:60784) 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 -- 172.21.15.81:0/3076665264 learned_addr learned my addr 172.21.15.81:0/3076665264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1a7fc640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d1c15d2c0 0x7f0d1c14bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1b7fe640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d1c1601c0 0x7f0d1c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 -- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d1c15d2c0 msgr2=0x7f0d1c14bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d1c15d2c0 0x7f0d1c14bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 -- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d1c1601c0 msgr2=0x7f0d1c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d1c1601c0 0x7f0d1c0cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1affd640 1 -- 172.21.15.81:0/3076665264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1c14c250 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.538+0000 7f0d1a7fc640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d1c15d2c0 0x7f0d1c14bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.539+0000 7f0d1affd640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c0c88c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009bf0 tx=0x7f0d0c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.539+0000 7f0d03fff640 1 -- 172.21.15.81:0/3076665264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c033050 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.539+0000 7f0d03fff640 1 -- 172.21.15.81:0/3076665264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d0c0045d0 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.539+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d1c14f440 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.539+0000 7f0d03fff640 1 -- 172.21.15.81:0/3076665264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c038450 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.539+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d1c06ec30 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.540+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1c073560 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.540+0000 7f0d03fff640 1 -- 172.21.15.81:0/3076665264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d0c036070 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.541+0000 7f0d03fff640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d08078b90 0x7f0d0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.541+0000 7f0d03fff640 1 -- 172.21.15.81:0/3076665264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6496+0+0 (secure 0 0 0) 0x7f0d0c0bc5f0 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.541+0000 7f0d1a7fc640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d08078b90 0x7f0d0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.542+0000 7f0d1a7fc640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d08078b90 0x7f0d0807b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000a830 tx=0x7f0d10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.546+0000 7f0d03fff640 1 -- 172.21.15.81:0/3076665264 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0d0c084720 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.760+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0d1c071af0 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.762 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-21T06:46:25.761+0000 7ffaf0bb2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:46:25.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.762+0000 7f0d03fff640 1 -- 172.21.15.81:0/3076665264 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f0d0c084020 con 0x7f0d1c0d19a0 2024-09-21T06:46:25.763 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:46:25.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d08078b90 msgr2=0x7f0d0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d08078b90 0x7f0d0807b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d1000a830 tx=0x7f0d10008040 comp rx=0 tx=0).stop 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 msgr2=0x7f0d1c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c0c88c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009bf0 tx=0x7f0d0c003f90 comp rx=0 tx=0).stop 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 shutdown_connections 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0d08078b90 0x7f0d0807b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d1c15d2c0 0x7f0d1c14bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d1c1601c0 0x7f0d1c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 --2- 172.21.15.81:0/3076665264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c0d19a0 0x7f0d1c0c88c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 >> 172.21.15.81:0/3076665264 conn(0x7f0d1c0d25e0 msgr2=0x7f0d1c15a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 shutdown_connections 2024-09-21T06:46:25.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.765+0000 7f0d2180a640 1 -- 172.21.15.81:0/3076665264 wait complete. 2024-09-21T06:46:25.770 INFO:tasks.ceph.mds.b.smithi089.stderr: -4512> 2024-09-21T06:46:09.284+0000 7fd063fb4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:46:25.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:46:25.828 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2024-09-21T06:46:25.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.891+0000 7f5add57b640 1 -- 172.21.15.81:0/3009704251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 msgr2=0x7f5ad80d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.891+0000 7f5add57b640 1 --2- 172.21.15.81:0/3009704251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad80d3220 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b93b0 tx=0x7f5ac802a510 comp rx=0 tx=0).stop 2024-09-21T06:46:25.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.891+0000 7f5add57b640 1 -- 172.21.15.81:0/3009704251 shutdown_connections 2024-09-21T06:46:25.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.891+0000 7f5add57b640 1 --2- 172.21.15.81:0/3009704251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad80d3220 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.891+0000 7f5add57b640 1 -- 172.21.15.81:0/3009704251 >> 172.21.15.81:0/3009704251 conn(0x7f5ad80b7330 msgr2=0x7f5ad80b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.892+0000 7f5add57b640 1 -- 172.21.15.81:0/3009704251 shutdown_connections 2024-09-21T06:46:25.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.892+0000 7f5add57b640 1 -- 172.21.15.81:0/3009704251 wait complete. 2024-09-21T06:46:25.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.893+0000 7f5add57b640 1 Processor -- start 2024-09-21T06:46:25.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.893+0000 7f5add57b640 1 -- start start 2024-09-21T06:46:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5add57b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad80d41a0 0x7f5ad806d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5add57b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad8151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5add57b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad815eda0 0x7f5ad80b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5add57b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b3700 con 0x7f5ad815c450 2024-09-21T06:46:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5add57b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b3580 con 0x7f5ad80d41a0 2024-09-21T06:46:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5add57b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad80b3880 con 0x7f5ad815eda0 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad8151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad8151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60806/0 (socket says 172.21.15.81:60806) 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 -- 172.21.15.81:0/3810045343 learned_addr learned my addr 172.21.15.81:0/3810045343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad77fe640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad815eda0 0x7f5ad80b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad6ffd640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad80d41a0 0x7f5ad806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 -- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad815eda0 msgr2=0x7f5ad80b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad815eda0 0x7f5ad80b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 -- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad80d41a0 msgr2=0x7f5ad806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad80d41a0 0x7f5ad806d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 -- 172.21.15.81:0/3810045343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad80b4e90 con 0x7f5ad815c450 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad6ffd640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad80d41a0 0x7f5ad806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5ad67fc640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad8151680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5acc001eb0 tx=0x7f5acc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.895+0000 7f5abf7fe640 1 -- 172.21.15.81:0/3810045343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc011790 con 0x7f5ad815c450 2024-09-21T06:46:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.896+0000 7f5abf7fe640 1 -- 172.21.15.81:0/3810045343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5acc017070 con 0x7f5ad815c450 2024-09-21T06:46:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.896+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad80b5150 con 0x7f5ad815c450 2024-09-21T06:46:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.896+0000 7f5abf7fe640 1 -- 172.21.15.81:0/3810045343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc011ca0 con 0x7f5ad815c450 2024-09-21T06:46:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.896+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad80b5710 con 0x7f5ad815c450 2024-09-21T06:46:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.897+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad81616d0 con 0x7f5ad815c450 2024-09-21T06:46:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.897+0000 7f5abf7fe640 1 -- 172.21.15.81:0/3810045343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5acc01c460 con 0x7f5ad815c450 2024-09-21T06:46:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.898+0000 7f5abf7fe640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5ac4078b90 0x7f5ac407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.898+0000 7f5abf7fe640 1 -- 172.21.15.81:0/3810045343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6582+0+0 (secure 0 0 0) 0x7f5acc09ae10 con 0x7f5ad815c450 2024-09-21T06:46:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.898+0000 7f5ad6ffd640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5ac4078b90 0x7f5ac407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.899+0000 7f5ad6ffd640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5ac4078b90 0x7f5ac407b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8034000 tx=0x7f5ac8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:25.903+0000 7f5abf7fe640 1 -- 172.21.15.81:0/3810045343 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5ad81616d0 con 0x7f5ad815c450 2024-09-21T06:46:26.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.121+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5ad808d0e0 con 0x7f5ad815c450 2024-09-21T06:46:26.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.764+0000 7f5abf7fe640 1 -- 172.21.15.81:0/3810045343 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f5acc062ee0 con 0x7f5ad815c450 2024-09-21T06:46:26.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5ac4078b90 msgr2=0x7f5ac407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5ac4078b90 0x7f5ac407b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8034000 tx=0x7f5ac8004730 comp rx=0 tx=0).stop 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 msgr2=0x7f5ad8151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad8151680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5acc001eb0 tx=0x7f5acc00c890 comp rx=0 tx=0).stop 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 shutdown_connections 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5ac4078b90 0x7f5ac407b0a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5ad815eda0 0x7f5ad80b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad815c450 0x7f5ad8151680 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 --2- 172.21.15.81:0/3810045343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ad80d41a0 0x7f5ad806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 >> 172.21.15.81:0/3810045343 conn(0x7f5ad80b7330 msgr2=0x7f5ad80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 shutdown_connections 2024-09-21T06:46:26.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.766+0000 7f5add57b640 1 -- 172.21.15.81:0/3810045343 wait complete. 2024-09-21T06:46:26.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:46:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.895+0000 7f5da1962640 1 -- 172.21.15.81:0/3976434655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c0d4370 msgr2=0x7f5d9c0d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.895+0000 7f5da1962640 1 --2- 172.21.15.81:0/3976434655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c0d4370 0x7f5d9c0d4780 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009820 tx=0x7f5d8402a510 comp rx=0 tx=0).stop 2024-09-21T06:46:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.895+0000 7f5da1962640 1 -- 172.21.15.81:0/3976434655 shutdown_connections 2024-09-21T06:46:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.895+0000 7f5da1962640 1 --2- 172.21.15.81:0/3976434655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c0d4370 0x7f5d9c0d4780 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.895+0000 7f5da1962640 1 -- 172.21.15.81:0/3976434655 >> 172.21.15.81:0/3976434655 conn(0x7f5d9c0b7330 msgr2=0x7f5d9c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.895+0000 7f5da1962640 1 -- 172.21.15.81:0/3976434655 shutdown_connections 2024-09-21T06:46:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.895+0000 7f5da1962640 1 -- 172.21.15.81:0/3976434655 wait complete. 2024-09-21T06:46:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.897+0000 7f5da1962640 1 Processor -- start 2024-09-21T06:46:26.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.897+0000 7f5da1962640 1 -- start start 2024-09-21T06:46:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5da1962640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0cf130 0x7f5d9c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5da1962640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d9c0d4370 0x7f5d9c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5da1962640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c15e800 0x7f5d9c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5da1962640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c0cffe0 con 0x7f5d9c15e800 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5da1962640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c0cfe60 con 0x7f5d9c0cf130 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5da1962640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c0d0160 con 0x7f5d9c0d4370 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c15e800 0x7f5d9c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c15e800 0x7f5d9c06ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60822/0 (socket says 172.21.15.81:60822) 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5d9b7fe640 1 -- 172.21.15.81:0/2984000558 learned_addr learned my addr 172.21.15.81:0/2984000558 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5d9affd640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0cf130 0x7f5d9c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.898+0000 7f5d9a7fc640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d9c0d4370 0x7f5d9c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d9b7fe640 1 -- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d9c0d4370 msgr2=0x7f5d9c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d9b7fe640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d9c0d4370 0x7f5d9c153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d9b7fe640 1 -- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0cf130 msgr2=0x7f5d9c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d9b7fe640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0cf130 0x7f5d9c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d9b7fe640 1 -- 172.21.15.81:0/2984000558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c0a1ef0 con 0x7f5d9c15e800 2024-09-21T06:46:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d9b7fe640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c15e800 0x7f5d9c06ef60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b440 tx=0x7f5d9400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d93fff640 1 -- 172.21.15.81:0/2984000558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94015020 con 0x7f5d9c15e800 2024-09-21T06:46:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d93fff640 1 -- 172.21.15.81:0/2984000558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d94011920 con 0x7f5d9c15e800 2024-09-21T06:46:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c0a03f0 con 0x7f5d9c15e800 2024-09-21T06:46:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5d93fff640 1 -- 172.21.15.81:0/2984000558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94011d70 con 0x7f5d9c15e800 2024-09-21T06:46:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.899+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c0d3050 con 0x7f5d9c15e800 2024-09-21T06:46:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.900+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9c0d4780 con 0x7f5d9c15e800 2024-09-21T06:46:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.901+0000 7f5d93fff640 1 -- 172.21.15.81:0/2984000558 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d94018020 con 0x7f5d9c15e800 2024-09-21T06:46:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.901+0000 7f5d93fff640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5d7c078b90 0x7f5d7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.901+0000 7f5d93fff640 1 -- 172.21.15.81:0/2984000558 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6582+0+0 (secure 0 0 0) 0x7f5d9409aea0 con 0x7f5d9c15e800 2024-09-21T06:46:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.901+0000 7f5d9affd640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5d7c078b90 0x7f5d7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.902+0000 7f5d9affd640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5d7c078b90 0x7f5d7c07b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c002200 tx=0x7f5d8c0019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:26.906+0000 7f5d93fff640 1 -- 172.21.15.81:0/2984000558 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5d9401f020 con 0x7f5d9c15e800 2024-09-21T06:46:27.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.086+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5d9c0cf820 con 0x7f5d9c15e800 2024-09-21T06:46:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.765+0000 7f5d93fff640 1 -- 172.21.15.81:0/2984000558 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) ==== 181+0+0 (secure 0 0 0) 0x7f5d9c0a03f0 con 0x7f5d9c15e800 2024-09-21T06:46:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:46:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.768+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5d7c078b90 msgr2=0x7f5d7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.768+0000 7f5da1962640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5d7c078b90 0x7f5d7c07b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c002200 tx=0x7f5d8c0019f0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.768+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c15e800 msgr2=0x7f5d9c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.768+0000 7f5da1962640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c15e800 0x7f5d9c06ef60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b440 tx=0x7f5d9400b900 comp rx=0 tx=0).stop 2024-09-21T06:46:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 shutdown_connections 2024-09-21T06:46:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5d7c078b90 0x7f5d7c07b0a0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c002200 tx=0x7f5d8c0019f0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5d9c0d4370 0x7f5d9c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d9c15e800 0x7f5d9c06ef60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 --2- 172.21.15.81:0/2984000558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5d9c0cf130 0x7f5d9c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 >> 172.21.15.81:0/2984000558 conn(0x7f5d9c0b7330 msgr2=0x7f5d9c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 shutdown_connections 2024-09-21T06:46:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.769+0000 7f5da1962640 1 -- 172.21.15.81:0/2984000558 wait complete. 2024-09-21T06:46:27.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:46:27.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.898+0000 7f34d5e84640 1 -- 172.21.15.81:0/3023080264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34bc004800 msgr2=0x7f34bc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.898+0000 7f34d5e84640 1 --2- 172.21.15.81:0/3023080264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34bc004800 0x7f34bc004c10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34b80016c0 tx=0x7f34bc005830 comp rx=0 tx=0).stop 2024-09-21T06:46:27.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.898+0000 7f34d5e84640 1 -- 172.21.15.81:0/3023080264 shutdown_connections 2024-09-21T06:46:27.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.898+0000 7f34d5e84640 1 --2- 172.21.15.81:0/3023080264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34bc004800 0x7f34bc004c10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.898+0000 7f34d5e84640 1 -- 172.21.15.81:0/3023080264 >> 172.21.15.81:0/3023080264 conn(0x7f34d00b4210 msgr2=0x7f34d00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:27.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.898+0000 7f34d5e84640 1 -- 172.21.15.81:0/3023080264 shutdown_connections 2024-09-21T06:46:27.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.898+0000 7f34d5e84640 1 -- 172.21.15.81:0/3023080264 wait complete. 2024-09-21T06:46:27.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.900+0000 7f34d5e84640 1 Processor -- start 2024-09-21T06:46:27.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.900+0000 7f34d5e84640 1 -- start start 2024-09-21T06:46:27.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34d5e84640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34bc004800 0x7f34d01554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34d5e84640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d00c79a0 0x7f34d00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34d5e84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d00cb430 0x7f34d00cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34d5e84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34d015dac0 con 0x7f34d00cb430 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34d5e84640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34d015d940 con 0x7f34d00c79a0 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34d5e84640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f34d015ab10 con 0x7f34bc004800 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d00cb430 0x7f34d00cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d00cb430 0x7f34d00cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60842/0 (socket says 172.21.15.81:60842) 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 -- 172.21.15.81:0/741124288 learned_addr learned my addr 172.21.15.81:0/741124288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cf7fe640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34bc004800 0x7f34d01554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34c7fff640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d00c79a0 0x7f34d00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 -- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34bc004800 msgr2=0x7f34d01554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34bc004800 0x7f34d01554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 -- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d00c79a0 msgr2=0x7f34d00c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d00c79a0 0x7f34d00c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.901+0000 7f34cffff640 1 -- 172.21.15.81:0/741124288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00cbd80 con 0x7f34d00cb430 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.902+0000 7f34cffff640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d00cb430 0x7f34d00cb840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f34c8002230 tx=0x7f34c800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.902+0000 7f34ccff9640 1 -- 172.21.15.81:0/741124288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c800cc20 con 0x7f34d00cb430 2024-09-21T06:46:27.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.902+0000 7f34ccff9640 1 -- 172.21.15.81:0/741124288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c8017070 con 0x7f34d00cb430 2024-09-21T06:46:27.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.902+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d015a640 con 0x7f34d00cb430 2024-09-21T06:46:27.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.902+0000 7f34ccff9640 1 -- 172.21.15.81:0/741124288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80116c0 con 0x7f34d00cb430 2024-09-21T06:46:27.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.902+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d01f7080 con 0x7f34d00cb430 2024-09-21T06:46:27.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.903+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d00d1ad0 con 0x7f34d00cb430 2024-09-21T06:46:27.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.904+0000 7f34ccff9640 1 -- 172.21.15.81:0/741124288 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34c8011860 con 0x7f34d00cb430 2024-09-21T06:46:27.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.904+0000 7f34ccff9640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34b0078b90 0x7f34b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.904+0000 7f34ccff9640 1 -- 172.21.15.81:0/741124288 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6144+0+0 (secure 0 0 0) 0x7f34c809b380 con 0x7f34d00cb430 2024-09-21T06:46:27.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.904+0000 7f34cf7fe640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34b0078b90 0x7f34b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.905+0000 7f34cf7fe640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34b0078b90 0x7f34b007b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009c10 tx=0x7f34c0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:27.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:27.909+0000 7f34ccff9640 1 -- 172.21.15.81:0/741124288 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f34d00cbd80 con 0x7f34d00cb430 2024-09-21T06:46:28.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.085+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34d01585b0 con 0x7f34d00cb430 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.767+0000 7f34ccff9640 1 -- 172.21.15.81:0/741124288 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) ==== 169+0+0 (secure 0 0 0) 0x7f34c80636a0 con 0x7f34d00cb430 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34b0078b90 msgr2=0x7f34b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34b0078b90 0x7f34b007b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009c10 tx=0x7f34c0005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d00cb430 msgr2=0x7f34d00cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d00cb430 0x7f34d00cb840 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f34c8002230 tx=0x7f34c800ed30 comp rx=0 tx=0).stop 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 shutdown_connections 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34b0078b90 0x7f34b007b0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d00cb430 0x7f34d00cb840 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34d00c79a0 0x7f34d00c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 --2- 172.21.15.81:0/741124288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34bc004800 0x7f34d01554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.769+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 >> 172.21.15.81:0/741124288 conn(0x7f34d00b4210 msgr2=0x7f34d00b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.770+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 shutdown_connections 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.770+0000 7f34d5e84640 1 -- 172.21.15.81:0/741124288 wait complete. 2024-09-21T06:46:28.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 -- 172.21.15.81:0/2690550922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400cc800 msgr2=0x7f10400ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 --2- 172.21.15.81:0/2690550922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400cc800 0x7f10400ccc10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f10400ce070 tx=0x7f103402a5f0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 -- 172.21.15.81:0/2690550922 shutdown_connections 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 --2- 172.21.15.81:0/2690550922 >> v2:172.21.15.89:3300/0 conn(0x7f10400d0340 0x7f10400d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 --2- 172.21.15.81:0/2690550922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400cc800 0x7f10400ccc10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 --2- 172.21.15.81:0/2690550922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10400d18c0 0x7f10401533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 -- 172.21.15.81:0/2690550922 >> 172.21.15.81:0/2690550922 conn(0x7f10400cec30 msgr2=0x7f10400cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 -- 172.21.15.81:0/2690550922 shutdown_connections 2024-09-21T06:46:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.902+0000 7f1045121640 1 -- 172.21.15.81:0/2690550922 wait complete. 2024-09-21T06:46:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.904+0000 7f1045121640 1 Processor -- start 2024-09-21T06:46:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.904+0000 7f1045121640 1 -- start start 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.905+0000 7f1045121640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10400cc800 0x7f1040156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.905+0000 7f1045121640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400d0340 0x7f10401510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f1045121640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10400d18c0 0x7f1040158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f1045121640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10400d1020 con 0x7f10400d0340 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f1045121640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f10400d0ea0 con 0x7f10400d18c0 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f1045121640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f10400d11a0 con 0x7f10400cc800 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400d0340 0x7f10401510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400d0340 0x7f10401510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35010/0 (socket says 172.21.15.81:35010) 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 -- 172.21.15.81:0/1802160181 learned_addr learned my addr 172.21.15.81:0/1802160181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103f59e640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10400d18c0 0x7f1040158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103ed9d640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10400cc800 0x7f1040156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 -- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10400cc800 msgr2=0x7f1040156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10400cc800 0x7f1040156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 -- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10400d18c0 msgr2=0x7f1040158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10400d18c0 0x7f1040158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 -- 172.21.15.81:0/1802160181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10401577c0 con 0x7f10400d0340 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103ed9d640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10400cc800 0x7f1040156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f103e59c640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400d0340 0x7f10401510c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1034034040 tx=0x7f10340039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f10277fe640 1 -- 172.21.15.81:0/1802160181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103403e030 con 0x7f10400d0340 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f10277fe640 1 -- 172.21.15.81:0/1802160181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10340047a0 con 0x7f10400d0340 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1040157aa0 con 0x7f10400d0340 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f10277fe640 1 -- 172.21.15.81:0/1802160181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034035040 con 0x7f10400d0340 2024-09-21T06:46:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.906+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1040158060 con 0x7f10400d0340 2024-09-21T06:46:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.907+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10400b8170 con 0x7f10400d0340 2024-09-21T06:46:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.908+0000 7f10277fe640 1 -- 172.21.15.81:0/1802160181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1034041030 con 0x7f10400d0340 2024-09-21T06:46:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.909+0000 7f10277fe640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f102c078b90 0x7f102c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.909+0000 7f10277fe640 1 -- 172.21.15.81:0/1802160181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5730+0+0 (secure 0 0 0) 0x7f10340bb9d0 con 0x7f10400d0340 2024-09-21T06:46:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.909+0000 7f103ed9d640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f102c078b90 0x7f102c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.910+0000 7f103ed9d640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f102c078b90 0x7f102c07b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1030009890 tx=0x7f1030008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:28.913+0000 7f10277fe640 1 -- 172.21.15.81:0/1802160181 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f10400b8170 con 0x7f10400d0340 2024-09-21T06:46:29.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.090+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) -- 0x7f10400d0750 con 0x7f10400d0340 2024-09-21T06:46:29.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.772+0000 7f10277fe640 1 -- 172.21.15.81:0/1802160181 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v45) ==== 160+0+0 (secure 0 0 0) 0x7f1034083880 con 0x7f10400d0340 2024-09-21T06:46:29.774 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'data_new' removed 2024-09-21T06:46:29.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f102c078b90 msgr2=0x7f102c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f102c078b90 0x7f102c07b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1030009890 tx=0x7f1030008040 comp rx=0 tx=0).stop 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400d0340 msgr2=0x7f10401510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400d0340 0x7f10401510c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1034034040 tx=0x7f10340039e0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 shutdown_connections 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f102c078b90 0x7f102c07b0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10400d18c0 0x7f1040158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10400d0340 0x7f10401510c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 --2- 172.21.15.81:0/1802160181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10400cc800 0x7f1040156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 >> 172.21.15.81:0/1802160181 conn(0x7f10400cec30 msgr2=0x7f10401e9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 shutdown_connections 2024-09-21T06:46:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.775+0000 7f1045121640 1 -- 172.21.15.81:0/1802160181 wait complete. 2024-09-21T06:46:29.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 -- 172.21.15.81:0/293626348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 msgr2=0x7f96f00d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 --2- 172.21.15.81:0/293626348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00d45b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f96e8005fd0 tx=0x7f96e802aa90 comp rx=0 tx=0).stop 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 -- 172.21.15.81:0/293626348 shutdown_connections 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 --2- 172.21.15.81:0/293626348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00d45b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 --2- 172.21.15.81:0/293626348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96f015c450 0x7f96f00d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 -- 172.21.15.81:0/293626348 >> 172.21.15.81:0/293626348 conn(0x7f96f00b7330 msgr2=0x7f96f00b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 -- 172.21.15.81:0/293626348 shutdown_connections 2024-09-21T06:46:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.901+0000 7f96f7989640 1 -- 172.21.15.81:0/293626348 wait complete. 2024-09-21T06:46:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.903+0000 7f96f7989640 1 Processor -- start 2024-09-21T06:46:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.903+0000 7f96f7989640 1 -- start start 2024-09-21T06:46:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f7989640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f7989640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96f015c450 0x7f96f0152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f7989640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96f015eda0 0x7f96f01f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f7989640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96f00b35c0 con 0x7f96f00d41a0 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f7989640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f96f00b3440 con 0x7f96f015eda0 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f7989640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f96f00b3740 con 0x7f96f015c450 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f5725640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f5725640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35034/0 (socket says 172.21.15.81:35034) 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.904+0000 7f96f5725640 1 -- 172.21.15.81:0/1041622028 learned_addr learned my addr 172.21.15.81:0/1041622028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f5f26640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96f015eda0 0x7f96f01f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f4f24640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96f015c450 0x7f96f0152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f5725640 1 -- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96f015c450 msgr2=0x7f96f0152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f5725640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96f015c450 0x7f96f0152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f5725640 1 -- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96f015eda0 msgr2=0x7f96f01f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f5725640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96f015eda0 0x7f96f01f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f5725640 1 -- 172.21.15.81:0/1041622028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f006f530 con 0x7f96f00d41a0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f5725640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00cdfb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00d750 tx=0x7f96ec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96e5ffb640 1 -- 172.21.15.81:0/1041622028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec017070 con 0x7f96f00d41a0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96e5ffb640 1 -- 172.21.15.81:0/1041622028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96ec009b20 con 0x7f96f00d41a0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96e5ffb640 1 -- 172.21.15.81:0/1041622028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec010460 con 0x7f96f00d41a0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f006f810 con 0x7f96f00d41a0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.905+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f00b5010 con 0x7f96f00d41a0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.906+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f008d110 con 0x7f96f00d41a0 2024-09-21T06:46:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.907+0000 7f96e5ffb640 1 -- 172.21.15.81:0/1041622028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96ec01a070 con 0x7f96f00d41a0 2024-09-21T06:46:29.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.908+0000 7f96e5ffb640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f96d4078b90 0x7f96d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:29.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.908+0000 7f96e5ffb640 1 -- 172.21.15.81:0/1041622028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f96ec09ac40 con 0x7f96f00d41a0 2024-09-21T06:46:29.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.908+0000 7f96f4f24640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f96d4078b90 0x7f96d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:29.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.909+0000 7f96f4f24640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f96d4078b90 0x7f96d407b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f96f00cb590 tx=0x7f96e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:29.913+0000 7f96e5ffb640 1 -- 172.21.15.81:0/1041622028 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f96f008d110 con 0x7f96f00d41a0 2024-09-21T06:46:30.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.090+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f96f006f030 con 0x7f96f00d41a0 2024-09-21T06:46:30.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.093+0000 7f96e5ffb640 1 -- 172.21.15.81:0/1041622028 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f96ec062c30 con 0x7f96f00d41a0 2024-09-21T06:46:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f96d4078b90 msgr2=0x7f96d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f96d4078b90 0x7f96d407b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f96f00cb590 tx=0x7f96e0009040 comp rx=0 tx=0).stop 2024-09-21T06:46:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 msgr2=0x7f96f00cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00cdfb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00d750 tx=0x7f96ec00dc10 comp rx=0 tx=0).stop 2024-09-21T06:46:30.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 shutdown_connections 2024-09-21T06:46:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f96d4078b90 0x7f96d407b0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96f015c450 0x7f96f0152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96f015eda0 0x7f96f01f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 --2- 172.21.15.81:0/1041622028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96f00d41a0 0x7f96f00cdfb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 >> 172.21.15.81:0/1041622028 conn(0x7f96f00b7330 msgr2=0x7f96f0160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 shutdown_connections 2024-09-21T06:46:30.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.096+0000 7f96f7989640 1 -- 172.21.15.81:0/1041622028 wait complete. 2024-09-21T06:46:30.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.222+0000 7fec5ed94640 1 -- 172.21.15.81:0/2559037551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815a290 msgr2=0x7fec581601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.222+0000 7fec5ed94640 1 --2- 172.21.15.81:0/2559037551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815a290 0x7fec581601c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fec48009830 tx=0x7fec4802a530 comp rx=0 tx=0).stop 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.222+0000 7fec5ed94640 1 -- 172.21.15.81:0/2559037551 shutdown_connections 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.222+0000 7fec5ed94640 1 --2- 172.21.15.81:0/2559037551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815a290 0x7fec581601c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.222+0000 7fec5ed94640 1 -- 172.21.15.81:0/2559037551 >> 172.21.15.81:0/2559037551 conn(0x7fec580d25e0 msgr2=0x7fec580d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.222+0000 7fec5ed94640 1 -- 172.21.15.81:0/2559037551 shutdown_connections 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.222+0000 7fec5ed94640 1 -- 172.21.15.81:0/2559037551 wait complete. 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.224+0000 7fec5ed94640 1 Processor -- start 2024-09-21T06:46:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.224+0000 7fec5ed94640 1 -- start start 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5ed94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec580d19a0 0x7fec580b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5ed94640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec5815a290 0x7fec581f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5ed94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815d2c0 0x7fec581f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5ed94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec5815d6d0 con 0x7fec5815d2c0 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5ed94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fec58073660 con 0x7fec580d19a0 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5ed94640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fec5815d850 con 0x7fec5815a290 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5d331640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815d2c0 0x7fec581f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5d331640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815d2c0 0x7fec581f7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35046/0 (socket says 172.21.15.81:35046) 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5d331640 1 -- 172.21.15.81:0/4125069631 learned_addr learned my addr 172.21.15.81:0/4125069631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec4ffff640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec5815a290 0x7fec581f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.225+0000 7fec5cb30640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec580d19a0 0x7fec580b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5d331640 1 -- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec5815a290 msgr2=0x7fec581f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5d331640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec5815a290 0x7fec581f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5d331640 1 -- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec580d19a0 msgr2=0x7fec580b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5d331640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec580d19a0 0x7fec580b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5d331640 1 -- 172.21.15.81:0/4125069631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec581f7ac0 con 0x7fec5815d2c0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5d331640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815d2c0 0x7fec581f7580 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c700 tx=0x7fec5000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec4d7fa640 1 -- 172.21.15.81:0/4125069631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50003b70 con 0x7fec5815d2c0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec4d7fa640 1 -- 172.21.15.81:0/4125069631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec50003d10 con 0x7fec5815d2c0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec581f3f50 con 0x7fec5815d2c0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec4d7fa640 1 -- 172.21.15.81:0/4125069631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5000aab0 con 0x7fec5815d2c0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.226+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec580c7fe0 con 0x7fec5815d2c0 2024-09-21T06:46:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.227+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec581601c0 con 0x7fec5815d2c0 2024-09-21T06:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.228+0000 7fec4d7fa640 1 -- 172.21.15.81:0/4125069631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec5000ac50 con 0x7fec5815d2c0 2024-09-21T06:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.228+0000 7fec4d7fa640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fec44078b90 0x7fec4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.229+0000 7fec4d7fa640 1 -- 172.21.15.81:0/4125069631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fec5009a780 con 0x7fec5815d2c0 2024-09-21T06:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.229+0000 7fec5cb30640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fec44078b90 0x7fec4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.229+0000 7fec5cb30640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fec44078b90 0x7fec4407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec54007fd0 tx=0x7fec54001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.233+0000 7fec4d7fa640 1 -- 172.21.15.81:0/4125069631 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fec50062800 con 0x7fec5815d2c0 2024-09-21T06:46:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.481+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) -- 0x7fec581f3ce0 con 0x7fec5815d2c0 2024-09-21T06:46:30.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.774+0000 7fec4d7fa640 1 -- 172.21.15.81:0/4125069631 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v94) ==== 147+0+0 (secure 0 0 0) 0x7fec50067230 con 0x7fec5815d2c0 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.776+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fec44078b90 msgr2=0x7fec4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.776+0000 7fec5ed94640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fec44078b90 0x7fec4407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec54007fd0 tx=0x7fec54001370 comp rx=0 tx=0).stop 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.776+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815d2c0 msgr2=0x7fec581f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.776+0000 7fec5ed94640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815d2c0 0x7fec581f7580 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c700 tx=0x7fec5000cbc0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 shutdown_connections 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fec44078b90 0x7fec4407b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec5815a290 0x7fec581f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec5815d2c0 0x7fec581f7580 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 --2- 172.21.15.81:0/4125069631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec580d19a0 0x7fec580b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 >> 172.21.15.81:0/4125069631 conn(0x7fec580d25e0 msgr2=0x7fec580b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 shutdown_connections 2024-09-21T06:46:30.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.777+0000 7fec5ed94640 1 -- 172.21.15.81:0/4125069631 wait complete. 2024-09-21T06:46:30.789 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2024-09-21T06:46:30.789 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2024-09-21T06:46:30.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.900+0000 7f3f1487e640 1 -- 172.21.15.81:0/4290933369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3efc004d40 msgr2=0x7f3efc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.900+0000 7f3f1487e640 1 --2- 172.21.15.81:0/4290933369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3efc004d40 0x7f3efc005190 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3f100cc7d0 tx=0x7f3efc005830 comp rx=0 tx=0).stop 2024-09-21T06:46:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.901+0000 7f3f0ed9d640 1 -- 172.21.15.81:0/4290933369 reap_dead start 2024-09-21T06:46:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.901+0000 7f3f1487e640 1 -- 172.21.15.81:0/4290933369 shutdown_connections 2024-09-21T06:46:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.901+0000 7f3f1487e640 1 -- 172.21.15.81:0/4290933369 >> 172.21.15.81:0/4290933369 conn(0x7f3f100b4210 msgr2=0x7f3f100b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.901+0000 7f3f1487e640 1 -- 172.21.15.81:0/4290933369 shutdown_connections 2024-09-21T06:46:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.901+0000 7f3f1487e640 1 -- 172.21.15.81:0/4290933369 wait complete. 2024-09-21T06:46:30.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.903+0000 7f3f1487e640 1 Processor -- start 2024-09-21T06:46:30.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.903+0000 7f3f1487e640 1 -- start start 2024-09-21T06:46:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f1487e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3efc004d40 0x7f3f10155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f1487e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f100c8660 0x7f3f100d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f1487e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f101f90f0 0x7f3f100d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f1487e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1015e940 con 0x7f3f101f90f0 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f1487e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1015e7c0 con 0x7f3efc004d40 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f1487e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3f1015eac0 con 0x7f3f100c8660 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f101f90f0 0x7f3f100d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f101f90f0 0x7f3f100d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35056/0 (socket says 172.21.15.81:35056) 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 -- 172.21.15.81:0/3722449316 learned_addr learned my addr 172.21.15.81:0/3722449316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0e59c640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3efc004d40 0x7f3f10155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f05d9b640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f100c8660 0x7f3f100d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 -- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f100c8660 msgr2=0x7f3f100d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f100c8660 0x7f3f100d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 -- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3efc004d40 msgr2=0x7f3f10155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3efc004d40 0x7f3f10155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0ed9d640 1 -- 172.21.15.81:0/3722449316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f101f5090 con 0x7f3f101f90f0 2024-09-21T06:46:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.904+0000 7f3f0e59c640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3efc004d40 0x7f3f10155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.905+0000 7f3f0ed9d640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f101f90f0 0x7f3f100d15a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3f08036040 tx=0x7f3f08033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.905+0000 7f3f077fe640 1 -- 172.21.15.81:0/3722449316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08038040 con 0x7f3f101f90f0 2024-09-21T06:46:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.905+0000 7f3f077fe640 1 -- 172.21.15.81:0/3722449316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f0802bbe0 con 0x7f3f101f90f0 2024-09-21T06:46:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.905+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f101f5370 con 0x7f3f101f90f0 2024-09-21T06:46:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.905+0000 7f3f077fe640 1 -- 172.21.15.81:0/3722449316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08004b20 con 0x7f3f101f90f0 2024-09-21T06:46:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.905+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101f5930 con 0x7f3f101f90f0 2024-09-21T06:46:30.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.906+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1015efb0 con 0x7f3f101f90f0 2024-09-21T06:46:30.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.906+0000 7f3f077fe640 1 -- 172.21.15.81:0/3722449316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f08044030 con 0x7f3f101f90f0 2024-09-21T06:46:30.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.907+0000 7f3f077fe640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3ef0078b90 0x7f3ef007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.907+0000 7f3f077fe640 1 -- 172.21.15.81:0/3722449316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f3f080bb180 con 0x7f3f101f90f0 2024-09-21T06:46:30.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.907+0000 7f3f0e59c640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3ef0078b90 0x7f3ef007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.908+0000 7f3f0e59c640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3ef0078b90 0x7f3ef007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f000011a0 tx=0x7f3f00006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:30.911+0000 7f3f077fe640 1 -- 172.21.15.81:0/3722449316 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3f0804b020 con 0x7f3f101f90f0 2024-09-21T06:46:31.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.089+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f100c5ae0 con 0x7f3f101f90f0 2024-09-21T06:46:31.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.090+0000 7f3f077fe640 1 -- 172.21.15.81:0/3722449316 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13269 (secure 0 0 0) 0x7f3f080836b0 con 0x7f3f101f90f0 2024-09-21T06:46:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:31.091 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":45,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:29.767548+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6837/3622751302":"2024-09-22T06:46:25.761392+0000","172.21.15.89:6835/3622751302":"2024-09-22T06:46:25.761392+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3ef0078b90 msgr2=0x7f3ef007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3ef0078b90 0x7f3ef007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f000011a0 tx=0x7f3f00006b10 comp rx=0 tx=0).stop 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f101f90f0 msgr2=0x7f3f100d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f101f90f0 0x7f3f100d15a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3f08036040 tx=0x7f3f08033ba0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 shutdown_connections 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3ef0078b90 0x7f3ef007b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f100c8660 0x7f3f100d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f101f90f0 0x7f3f100d15a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 --2- 172.21.15.81:0/3722449316 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3efc004d40 0x7f3f10155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 >> 172.21.15.81:0/3722449316 conn(0x7f3f100b4210 msgr2=0x7f3f100b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 shutdown_connections 2024-09-21T06:46:31.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.092+0000 7f3f1487e640 1 -- 172.21.15.81:0/3722449316 wait complete. 2024-09-21T06:46:31.105 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:45:04.668203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:46:31.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:46:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.220+0000 7fd037c8b640 1 -- 172.21.15.81:0/1583151845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c003a30 msgr2=0x7fd01c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.220+0000 7fd037c8b640 1 --2- 172.21.15.81:0/1583151845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd01c003a30 0x7fd01c003ea0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd02c001d90 tx=0x7fd01c005830 comp rx=0 tx=0).stop 2024-09-21T06:46:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.220+0000 7fd036228640 1 -- 172.21.15.81:0/1583151845 reap_dead start 2024-09-21T06:46:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.220+0000 7fd037c8b640 1 -- 172.21.15.81:0/1583151845 shutdown_connections 2024-09-21T06:46:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.220+0000 7fd037c8b640 1 -- 172.21.15.81:0/1583151845 >> 172.21.15.81:0/1583151845 conn(0x7fd0300b7330 msgr2=0x7fd0300b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.220+0000 7fd037c8b640 1 -- 172.21.15.81:0/1583151845 shutdown_connections 2024-09-21T06:46:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.220+0000 7fd037c8b640 1 -- 172.21.15.81:0/1583151845 wait complete. 2024-09-21T06:46:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.222+0000 7fd037c8b640 1 Processor -- start 2024-09-21T06:46:31.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.222+0000 7fd037c8b640 1 -- start start 2024-09-21T06:46:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd037c8b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd01c003a30 0x7fd0300ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd037c8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd03006e7e0 0x7fd0301558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd037c8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03015aaa0 0x7fd03015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd037c8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0300b3230 con 0x7fd03015aaa0 2024-09-21T06:46:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd037c8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd0300b99b0 con 0x7fd03006e7e0 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd037c8b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd0300b33b0 con 0x7fd01c003a30 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03015aaa0 0x7fd03015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03015aaa0 0x7fd03015aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35070/0 (socket says 172.21.15.81:35070) 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 -- 172.21.15.81:0/2437948137 learned_addr learned my addr 172.21.15.81:0/2437948137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd035226640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd03006e7e0 0x7fd0301558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd035a27640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd01c003a30 0x7fd0300ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 -- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd01c003a30 msgr2=0x7fd0300ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd01c003a30 0x7fd0300ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 -- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd03006e7e0 msgr2=0x7fd0301558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd03006e7e0 0x7fd0301558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.223+0000 7fd036228640 1 -- 172.21.15.81:0/2437948137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd030155e20 con 0x7fd03015aaa0 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.224+0000 7fd036228640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03015aaa0 0x7fd03015aeb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd0300c7980 tx=0x7fd0280039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.224+0000 7fd0267fc640 1 -- 172.21.15.81:0/2437948137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028011840 con 0x7fd03015aaa0 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.224+0000 7fd0267fc640 1 -- 172.21.15.81:0/2437948137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd028018070 con 0x7fd03015aaa0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.224+0000 7fd0267fc640 1 -- 172.21.15.81:0/2437948137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028011c80 con 0x7fd03015aaa0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.224+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03015b3f0 con 0x7fd03015aaa0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.224+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0300c8c10 con 0x7fd03015aaa0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.225+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03008d110 con 0x7fd03015aaa0 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.226+0000 7fd0267fc640 1 -- 172.21.15.81:0/2437948137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd02801d460 con 0x7fd03015aaa0 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.226+0000 7fd0267fc640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd014078bc0 0x7fd01407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.226+0000 7fd0267fc640 1 -- 172.21.15.81:0/2437948137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fd02809b220 con 0x7fd03015aaa0 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.226+0000 7fd035a27640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd014078bc0 0x7fd01407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.227+0000 7fd035a27640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd014078bc0 0x7fd01407b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd02c032000 tx=0x7fd02c001510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.231+0000 7fd0267fc640 1 -- 172.21.15.81:0/2437948137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd03008d110 con 0x7fd03015aaa0 2024-09-21T06:46:31.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.406+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd0300b3910 con 0x7fd03015aaa0 2024-09-21T06:46:31.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.406+0000 7fd0267fc640 1 -- 172.21.15.81:0/2437948137 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7fd03015b3f0 con 0x7fd03015aaa0 2024-09-21T06:46:31.408 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.408+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd014078bc0 msgr2=0x7fd01407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.408+0000 7fd037c8b640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd014078bc0 0x7fd01407b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd02c032000 tx=0x7fd02c001510 comp rx=0 tx=0).stop 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.408+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03015aaa0 msgr2=0x7fd03015aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.408+0000 7fd037c8b640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03015aaa0 0x7fd03015aeb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd0300c7980 tx=0x7fd0280039c0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.408+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 shutdown_connections 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.409+0000 7fd037c8b640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd014078bc0 0x7fd01407b0d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.409+0000 7fd037c8b640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03015aaa0 0x7fd03015aeb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.409+0000 7fd037c8b640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd03006e7e0 0x7fd0301558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.409+0000 7fd037c8b640 1 --2- 172.21.15.81:0/2437948137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd01c003a30 0x7fd0300ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.409+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 >> 172.21.15.81:0/2437948137 conn(0x7fd0300b7330 msgr2=0x7fd0300d1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.409+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 shutdown_connections 2024-09-21T06:46:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.409+0000 7fd037c8b640 1 -- 172.21.15.81:0/2437948137 wait complete. 2024-09-21T06:46:31.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-09-21T06:46:31.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.534+0000 7f8853551640 1 -- 172.21.15.81:0/3271674531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 msgr2=0x7f8838003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.534+0000 7f8853551640 1 --2- 172.21.15.81:0/3271674531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f8838003ec0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f88480016c0 tx=0x7f8838005830 comp rx=0 tx=0).stop 2024-09-21T06:46:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.534+0000 7f8853551640 1 -- 172.21.15.81:0/3271674531 shutdown_connections 2024-09-21T06:46:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.534+0000 7f8853551640 1 --2- 172.21.15.81:0/3271674531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f8838003ec0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.534+0000 7f8853551640 1 -- 172.21.15.81:0/3271674531 >> 172.21.15.81:0/3271674531 conn(0x7f884c0b4220 msgr2=0x7f884c0b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.534+0000 7f8853551640 1 -- 172.21.15.81:0/3271674531 shutdown_connections 2024-09-21T06:46:31.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.534+0000 7f8853551640 1 -- 172.21.15.81:0/3271674531 wait complete. 2024-09-21T06:46:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.536+0000 7f8853551640 1 Processor -- start 2024-09-21T06:46:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.536+0000 7f8853551640 1 -- start start 2024-09-21T06:46:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8853551640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f884c0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8853551640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884c0b75b0 0x7f884c0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8853551640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884c0aaf50 0x7f884c0ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8853551640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f884c15d680 con 0x7f8838003a50 2024-09-21T06:46:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8853551640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f884c15d500 con 0x7f884c0b75b0 2024-09-21T06:46:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8853551640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f884c15d800 con 0x7f884c0aaf50 2024-09-21T06:46:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f88512ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f884c0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f88512ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f884c0cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35082/0 (socket says 172.21.15.81:35082) 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f88512ed640 1 -- 172.21.15.81:0/99375579 learned_addr learned my addr 172.21.15.81:0/99375579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8851aee640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884c0aaf50 0x7f884c0ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.537+0000 7f8850aec640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884c0b75b0 0x7f884c0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f88512ed640 1 -- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884c0aaf50 msgr2=0x7f884c0ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f88512ed640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884c0aaf50 0x7f884c0ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f88512ed640 1 -- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884c0b75b0 msgr2=0x7f884c0b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f88512ed640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884c0b75b0 0x7f884c0b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f88512ed640 1 -- 172.21.15.81:0/99375579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c0b80d0 con 0x7f8838003a50 2024-09-21T06:46:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f8850aec640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884c0b75b0 0x7f884c0b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f88512ed640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f884c0cc770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f884802a8e0 tx=0x7f88480063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f8841ffb640 1 -- 172.21.15.81:0/99375579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848003a00 con 0x7f8838003a50 2024-09-21T06:46:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f8841ffb640 1 -- 172.21.15.81:0/99375579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8848039070 con 0x7f8838003a50 2024-09-21T06:46:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884c0a9540 con 0x7f8838003a50 2024-09-21T06:46:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f8841ffb640 1 -- 172.21.15.81:0/99375579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848033420 con 0x7f8838003a50 2024-09-21T06:46:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.538+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884c0a97e0 con 0x7f8838003a50 2024-09-21T06:46:31.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.539+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884c0d0210 con 0x7f8838003a50 2024-09-21T06:46:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.540+0000 7f8841ffb640 1 -- 172.21.15.81:0/99375579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8848044020 con 0x7f8838003a50 2024-09-21T06:46:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.540+0000 7f8841ffb640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8830078bc0 0x7f883007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.540+0000 7f8841ffb640 1 -- 172.21.15.81:0/99375579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f88480ba4a0 con 0x7f8838003a50 2024-09-21T06:46:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.541+0000 7f8850aec640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8830078bc0 0x7f883007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.541+0000 7f8850aec640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8830078bc0 0x7f883007b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f884c0accc0 tx=0x7f883c0067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.545+0000 7f8841ffb640 1 -- 172.21.15.81:0/99375579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f884c0a9540 con 0x7f8838003a50 2024-09-21T06:46:31.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:46:31.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:46:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:31.800+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7f884c0ccf60 con 0x7f8838003a50 2024-09-21T06:46:32.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.781+0000 7f8841ffb640 1 -- 172.21.15.81:0/99375579 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v96) ==== 137+0+0 (secure 0 0 0) 0x7f884808b020 con 0x7f8838003a50 2024-09-21T06:46:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8830078bc0 msgr2=0x7f883007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8830078bc0 0x7f883007b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f884c0accc0 tx=0x7f883c0067a0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 msgr2=0x7f884c0cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f884c0cc770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f884802a8e0 tx=0x7f88480063a0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 shutdown_connections 2024-09-21T06:46:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8830078bc0 0x7f883007b0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f884c0aaf50 0x7f884c0ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884c0b75b0 0x7f884c0b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 --2- 172.21.15.81:0/99375579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838003a50 0x7f884c0cc770 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 >> 172.21.15.81:0/99375579 conn(0x7f884c0b4220 msgr2=0x7f884c15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 shutdown_connections 2024-09-21T06:46:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.784+0000 7f8853551640 1 -- 172.21.15.81:0/99375579 wait complete. 2024-09-21T06:46:32.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.916+0000 7f1181958640 1 -- 172.21.15.81:0/1302236810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 msgr2=0x7f1168004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.916+0000 7f1181958640 1 --2- 172.21.15.81:0/1302236810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f1168004c10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f117c0b3e10 tx=0x7f1168005830 comp rx=0 tx=0).stop 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.916+0000 7f1181958640 1 -- 172.21.15.81:0/1302236810 shutdown_connections 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.916+0000 7f1181958640 1 --2- 172.21.15.81:0/1302236810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f1168004c10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.916+0000 7f1181958640 1 -- 172.21.15.81:0/1302236810 >> 172.21.15.81:0/1302236810 conn(0x7f117c0b7330 msgr2=0x7f117c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.916+0000 7f1181958640 1 -- 172.21.15.81:0/1302236810 shutdown_connections 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.916+0000 7f1181958640 1 -- 172.21.15.81:0/1302236810 wait complete. 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.918+0000 7f1181958640 1 Processor -- start 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.918+0000 7f1181958640 1 -- start start 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f117c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c14ff80 0x7f117c06e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c06e840 0x7f117c1f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f117c0d4940 con 0x7f1168004800 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f117c0d47c0 con 0x7f117c14ff80 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f117c0d4ac0 con 0x7f117c06e840 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f117c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f117c0cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35098/0 (socket says 172.21.15.81:35098) 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 -- 172.21.15.81:0/3374583893 learned_addr learned my addr 172.21.15.81:0/3374583893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f11727fc640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c14ff80 0x7f117c06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117b7fe640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c06e840 0x7f117c1f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 -- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c06e840 msgr2=0x7f117c1f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c06e840 0x7f117c1f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 -- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c14ff80 msgr2=0x7f117c06e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c14ff80 0x7f117c06e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 -- 172.21.15.81:0/3374583893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c0cd650 con 0x7f1168004800 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117b7fe640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c06e840 0x7f117c1f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f11727fc640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c14ff80 0x7f117c06e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f117affd640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f117c0cbb50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f116c011780 tx=0x7f116c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1178ff9640 1 -- 172.21.15.81:0/3374583893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c004460 con 0x7f1168004800 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1178ff9640 1 -- 172.21.15.81:0/3374583893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f116c016070 con 0x7f1168004800 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117c06ec50 con 0x7f1168004800 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1178ff9640 1 -- 172.21.15.81:0/3374583893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c00fba0 con 0x7f1168004800 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.920+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117c0cde30 con 0x7f1168004800 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.921+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117c08ddf0 con 0x7f1168004800 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.922+0000 7f1178ff9640 1 -- 172.21.15.81:0/3374583893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f116c018030 con 0x7f1168004800 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.923+0000 7f1178ff9640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f115c078b90 0x7f115c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.923+0000 7f1178ff9640 1 -- 172.21.15.81:0/3374583893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f116c09b340 con 0x7f1168004800 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.923+0000 7f11727fc640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f115c078b90 0x7f115c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.924+0000 7f11727fc640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f115c078b90 0x7f115c07b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1164033000 tx=0x7f1164000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:32.928+0000 7f1178ff9640 1 -- 172.21.15.81:0/3374583893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f117c08ddf0 con 0x7f1168004800 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.104+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f117c08d110 con 0x7f1168004800 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.105+0000 7f1178ff9640 1 -- 172.21.15.81:0/3374583893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+2294 (secure 0 0 0) 0x7f117c08d110 con 0x7f1168004800 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_client 20/20 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3876.588034 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4115.510150 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3757.512442 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4044.560836 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4228.192761 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6498.980548 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4050.688802 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 6012.152376 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f115c078b90 msgr2=0x7f115c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f115c078b90 0x7f115c07b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1164033000 tx=0x7f1164000fe0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 msgr2=0x7f117c0cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f117c0cbb50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f116c011780 tx=0x7f116c011c40 comp rx=0 tx=0).stop 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 shutdown_connections 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f115c078b90 0x7f115c07b0a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f117c06e840 0x7f117c1f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f117c14ff80 0x7f117c06e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 --2- 172.21.15.81:0/3374583893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1168004800 0x7f117c0cbb50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 >> 172.21.15.81:0/3374583893 conn(0x7f117c0b7330 msgr2=0x7f117c15fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 shutdown_connections 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.107+0000 7f1181958640 1 -- 172.21.15.81:0/3374583893 wait complete. 2024-09-21T06:46:33.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.234+0000 7f2f0b371640 1 -- 172.21.15.81:0/2343633446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 msgr2=0x7f2f0415a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.234+0000 7f2f0b371640 1 --2- 172.21.15.81:0/2343633446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f0415a290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009900 tx=0x7f2ef402a610 comp rx=0 tx=0).stop 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.234+0000 7f2f0b371640 1 -- 172.21.15.81:0/2343633446 shutdown_connections 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.234+0000 7f2f0b371640 1 --2- 172.21.15.81:0/2343633446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f0415a290 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.234+0000 7f2f0b371640 1 -- 172.21.15.81:0/2343633446 >> 172.21.15.81:0/2343633446 conn(0x7f2f040d25e0 msgr2=0x7f2f040d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.234+0000 7f2f0b371640 1 -- 172.21.15.81:0/2343633446 shutdown_connections 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.234+0000 7f2f0b371640 1 -- 172.21.15.81:0/2343633446 wait complete. 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.236+0000 7f2f0b371640 1 Processor -- start 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.236+0000 7f2f0b371640 1 -- start start 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0b371640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f040b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0b371640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0415d2c0 0x7f2f041f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0b371640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f041601c0 0x7f2f040c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0b371640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0415d6d0 con 0x7f2f040d19a0 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0b371640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2f04073660 con 0x7f2f041601c0 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0b371640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0415d850 con 0x7f2f0415d2c0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f040b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f040b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35114/0 (socket says 172.21.15.81:35114) 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 -- 172.21.15.81:0/3303375474 learned_addr learned my addr 172.21.15.81:0/3303375474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0890c640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0415d2c0 0x7f2f041f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0990e640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f041601c0 0x7f2f040c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 -- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0415d2c0 msgr2=0x7f2f041f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0415d2c0 0x7f2f041f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 -- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f041601c0 msgr2=0x7f2f040c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f041601c0 0x7f2f040c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 -- 172.21.15.81:0/3303375474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f040c65e0 con 0x7f2f040d19a0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2f0910d640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f040b7470 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009230 tx=0x7f2ef40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.237+0000 7f2ef9ffb640 1 -- 172.21.15.81:0/3303375474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef403e030 con 0x7f2f040d19a0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.238+0000 7f2ef9ffb640 1 -- 172.21.15.81:0/3303375474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef4003ca0 con 0x7f2f040d19a0 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.238+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f040c68c0 con 0x7f2f040d19a0 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.238+0000 7f2ef9ffb640 1 -- 172.21.15.81:0/3303375474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4035040 con 0x7f2f040d19a0 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.238+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f040b79b0 con 0x7f2f040d19a0 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.239+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f0415a290 con 0x7f2f040d19a0 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.240+0000 7f2ef9ffb640 1 -- 172.21.15.81:0/3303375474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ef4041030 con 0x7f2f040d19a0 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.240+0000 7f2ef9ffb640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ee8078bc0 0x7f2ee807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.240+0000 7f2ef9ffb640 1 -- 172.21.15.81:0/3303375474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f2ef40bb210 con 0x7f2f040d19a0 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.240+0000 7f2f0890c640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ee8078bc0 0x7f2ee807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.241+0000 7f2f0890c640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ee8078bc0 0x7f2ee807b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f00007fd0 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.244+0000 7f2ef9ffb640 1 -- 172.21.15.81:0/3303375474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2ef4083850 con 0x7f2f040d19a0 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.424+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2f040d1530 con 0x7f2f040d19a0 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.427+0000 7f2ef9ffb640 1 -- 172.21.15.81:0/3303375474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f2ef4083150 con 0x7f2f040d19a0 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ee8078bc0 msgr2=0x7f2ee807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ee8078bc0 0x7f2ee807b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f00007fd0 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 msgr2=0x7f2f040b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f040b7470 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009230 tx=0x7f2ef40038a0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 shutdown_connections 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2ee8078bc0 0x7f2ee807b0d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f0415d2c0 0x7f2f041f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f041601c0 0x7f2f040c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 --2- 172.21.15.81:0/3303375474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f040d19a0 0x7f2f040b7470 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 >> 172.21.15.81:0/3303375474 conn(0x7f2f040d25e0 msgr2=0x7f2f04071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 shutdown_connections 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.430+0000 7f2f0b371640 1 -- 172.21.15.81:0/3303375474 wait complete. 2024-09-21T06:46:33.443 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:46:33.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:46:33.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:46:33.537 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:46:33.538 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:33.538 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:33.554 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=10698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:46:33.554 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:46:33.554 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:33.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:46:33.572 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:33.573 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:33.609 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=10698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:46:33.609 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:46:33.609 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:33.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:46:33.630 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T06:46:33.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.761+0000 7f3f1fef2640 1 -- 172.21.15.81:0/1590968661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1815c4c0 msgr2=0x7f3f1815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.761+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/1590968661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1815c4c0 0x7f3f1815c8d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009830 tx=0x7f3f0c02a5c0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.761+0000 7f3f1fef2640 1 -- 172.21.15.81:0/1590968661 shutdown_connections 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.761+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/1590968661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1815c4c0 0x7f3f1815c8d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.761+0000 7f3f1fef2640 1 -- 172.21.15.81:0/1590968661 >> 172.21.15.81:0/1590968661 conn(0x7f3f180740a0 msgr2=0x7f3f180b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.761+0000 7f3f1fef2640 1 -- 172.21.15.81:0/1590968661 shutdown_connections 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.761+0000 7f3f1fef2640 1 -- 172.21.15.81:0/1590968661 wait complete. 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.763+0000 7f3f1fef2640 1 Processor -- start 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.763+0000 7f3f1fef2640 1 -- start start 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1fef2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1806f510 0x7f3f180b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1fef2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f1815c4c0 0x7f3f180d1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1fef2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f181633c0 0x7f3f18163d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1fef2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1815d0f0 con 0x7f3f1806f510 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1fef2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1815cf70 con 0x7f3f181633c0 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1fef2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3f18166f00 con 0x7f3f1815c4c0 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1dc8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1806f510 0x7f3f180b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.764+0000 7f3f1dc8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1806f510 0x7f3f180b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35118/0 (socket says 172.21.15.81:35118) 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1dc8e640 1 -- 172.21.15.81:0/2450391325 learned_addr learned my addr 172.21.15.81:0/2450391325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1d48d640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f1815c4c0 0x7f3f180d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1e48f640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f181633c0 0x7f3f18163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1dc8e640 1 -- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f1815c4c0 msgr2=0x7f3f180d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1dc8e640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f1815c4c0 0x7f3f180d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1dc8e640 1 -- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f181633c0 msgr2=0x7f3f18163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1dc8e640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f181633c0 0x7f3f18163d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1dc8e640 1 -- 172.21.15.81:0/2450391325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f180b1450 con 0x7f3f1806f510 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1dc8e640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1806f510 0x7f3f180b24b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800cbc0 tx=0x7f3f0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f167fc640 1 -- 172.21.15.81:0/2450391325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08016020 con 0x7f3f1806f510 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f167fc640 1 -- 172.21.15.81:0/2450391325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f0800ae30 con 0x7f3f1806f510 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f180b16f0 con 0x7f3f1806f510 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f167fc640 1 -- 172.21.15.81:0/2450391325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08012680 con 0x7f3f1806f510 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.765+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f180b1cb0 con 0x7f3f1806f510 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.766+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1815c8d0 con 0x7f3f1806f510 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.767+0000 7f3f167fc640 1 -- 172.21.15.81:0/2450391325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f08019020 con 0x7f3f1806f510 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.767+0000 7f3f167fc640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3f04078b90 0x7f3f0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.768+0000 7f3f167fc640 1 -- 172.21.15.81:0/2450391325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f3f0809ae40 con 0x7f3f1806f510 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.768+0000 7f3f1d48d640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3f04078b90 0x7f3f0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.768+0000 7f3f1d48d640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3f04078b90 0x7f3f0407b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c034000 tx=0x7f3f0c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.772+0000 7f3f167fc640 1 -- 172.21.15.81:0/2450391325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3f08020030 con 0x7f3f1806f510 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.985+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f1806ee30 con 0x7f3f1806f510 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.985+0000 7f3f167fc640 1 -- 172.21.15.81:0/2450391325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3911 (secure 0 0 0) 0x7f3f08063510 con 0x7f3f1806f510 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"btime":"2024-09-21T06:46:26:763119+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3858608712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3858608712},{"type":"v1","addr":"172.21.15.81:6834","nonce":3858608712}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4870,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1006706970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1006706970},{"type":"v1","addr":"172.21.15.81:6835","nonce":1006706970}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4879,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/1731216103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1731216103},{"type":"v1","addr":"172.21.15.89:6836","nonce":1731216103}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4904,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/2706661449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":2706661449},{"type":"v1","addr":"172.21.15.89:6837","nonce":2706661449}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 20 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3f04078b90 msgr2=0x7f3f0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3f04078b90 0x7f3f0407b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c034000 tx=0x7f3f0c004730 comp rx=0 tx=0).stop 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1806f510 msgr2=0x7f3f180b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1806f510 0x7f3f180b24b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800cbc0 tx=0x7f3f0800a430 comp rx=0 tx=0).stop 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 shutdown_connections 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3f04078b90 0x7f3f0407b0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f1815c4c0 0x7f3f180d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f181633c0 0x7f3f18163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 --2- 172.21.15.81:0/2450391325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f1806f510 0x7f3f180b24b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 >> 172.21.15.81:0/2450391325 conn(0x7f3f180740a0 msgr2=0x7f3f180afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 shutdown_connections 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:33.987+0000 7f3f1fef2640 1 -- 172.21.15.81:0/2450391325 wait complete. 2024-09-21T06:46:34.000 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T06:46:34.000 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T06:46:34.000 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:46:34.001 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T06:46:34.001 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T06:46:34.001 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:46:34.001 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T06:46:34.001 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T06:46:34.001 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:46:34.002 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T06:46:34.002 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T06:46:34.002 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:46:34.010 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:46:34.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T06:46:34.011 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:46:34.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T06:46:34.014 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:46:34.015 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T06:46:34.016 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:46:34.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T06:46:34.053 INFO:tasks.ceph.mds.a:Started 2024-09-21T06:46:34.053 DEBUG:teuthology.parallel:result is None 2024-09-21T06:46:34.054 INFO:tasks.ceph.mds.c:Started 2024-09-21T06:46:34.054 DEBUG:teuthology.parallel:result is None 2024-09-21T06:46:34.059 INFO:tasks.ceph.mds.d:Started 2024-09-21T06:46:34.059 DEBUG:teuthology.parallel:result is None 2024-09-21T06:46:34.060 INFO:tasks.ceph.mds.b:Started 2024-09-21T06:46:34.060 DEBUG:teuthology.parallel:result is None 2024-09-21T06:46:34.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T06:46:34.140 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-21T06:46:34.140 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-21T06:46:34.157 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2024-09-21T06:46:34.157 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 -- 172.21.15.81:0/67682230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c06f510 msgr2=0x7fd09c15bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/67682230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c06f510 0x7fd09c15bdb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd09c073340 tx=0x7fd08c02aa30 comp rx=0 tx=0).stop 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 -- 172.21.15.81:0/67682230 shutdown_connections 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/67682230 >> v2:172.21.15.89:3300/0 conn(0x7fd09c06e2f0 0x7fd09c06e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/67682230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd09c15c2f0 0x7fd09c15c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/67682230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c06f510 0x7fd09c15bdb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 -- 172.21.15.81:0/67682230 >> 172.21.15.81:0/67682230 conn(0x7fd09c0740a0 msgr2=0x7fd09c0b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 -- 172.21.15.81:0/67682230 shutdown_connections 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.179+0000 7fd0a12bd640 1 -- 172.21.15.81:0/67682230 wait complete. 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.181+0000 7fd0a12bd640 1 Processor -- start 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.181+0000 7fd0a12bd640 1 -- start start 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.182+0000 7fd0a12bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd09c06e2f0 0x7fd09c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.182+0000 7fd0a12bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd09c06f510 0x7fd09c1f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.182+0000 7fd0a12bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c15c2f0 0x7fd09c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0a12bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c09ad70 con 0x7fd09c15c2f0 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0a12bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c09abf0 con 0x7fd09c06e2f0 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0a12bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c15cf70 con 0x7fd09c06f510 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c15c2f0 0x7fd09c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c15c2f0 0x7fd09c156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35168/0 (socket says 172.21.15.81:35168) 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 -- 172.21.15.81:0/822828022 learned_addr learned my addr 172.21.15.81:0/822828022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd09c06e2f0 0x7fd09c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09a7fc640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd09c06f510 0x7fd09c1f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 -- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd09c06f510 msgr2=0x7fd09c1f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd09c06f510 0x7fd09c1f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 -- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd09c06e2f0 msgr2=0x7fd09c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd09c06e2f0 0x7fd09c159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 -- 172.21.15.81:0/822828022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c1f3300 con 0x7fd09c15c2f0 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09affd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd09c06e2f0 0x7fd09c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd09b7fe640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c15c2f0 0x7fd09c156f10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd0940099d0 tx=0x7fd094009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0837fe640 1 -- 172.21.15.81:0/822828022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09400b9d0 con 0x7fd09c15c2f0 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0837fe640 1 -- 172.21.15.81:0/822828022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd09400bb70 con 0x7fd09c15c2f0 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c156470 con 0x7fd09c15c2f0 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0837fe640 1 -- 172.21.15.81:0/822828022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094005020 con 0x7fd09c15c2f0 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.183+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c0b1fd0 con 0x7fd09c15c2f0 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.185+0000 7fd0837fe640 1 -- 172.21.15.81:0/822828022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0940051c0 con 0x7fd09c15c2f0 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.185+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd09c15bdb0 con 0x7fd09c15c2f0 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.186+0000 7fd0837fe640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd088078b90 0x7fd08807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.186+0000 7fd0837fe640 1 -- 172.21.15.81:0/822828022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fd09409c950 con 0x7fd09c15c2f0 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.186+0000 7fd09affd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd088078b90 0x7fd08807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.186+0000 7fd09affd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd088078b90 0x7fd08807b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd08c035000 tx=0x7fd08c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.190+0000 7fd0837fe640 1 -- 172.21.15.81:0/822828022 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd09c1f3300 con 0x7fd09c15c2f0 2024-09-21T06:46:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.377+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd09c151cb0 con 0x7fd09c15c2f0 2024-09-21T06:46:34.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.795+0000 7fd0837fe640 1 -- 172.21.15.81:0/822828022 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) ==== 97+0+0 (secure 0 0 0) 0x7fd0940648b0 con 0x7fd09c15c2f0 2024-09-21T06:46:34.796 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd088078b90 msgr2=0x7fd08807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd088078b90 0x7fd08807b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd08c035000 tx=0x7fd08c03b040 comp rx=0 tx=0).stop 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c15c2f0 msgr2=0x7fd09c156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c15c2f0 0x7fd09c156f10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd0940099d0 tx=0x7fd094009e90 comp rx=0 tx=0).stop 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 shutdown_connections 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd088078b90 0x7fd08807b0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd09c06f510 0x7fd09c1f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd09c15c2f0 0x7fd09c156f10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 --2- 172.21.15.81:0/822828022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd09c06e2f0 0x7fd09c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 >> 172.21.15.81:0/822828022 conn(0x7fd09c0740a0 msgr2=0x7fd09c0b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 shutdown_connections 2024-09-21T06:46:34.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.797+0000 7fd0a12bd640 1 -- 172.21.15.81:0/822828022 wait complete. 2024-09-21T06:46:34.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 -- 172.21.15.81:0/1826217233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b641601c0 msgr2=0x7f5b640b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 --2- 172.21.15.81:0/1826217233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b641601c0 0x7f5b640b1b90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009860 tx=0x7f5b4c02a540 comp rx=0 tx=0).stop 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 -- 172.21.15.81:0/1826217233 shutdown_connections 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 --2- 172.21.15.81:0/1826217233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b641601c0 0x7f5b640b1b90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 --2- 172.21.15.81:0/1826217233 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b640d19a0 0x7f5b6415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 -- 172.21.15.81:0/1826217233 >> 172.21.15.81:0/1826217233 conn(0x7f5b640d25e0 msgr2=0x7f5b640d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 -- 172.21.15.81:0/1826217233 shutdown_connections 2024-09-21T06:46:34.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.922+0000 7f5b69069640 1 -- 172.21.15.81:0/1826217233 wait complete. 2024-09-21T06:46:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.924+0000 7f5b69069640 1 Processor -- start 2024-09-21T06:46:34.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.924+0000 7f5b69069640 1 -- start start 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b640b20d0 0x7f5b640c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b640d19a0 0x7f5b640c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b641601c0 0x7f5b640cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b64072ec0 con 0x7f5b640d19a0 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f5b64072d40 con 0x7f5b640b20d0 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f5b64073040 con 0x7f5b641601c0 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b640d19a0 0x7f5b640c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b640d19a0 0x7f5b640c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35190/0 (socket says 172.21.15.81:35190) 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 -- 172.21.15.81:0/441211552 learned_addr learned my addr 172.21.15.81:0/441211552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b62d9d640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b640b20d0 0x7f5b640c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b6359e640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b641601c0 0x7f5b640cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 -- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b641601c0 msgr2=0x7f5b640cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b641601c0 0x7f5b640cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 -- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b640b20d0 msgr2=0x7f5b640c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b640b20d0 0x7f5b640c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 -- 172.21.15.81:0/441211552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b640c5d90 con 0x7f5b640d19a0 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5bfff640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b640d19a0 0x7f5b640c9270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009980 tx=0x7f5b4c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5b7fe640 1 -- 172.21.15.81:0/441211552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c031d60 con 0x7f5b640d19a0 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5b7fe640 1 -- 172.21.15.81:0/441211552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b4c033e10 con 0x7f5b640d19a0 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b640c6070 con 0x7f5b640d19a0 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b5b7fe640 1 -- 172.21.15.81:0/441211552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c005260 con 0x7f5b640d19a0 2024-09-21T06:46:34.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.926+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b640c6630 con 0x7f5b640d19a0 2024-09-21T06:46:34.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.927+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b64073530 con 0x7f5b640d19a0 2024-09-21T06:46:34.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.928+0000 7f5b5b7fe640 1 -- 172.21.15.81:0/441211552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b4c005400 con 0x7f5b640d19a0 2024-09-21T06:46:34.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.929+0000 7f5b5b7fe640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b44078b90 0x7f5b4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.929+0000 7f5b5b7fe640 1 -- 172.21.15.81:0/441211552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5249+0+0 (secure 0 0 0) 0x7f5b4c0bbd70 con 0x7f5b640d19a0 2024-09-21T06:46:34.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.929+0000 7f5b62d9d640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b44078b90 0x7f5b4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.929+0000 7f5b62d9d640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b44078b90 0x7f5b4407b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400bb50 tx=0x7f5b5400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:34.933+0000 7f5b5b7fe640 1 -- 172.21.15.81:0/441211552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5b4c03f030 con 0x7f5b640d19a0 2024-09-21T06:46:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.177+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5b640c7d10 con 0x7f5b640d19a0 2024-09-21T06:46:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.177+0000 7f5b5b7fe640 1 -- 172.21.15.81:0/441211552 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v36) ==== 80+0+5298 (secure 0 0 0) 0x7f5b4c005d00 con 0x7f5b640d19a0 2024-09-21T06:46:35.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mUzW5KhAAlWe3DNGFhoHzcZKVslgilw==", 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.179 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mrJ6iNxAAYlPzreZVfOBq8uNON7qX6A==", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mb9hZMhAAHLZ7d0T548EPhF3/h33DeA==", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.180 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5mRC+TAxAAZBxHrZ/8fkiTV5/jI/qPig==", 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA3a+5m2fjqHRAAP178PuV9yiw9cbo7/1OoVg==", 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA6a+5mIe4HIRAAPkD3C92LH25iaPoKrs66uQ==", 2024-09-21T06:46:35.182 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA9a+5meEnSMRAAf4QZAj2WcogUBB1Y8efOtQ==", 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBBa+5m93HXFRAAAJCY+KY0MQuETBmI44+aNw==", 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBIa+5mo5JTDxAAHWKo3EJWBUAbC8e4WHWQgw==", 2024-09-21T06:46:35.184 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBLa+5mNKVNEhAAdCjnmKVY9GyFjHe+EPqc1Q==", 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBOa+5mdT3YMhAAr7AtNX9uM2SjgIbXyNJvtg==", 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQBRa+5mqwVtNRAA2qzg3e3lxipuLSGdwaDlAQ==", 2024-09-21T06:46:35.186 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg==", 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5mA3XZDxAA2aiJXqyvv25Mz518UE+Efg==", 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-21T06:46:35.188 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5mniEcDBAAKVy0qqJUGtHC9okai+CUlQ==", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQA0a+5m3tqhExAAfa2YN4jeUlT9G43v8YOo4w==", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-21T06:46:35.189 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5m/Q+kDRAA2/OGarZVfV+FnuCEht6dsw==", 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mMvfYJhAAvcvg+BqxohgSrYZxnsWkgw==", 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAza+5mVfC1IhAAasTz1gRrzWOb3hWmXUQmdw==", 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-21T06:46:35.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-21T06:46:35.192 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-21T06:46:35.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-21T06:46:35.192 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:46:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b44078b90 msgr2=0x7f5b4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b44078b90 0x7f5b4407b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400bb50 tx=0x7f5b5400b2e0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b640d19a0 msgr2=0x7f5b640c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b640d19a0 0x7f5b640c9270 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009980 tx=0x7f5b4c033c20 comp rx=0 tx=0).stop 2024-09-21T06:46:35.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 shutdown_connections 2024-09-21T06:46:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f5b44078b90 0x7f5b4407b0a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b641601c0 0x7f5b640cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b640d19a0 0x7f5b640c9270 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 --2- 172.21.15.81:0/441211552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b640b20d0 0x7f5b640c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 >> 172.21.15.81:0/441211552 conn(0x7f5b640d25e0 msgr2=0x7f5b6415c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 shutdown_connections 2024-09-21T06:46:35.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.179+0000 7f5b69069640 1 -- 172.21.15.81:0/441211552 wait complete. 2024-09-21T06:46:35.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T06:46:35.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 -- 172.21.15.81:0/3885448536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 msgr2=0x7f9c100ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 --2- 172.21.15.81:0/3885448536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c100ad290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009830 tx=0x7f9c0402a510 comp rx=0 tx=0).stop 2024-09-21T06:46:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 -- 172.21.15.81:0/3885448536 shutdown_connections 2024-09-21T06:46:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 --2- 172.21.15.81:0/3885448536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c100ad290 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 --2- 172.21.15.81:0/3885448536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c10155a80 0x7f9c1015c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 -- 172.21.15.81:0/3885448536 >> 172.21.15.81:0/3885448536 conn(0x7f9c100b2030 msgr2=0x7f9c100b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 -- 172.21.15.81:0/3885448536 shutdown_connections 2024-09-21T06:46:35.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.305+0000 7f9c17f83640 1 -- 172.21.15.81:0/3885448536 wait complete. 2024-09-21T06:46:35.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.307+0000 7f9c17f83640 1 Processor -- start 2024-09-21T06:46:35.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.307+0000 7f9c17f83640 1 -- start start 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c17f83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c10153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c17f83640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c100ad7d0 0x7f9c100cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c17f83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c10155a80 0x7f9c10147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c17f83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1015f6d0 con 0x7f9c100737a0 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c17f83640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10070300 con 0x7f9c10155a80 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c17f83640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1015f850 con 0x7f9c100ad7d0 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c15d1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c10153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c15d1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c10153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35206/0 (socket says 172.21.15.81:35206) 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c15d1f640 1 -- 172.21.15.81:0/1250738140 learned_addr learned my addr 172.21.15.81:0/1250738140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c1551e640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c100ad7d0 0x7f9c100cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.308+0000 7f9c16520640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c10155a80 0x7f9c10147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c15d1f640 1 -- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c100ad7d0 msgr2=0x7f9c100cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c15d1f640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c100ad7d0 0x7f9c100cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c15d1f640 1 -- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c10155a80 msgr2=0x7f9c10147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c15d1f640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c10155a80 0x7f9c10147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c15d1f640 1 -- 172.21.15.81:0/1250738140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c101f6ad0 con 0x7f9c100737a0 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c15d1f640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c10153340 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000cce0 tx=0x7f9c00007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c0e7fc640 1 -- 172.21.15.81:0/1250738140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00004b20 con 0x7f9c100737a0 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c0e7fc640 1 -- 172.21.15.81:0/1250738140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c00004db0 con 0x7f9c100737a0 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c10150080 con 0x7f9c100737a0 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c0e7fc640 1 -- 172.21.15.81:0/1250738140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00005280 con 0x7f9c100737a0 2024-09-21T06:46:35.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.309+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c101f3ce0 con 0x7f9c100737a0 2024-09-21T06:46:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.310+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1015fd10 con 0x7f9c100737a0 2024-09-21T06:46:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.311+0000 7f9c0e7fc640 1 -- 172.21.15.81:0/1250738140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c00005420 con 0x7f9c100737a0 2024-09-21T06:46:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.312+0000 7f9c0e7fc640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.312+0000 7f9c0e7fc640 1 -- 172.21.15.81:0/1250738140 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5249+0+0 (secure 0 0 0) 0x7f9c0009b2a0 con 0x7f9c100737a0 2024-09-21T06:46:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.312+0000 7f9c1551e640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.312+0000 7f9c1551e640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c04034000 tx=0x7f9c04004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.316+0000 7f9c0e7fc640 1 -- 172.21.15.81:0/1250738140 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9c00014030 con 0x7f9c100737a0 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.494+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9c100b32c0 con 0x7f9c100737a0 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.495+0000 7f9c0e7fc640 1 -- 172.21.15.81:0/1250738140 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) ==== 84+0+65 (secure 0 0 0) 0x7f9c0009b0c0 con 0x7f9c100737a0 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-21T06:46:35.496 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-21T06:46:35.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9bfc078b90 msgr2=0x7f9bfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c04034000 tx=0x7f9c04004730 comp rx=0 tx=0).stop 2024-09-21T06:46:35.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 msgr2=0x7f9c10153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c10153340 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000cce0 tx=0x7f9c00007610 comp rx=0 tx=0).stop 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 shutdown_connections 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9bfc078b90 0x7f9bfc07b0a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c100ad7d0 0x7f9c100cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c10155a80 0x7f9c10147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 --2- 172.21.15.81:0/1250738140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c100737a0 0x7f9c10153340 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 >> 172.21.15.81:0/1250738140 conn(0x7f9c100b2030 msgr2=0x7f9c100b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 shutdown_connections 2024-09-21T06:46:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.497+0000 7f9c17f83640 1 -- 172.21.15.81:0/1250738140 wait complete. 2024-09-21T06:46:35.509 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:46:35.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:46:35.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 -- 172.21.15.81:0/2676879573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0cf2a0 msgr2=0x7fd7cc0d4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2676879573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0cf2a0 0x7fd7cc0d4160 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0a2270 tx=0x7fd7bc02a5f0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 -- 172.21.15.81:0/2676879573 shutdown_connections 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2676879573 >> v2:172.21.15.89:3300/0 conn(0x7fd7cc0b36a0 0x7fd7cc0d46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2676879573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0cf2a0 0x7fd7cc0d4160 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 -- 172.21.15.81:0/2676879573 >> 172.21.15.81:0/2676879573 conn(0x7fd7cc0b9290 msgr2=0x7fd7cc0b96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 -- 172.21.15.81:0/2676879573 shutdown_connections 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.625+0000 7fd7d305c640 1 -- 172.21.15.81:0/2676879573 wait complete. 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.626+0000 7fd7d305c640 1 Processor -- start 2024-09-21T06:46:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.627+0000 7fd7d305c640 1 -- start start 2024-09-21T06:46:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d305c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7cc0b36a0 0x7fd7cc154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d305c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7cc0cf2a0 0x7fd7cc1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d305c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0d25a0 0x7fd7cc1f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d305c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc0b6580 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d305c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc15edd0 con 0x7fd7cc0b36a0 2024-09-21T06:46:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d305c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc0b6700 con 0x7fd7cc0cf2a0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0d25a0 0x7fd7cc1f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0d25a0 0x7fd7cc1f8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35226/0 (socket says 172.21.15.81:35226) 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 -- 172.21.15.81:0/2028793766 learned_addr learned my addr 172.21.15.81:0/2028793766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d0df8640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7cc0b36a0 0x7fd7cc154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7cbfff640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7cc0cf2a0 0x7fd7cc1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 -- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7cc0cf2a0 msgr2=0x7fd7cc1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7cc0cf2a0 0x7fd7cc1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 -- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7cc0b36a0 msgr2=0x7fd7cc154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7cc0b36a0 0x7fd7cc154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 -- 172.21.15.81:0/2028793766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc155b40 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.628+0000 7fd7d15f9640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0d25a0 0x7fd7cc1f8990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c6b0 tx=0x7fd7c400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.629+0000 7fd7c97fa640 1 -- 172.21.15.81:0/2028793766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4003b70 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.629+0000 7fd7c97fa640 1 -- 172.21.15.81:0/2028793766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7c4003d10 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.629+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc154fc0 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.629+0000 7fd7c97fa640 1 -- 172.21.15.81:0/2028793766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4005330 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.629+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc155580 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.630+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc154d30 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.631+0000 7fd7c97fa640 1 -- 172.21.15.81:0/2028793766 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7c40054d0 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.631+0000 7fd7c97fa640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd7b8078bc0 0x7fd7b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.631+0000 7fd7c97fa640 1 -- 172.21.15.81:0/2028793766 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5249+0+0 (secure 0 0 0) 0x7fd7c409a850 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.631+0000 7fd7d0df8640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd7b8078bc0 0x7fd7b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.632+0000 7fd7d0df8640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd7b8078bc0 0x7fd7b807b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc033000 tx=0x7fd7bc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.636+0000 7fd7c97fa640 1 -- 172.21.15.81:0/2028793766 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd7c4062ef0 con 0x7fd7cc0d25a0 2024-09-21T06:46:35.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:35.817+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd7cc15bb50 con 0x7fd7cc0d25a0 2024-09-21T06:46:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.802+0000 7fd7c97fa640 1 -- 172.21.15.81:0/2028793766 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v50) ==== 138+0+0 (secure 0 0 0) 0x7fd7c40627f0 con 0x7fd7cc0d25a0 2024-09-21T06:46:36.804 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-21T06:46:36.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.806+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd7b8078bc0 msgr2=0x7fd7b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:36.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.806+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd7b8078bc0 0x7fd7b807b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc033000 tx=0x7fd7bc004730 comp rx=0 tx=0).stop 2024-09-21T06:46:36.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.806+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0d25a0 msgr2=0x7fd7cc1f8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:36.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.806+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0d25a0 0x7fd7cc1f8990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c6b0 tx=0x7fd7c400cb70 comp rx=0 tx=0).stop 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.806+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 shutdown_connections 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.806+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd7b8078bc0 0x7fd7b807b0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.807+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7cc0cf2a0 0x7fd7cc1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.807+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7cc0d25a0 0x7fd7cc1f8990 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.807+0000 7fd7d305c640 1 --2- 172.21.15.81:0/2028793766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7cc0b36a0 0x7fd7cc154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.807+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 >> 172.21.15.81:0/2028793766 conn(0x7fd7cc0b9290 msgr2=0x7fd7cc15a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.807+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 shutdown_connections 2024-09-21T06:46:36.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.807+0000 7fd7d305c640 1 -- 172.21.15.81:0/2028793766 wait complete. 2024-09-21T06:46:36.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:46:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.951+0000 7f24a2c27640 1 -- 172.21.15.81:0/1591995629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484003a50 msgr2=0x7f2484003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.951+0000 7f24a2c27640 1 --2- 172.21.15.81:0/1591995629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484003a50 0x7f2484003ec0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2498009b50 tx=0x7f2484005830 comp rx=0 tx=0).stop 2024-09-21T06:46:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.951+0000 7f24a2c27640 1 -- 172.21.15.81:0/1591995629 shutdown_connections 2024-09-21T06:46:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.951+0000 7f24a2c27640 1 --2- 172.21.15.81:0/1591995629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2484003a50 0x7f2484003ec0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.951+0000 7f24a2c27640 1 -- 172.21.15.81:0/1591995629 >> 172.21.15.81:0/1591995629 conn(0x7f249c0d25e0 msgr2=0x7f249c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.951+0000 7f24a2c27640 1 -- 172.21.15.81:0/1591995629 shutdown_connections 2024-09-21T06:46:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.951+0000 7f24a2c27640 1 -- 172.21.15.81:0/1591995629 wait complete. 2024-09-21T06:46:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.953+0000 7f24a2c27640 1 Processor -- start 2024-09-21T06:46:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.953+0000 7f24a2c27640 1 -- start start 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a2c27640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2484003a50 0x7f249c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a2c27640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f249c1f32d0 0x7f249c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a2c27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f249c0b7430 0x7f249c0b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a2c27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f249c15d6d0 con 0x7f249c0b7430 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a2c27640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f249c15a610 con 0x7f2484003a50 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a2c27640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f249c15d850 con 0x7f249c1f32d0 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a11c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f249c0b7430 0x7f249c0b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a11c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f249c0b7430 0x7f249c0b7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35242/0 (socket says 172.21.15.81:35242) 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a11c4640 1 -- 172.21.15.81:0/3447044272 learned_addr learned my addr 172.21.15.81:0/3447044272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f24a09c3640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2484003a50 0x7f249c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.954+0000 7f2493fff640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f249c1f32d0 0x7f249c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a11c4640 1 -- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f249c1f32d0 msgr2=0x7f249c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a11c4640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f249c1f32d0 0x7f249c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a11c4640 1 -- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2484003a50 msgr2=0x7f249c0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a11c4640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2484003a50 0x7f249c0c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a11c4640 1 -- 172.21.15.81:0/3447044272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c0b7d80 con 0x7f249c0b7430 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a11c4640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f249c0b7430 0x7f249c0b7840 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f249c074db0 tx=0x7f24940019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24917fa640 1 -- 172.21.15.81:0/3447044272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494011870 con 0x7f249c0b7430 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24917fa640 1 -- 172.21.15.81:0/3447044272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2494017070 con 0x7f249c0b7430 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c1f3ab0 con 0x7f249c0b7430 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24917fa640 1 -- 172.21.15.81:0/3447044272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494011da0 con 0x7f249c0b7430 2024-09-21T06:46:36.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.955+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c1f4070 con 0x7f249c0b7430 2024-09-21T06:46:36.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.956+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c0b1c70 con 0x7f249c0b7430 2024-09-21T06:46:36.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.957+0000 7f24917fa640 1 -- 172.21.15.81:0/3447044272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f249401c460 con 0x7f249c0b7430 2024-09-21T06:46:36.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.957+0000 7f24917fa640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2488078b90 0x7f248807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.957+0000 7f24917fa640 1 -- 172.21.15.81:0/3447044272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5619+0+0 (secure 0 0 0) 0x7f249409b380 con 0x7f249c0b7430 2024-09-21T06:46:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.958+0000 7f24a09c3640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2488078b90 0x7f248807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:36.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.958+0000 7f24a09c3640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2488078b90 0x7f248807b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2498035000 tx=0x7f24980046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:36.962+0000 7f24917fa640 1 -- 172.21.15.81:0/3447044272 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f249c0b7d80 con 0x7f249c0b7430 2024-09-21T06:46:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.139+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f249c1f3840 con 0x7f249c0b7430 2024-09-21T06:46:37.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.805+0000 7f24917fa640 1 -- 172.21.15.81:0/3447044272 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v51) ==== 170+0+0 (secure 0 0 0) 0x7f24940638a0 con 0x7f249c0b7430 2024-09-21T06:46:37.806 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-21T06:46:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2488078b90 msgr2=0x7f248807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2488078b90 0x7f248807b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2498035000 tx=0x7f24980046c0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f249c0b7430 msgr2=0x7f249c0b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f249c0b7430 0x7f249c0b7840 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f249c074db0 tx=0x7f24940019b0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 shutdown_connections 2024-09-21T06:46:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2488078b90 0x7f248807b0a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f249c1f32d0 0x7f249c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f249c0b7430 0x7f249c0b7840 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 --2- 172.21.15.81:0/3447044272 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2484003a50 0x7f249c0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 >> 172.21.15.81:0/3447044272 conn(0x7f249c0d25e0 msgr2=0x7f249c15bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 shutdown_connections 2024-09-21T06:46:37.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.808+0000 7f24a2c27640 1 -- 172.21.15.81:0/3447044272 wait complete. 2024-09-21T06:46:37.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 -- 172.21.15.81:0/3913082657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 msgr2=0x7f068c15e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 --2- 172.21.15.81:0/3913082657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c15e4c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f068c0d1030 tx=0x7f068402a9e0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 -- 172.21.15.81:0/3913082657 shutdown_connections 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 --2- 172.21.15.81:0/3913082657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c15e4c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 --2- 172.21.15.81:0/3913082657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f068c0d1a50 0x7f068c15d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 -- 172.21.15.81:0/3913082657 >> 172.21.15.81:0/3913082657 conn(0x7f068c0b4210 msgr2=0x7f068c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 -- 172.21.15.81:0/3913082657 shutdown_connections 2024-09-21T06:46:37.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.946+0000 7f0692369640 1 -- 172.21.15.81:0/3913082657 wait complete. 2024-09-21T06:46:37.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.948+0000 7f0692369640 1 Processor -- start 2024-09-21T06:46:37.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.948+0000 7f0692369640 1 -- start start 2024-09-21T06:46:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.949+0000 7f0692369640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f068c0cfda0 0x7f068c0b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.949+0000 7f0692369640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.949+0000 7f0692369640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f068c0b6fe0 0x7f068c1503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.949+0000 7f0692369640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f068c15ed90 con 0x7f068c15e0b0 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.949+0000 7f0692369640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f068c15ec10 con 0x7f068c0cfda0 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.949+0000 7f0692369640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f068c15ef10 con 0x7f068c0b6fe0 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c0c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35262/0 (socket says 172.21.15.81:35262) 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 -- 172.21.15.81:0/723829185 learned_addr learned my addr 172.21.15.81:0/723829185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f0690906640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f068c0b6fe0 0x7f068c1503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068bfff640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f068c0cfda0 0x7f068c0b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 -- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f068c0b6fe0 msgr2=0x7f068c1503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f068c0b6fe0 0x7f068c1503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 -- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f068c0cfda0 msgr2=0x7f068c0b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f068c0cfda0 0x7f068c0b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 -- 172.21.15.81:0/723829185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c152490 con 0x7f068c15e0b0 2024-09-21T06:46:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f068b7fe640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c0c9b70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f068000c7a0 tx=0x7f068000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f0688ff9640 1 -- 172.21.15.81:0/723829185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680007bb0 con 0x7f068c15e0b0 2024-09-21T06:46:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f0688ff9640 1 -- 172.21.15.81:0/723829185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0680005020 con 0x7f068c15e0b0 2024-09-21T06:46:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f0688ff9640 1 -- 172.21.15.81:0/723829185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680007e60 con 0x7f068c15e0b0 2024-09-21T06:46:37.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c0cbca0 con 0x7f068c15e0b0 2024-09-21T06:46:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.950+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c0cc260 con 0x7f068c15e0b0 2024-09-21T06:46:37.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.951+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c0c5ae0 con 0x7f068c15e0b0 2024-09-21T06:46:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.952+0000 7f0688ff9640 1 -- 172.21.15.81:0/723829185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0680005470 con 0x7f068c15e0b0 2024-09-21T06:46:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.953+0000 7f0688ff9640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0678078bc0 0x7f067807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.953+0000 7f0688ff9640 1 -- 172.21.15.81:0/723829185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6001+0+0 (secure 0 0 0) 0x7f068009b550 con 0x7f068c15e0b0 2024-09-21T06:46:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.953+0000 7f068bfff640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0678078bc0 0x7f067807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:37.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.953+0000 7f068bfff640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0678078bc0 0x7f067807b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f067c006fd0 tx=0x7f067c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:37.957+0000 7f0688ff9640 1 -- 172.21.15.81:0/723829185 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0680014030 con 0x7f068c15e0b0 2024-09-21T06:46:38.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.172+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f068c15d310 con 0x7f068c15e0b0 2024-09-21T06:46:38.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.838+0000 7f0688ff9640 1 -- 172.21.15.81:0/723829185 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v23) ==== 172+0+0 (secure 0 0 0) 0x7f0680063380 con 0x7f068c15e0b0 2024-09-21T06:46:38.845 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 8 and data pool 9 2024-09-21T06:46:38.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.849+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0678078bc0 msgr2=0x7f067807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:38.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.849+0000 7f0692369640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0678078bc0 0x7f067807b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f067c006fd0 tx=0x7f067c009060 comp rx=0 tx=0).stop 2024-09-21T06:46:38.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.849+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 msgr2=0x7f068c0c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:38.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.849+0000 7f0692369640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c0c9b70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f068000c7a0 tx=0x7f068000cc60 comp rx=0 tx=0).stop 2024-09-21T06:46:38.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.850+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 shutdown_connections 2024-09-21T06:46:38.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.850+0000 7f0692369640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0678078bc0 0x7f067807b0d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.850+0000 7f0692369640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f068c0b6fe0 0x7f068c1503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.850+0000 7f0692369640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068c15e0b0 0x7f068c0c9b70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.850+0000 7f0692369640 1 --2- 172.21.15.81:0/723829185 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f068c0cfda0 0x7f068c0b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.850+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 >> 172.21.15.81:0/723829185 conn(0x7f068c0b4210 msgr2=0x7f068c0b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:38.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.851+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 shutdown_connections 2024-09-21T06:46:38.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.851+0000 7f0692369640 1 -- 172.21.15.81:0/723829185 wait complete. 2024-09-21T06:46:38.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.982+0000 7f98b10bd640 1 -- 172.21.15.81:0/2285371979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 msgr2=0x7f98ac15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.982+0000 7f98b10bd640 1 --2- 172.21.15.81:0/2285371979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 0x7f98ac15a290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f989c009c10 tx=0x7f989c02a8d0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.982+0000 7f98b10bd640 1 -- 172.21.15.81:0/2285371979 shutdown_connections 2024-09-21T06:46:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.982+0000 7f98b10bd640 1 --2- 172.21.15.81:0/2285371979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 0x7f98ac15a290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.982+0000 7f98b10bd640 1 -- 172.21.15.81:0/2285371979 >> 172.21.15.81:0/2285371979 conn(0x7f98ac0d25e0 msgr2=0x7f98ac0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.982+0000 7f98b10bd640 1 -- 172.21.15.81:0/2285371979 shutdown_connections 2024-09-21T06:46:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.982+0000 7f98b10bd640 1 -- 172.21.15.81:0/2285371979 wait complete. 2024-09-21T06:46:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.984+0000 7f98b10bd640 1 Processor -- start 2024-09-21T06:46:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.984+0000 7f98b10bd640 1 -- start start 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.985+0000 7f98b10bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 0x7f98ac0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.985+0000 7f98b10bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ac15d2c0 0x7f98ac0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.985+0000 7f98b10bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac1601c0 0x7f98ac0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.985+0000 7f98b10bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac15d6d0 con 0x7f98ac1601c0 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.985+0000 7f98b10bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac073660 con 0x7f98ac15d2c0 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.985+0000 7f98b10bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac15d850 con 0x7f98ac0d19a0 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac1601c0 0x7f98ac0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac1601c0 0x7f98ac0b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58226/0 (socket says 172.21.15.81:58226) 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 -- 172.21.15.81:0/416001680 learned_addr learned my addr 172.21.15.81:0/416001680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98aad9d640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 0x7f98ac0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98aa59c640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ac15d2c0 0x7f98ac0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 -- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 msgr2=0x7f98ac0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 0x7f98ac0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 -- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ac15d2c0 msgr2=0x7f98ac0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ac15d2c0 0x7f98ac0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 -- 172.21.15.81:0/416001680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac0b6a60 con 0x7f98ac1601c0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98ab59e640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac1601c0 0x7f98ac0b7110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c3c0 tx=0x7f98a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98937fe640 1 -- 172.21.15.81:0/416001680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011850 con 0x7f98ac1601c0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98937fe640 1 -- 172.21.15.81:0/416001680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98a4017070 con 0x7f98ac1601c0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ac0b59c0 con 0x7f98ac1601c0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98937fe640 1 -- 172.21.15.81:0/416001680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4011d80 con 0x7f98ac1601c0 2024-09-21T06:46:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.986+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ac0b5f80 con 0x7f98ac1601c0 2024-09-21T06:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.987+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ac0b5730 con 0x7f98ac1601c0 2024-09-21T06:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.988+0000 7f98937fe640 1 -- 172.21.15.81:0/416001680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98a401c460 con 0x7f98ac1601c0 2024-09-21T06:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.989+0000 7f98937fe640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9898078b90 0x7f989807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.989+0000 7f98937fe640 1 -- 172.21.15.81:0/416001680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f98a409aad0 con 0x7f98ac1601c0 2024-09-21T06:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.989+0000 7f98aad9d640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9898078b90 0x7f989807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.990+0000 7f98aad9d640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9898078b90 0x7f989807b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f989c034000 tx=0x7f989c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:38.994+0000 7f98937fe640 1 -- 172.21.15.81:0/416001680 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f98a40627c0 con 0x7f98ac1601c0 2024-09-21T06:46:39.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.171+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98ac15a290 con 0x7f98ac1601c0 2024-09-21T06:46:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.172+0000 7f98937fe640 1 -- 172.21.15.81:0/416001680 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+16975 (secure 0 0 0) 0x7f98a40671f0 con 0x7f98ac1601c0 2024-09-21T06:46:39.173 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:39.173 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:38.173542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:35.820919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:37.143302+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:39.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9898078b90 msgr2=0x7f989807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9898078b90 0x7f989807b0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f989c034000 tx=0x7f989c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac1601c0 msgr2=0x7f98ac0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac1601c0 0x7f98ac0b7110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c3c0 tx=0x7f98a400c880 comp rx=0 tx=0).stop 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 shutdown_connections 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9898078b90 0x7f989807b0a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98ac1601c0 0x7f98ac0b7110 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98ac15d2c0 0x7f98ac0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 --2- 172.21.15.81:0/416001680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98ac0d19a0 0x7f98ac0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 >> 172.21.15.81:0/416001680 conn(0x7f98ac0d25e0 msgr2=0x7f98ac0716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 shutdown_connections 2024-09-21T06:46:39.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.174+0000 7f98b10bd640 1 -- 172.21.15.81:0/416001680 wait complete. 2024-09-21T06:46:39.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:39.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 -- 172.21.15.81:0/1671744329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015f100 msgr2=0x7f6b2015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1671744329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015f100 0x7f6b2015f510 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6b200ce470 tx=0x7f6b1002a560 comp rx=0 tx=0).stop 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 -- 172.21.15.81:0/1671744329 shutdown_connections 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1671744329 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b2015bb10 0x7f6b2015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1671744329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015f100 0x7f6b2015f510 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1671744329 >> v2:172.21.15.89:3300/0 conn(0x7f6b20152810 0x7f6b200afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 -- 172.21.15.81:0/1671744329 >> 172.21.15.81:0/1671744329 conn(0x7f6b200cd370 msgr2=0x7f6b200cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 -- 172.21.15.81:0/1671744329 shutdown_connections 2024-09-21T06:46:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.298+0000 7f6b271ad640 1 -- 172.21.15.81:0/1671744329 wait complete. 2024-09-21T06:46:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.300+0000 7f6b271ad640 1 Processor -- start 2024-09-21T06:46:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.300+0000 7f6b271ad640 1 -- start start 2024-09-21T06:46:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b271ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015bb10 0x7f6b20141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b271ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b2015f100 0x7f6b200b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b271ad640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b2014bd40 0x7f6b200b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b271ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2015c5e0 con 0x7f6b2015bb10 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b271ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2015c460 con 0x7f6b2015f100 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b271ad640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2015c760 con 0x7f6b2014bd40 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b24f49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015bb10 0x7f6b20141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b24f49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015bb10 0x7f6b20141290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58250/0 (socket says 172.21.15.81:58250) 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b24f49640 1 -- 172.21.15.81:0/1058963191 learned_addr learned my addr 172.21.15.81:0/1058963191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b2574a640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b2014bd40 0x7f6b200b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.301+0000 7f6b17fff640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b2015f100 0x7f6b200b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b24f49640 1 -- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b2014bd40 msgr2=0x7f6b200b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b24f49640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b2014bd40 0x7f6b200b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b24f49640 1 -- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b2015f100 msgr2=0x7f6b200b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b24f49640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b2015f100 0x7f6b200b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b24f49640 1 -- 172.21.15.81:0/1058963191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b201f24b0 con 0x7f6b2015bb10 2024-09-21T06:46:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b24f49640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015bb10 0x7f6b20141290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00e710 tx=0x7f6b1c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b157fa640 1 -- 172.21.15.81:0/1058963191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c004220 con 0x7f6b2015bb10 2024-09-21T06:46:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b157fa640 1 -- 172.21.15.81:0/1058963191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b1c0043c0 con 0x7f6b2015bb10 2024-09-21T06:46:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b157fa640 1 -- 172.21.15.81:0/1058963191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00cb10 con 0x7f6b2015bb10 2024-09-21T06:46:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b200b39f0 con 0x7f6b2015bb10 2024-09-21T06:46:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.302+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b200b3fb0 con 0x7f6b2015bb10 2024-09-21T06:46:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.303+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b200cec60 con 0x7f6b2015bb10 2024-09-21T06:46:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.304+0000 7f6b157fa640 1 -- 172.21.15.81:0/1058963191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b1c0035f0 con 0x7f6b2015bb10 2024-09-21T06:46:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.304+0000 7f6b157fa640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6b0c078bc0 0x7f6b0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.304+0000 7f6b157fa640 1 -- 172.21.15.81:0/1058963191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7f6b1c09b7c0 con 0x7f6b2015bb10 2024-09-21T06:46:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.305+0000 7f6b17fff640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6b0c078bc0 0x7f6b0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.305+0000 7f6b17fff640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6b0c078bc0 0x7f6b0c07b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6b10033000 tx=0x7f6b10004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.309+0000 7f6b157fa640 1 -- 172.21.15.81:0/1058963191 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6b1c0634b0 con 0x7f6b2015bb10 2024-09-21T06:46:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.485+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b20152810 con 0x7f6b2015bb10 2024-09-21T06:46:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.486+0000 7f6b157fa640 1 -- 172.21.15.81:0/1058963191 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+16975 (secure 0 0 0) 0x7f6b1c067ee0 con 0x7f6b2015bb10 2024-09-21T06:46:39.487 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:38.173542+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:35.820919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:37.143302+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6b0c078bc0 msgr2=0x7f6b0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6b0c078bc0 0x7f6b0c07b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6b10033000 tx=0x7f6b10004730 comp rx=0 tx=0).stop 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015bb10 msgr2=0x7f6b20141290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015bb10 0x7f6b20141290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00e710 tx=0x7f6b1c00ebd0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 shutdown_connections 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6b0c078bc0 0x7f6b0c07b0d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b2014bd40 0x7f6b200b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b2015f100 0x7f6b200b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 --2- 172.21.15.81:0/1058963191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b2015bb10 0x7f6b20141290 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 >> 172.21.15.81:0/1058963191 conn(0x7f6b200cd370 msgr2=0x7f6b2014e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 shutdown_connections 2024-09-21T06:46:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.488+0000 7f6b271ad640 1 -- 172.21.15.81:0/1058963191 wait complete. 2024-09-21T06:46:39.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:46:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 -- 172.21.15.81:0/4124500182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc680d3220 msgr2=0x7fcc680b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/4124500182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc680d3220 0x7fcc680b96c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcc680ceac0 tx=0x7fcc5c02a4a0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 -- 172.21.15.81:0/4124500182 shutdown_connections 2024-09-21T06:46:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/4124500182 >> v2:172.21.15.89:3300/0 conn(0x7fcc680b9c00 0x7fcc680d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/4124500182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc680d3220 0x7fcc680b96c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 -- 172.21.15.81:0/4124500182 >> 172.21.15.81:0/4124500182 conn(0x7fcc680b7330 msgr2=0x7fcc680b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 -- 172.21.15.81:0/4124500182 shutdown_connections 2024-09-21T06:46:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.616+0000 7fcc6d8de640 1 -- 172.21.15.81:0/4124500182 wait complete. 2024-09-21T06:46:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.618+0000 7fcc6d8de640 1 Processor -- start 2024-09-21T06:46:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.618+0000 7fcc6d8de640 1 -- start start 2024-09-21T06:46:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc6d8de640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc680b9c00 0x7fcc6814a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc6d8de640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc680d3220 0x7fcc681f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc6d8de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6815c450 0x7fcc680d0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc6d8de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc680b35c0 con 0x7fcc6815c450 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc6d8de640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcc680b3440 con 0x7fcc680d3220 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc6d8de640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fcc680b3740 con 0x7fcc680b9c00 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6815c450 0x7fcc680d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6815c450 0x7fcc680d0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58264/0 (socket says 172.21.15.81:58264) 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 -- 172.21.15.81:0/3536405687 learned_addr learned my addr 172.21.15.81:0/3536405687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc66ffd640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc680b9c00 0x7fcc6814a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc667fc640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc680d3220 0x7fcc681f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 -- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc680b9c00 msgr2=0x7fcc6814a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc680b9c00 0x7fcc6814a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 -- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc680d3220 msgr2=0x7fcc681f8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc680d3220 0x7fcc681f8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.619+0000 7fcc677fe640 1 -- 172.21.15.81:0/3536405687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc68156080 con 0x7fcc6815c450 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.620+0000 7fcc677fe640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6815c450 0x7fcc680d0890 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000cad0 tx=0x7fcc6000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.620+0000 7fcc4ffff640 1 -- 172.21.15.81:0/3536405687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000ae20 con 0x7fcc6815c450 2024-09-21T06:46:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.620+0000 7fcc4ffff640 1 -- 172.21.15.81:0/3536405687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc6000f450 con 0x7fcc6815c450 2024-09-21T06:46:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.620+0000 7fcc4ffff640 1 -- 172.21.15.81:0/3536405687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000f8c0 con 0x7fcc6815c450 2024-09-21T06:46:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.620+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc681f9720 con 0x7fcc6815c450 2024-09-21T06:46:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.620+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc680cca90 con 0x7fcc6815c450 2024-09-21T06:46:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.621+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc681f9490 con 0x7fcc6815c450 2024-09-21T06:46:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.621+0000 7fcc4ffff640 1 -- 172.21.15.81:0/3536405687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc6000fa60 con 0x7fcc6815c450 2024-09-21T06:46:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.622+0000 7fcc4ffff640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.622+0000 7fcc4ffff640 1 -- 172.21.15.81:0/3536405687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6101+0+0 (secure 0 0 0) 0x7fcc6009ba90 con 0x7fcc6815c450 2024-09-21T06:46:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.622+0000 7fcc66ffd640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.623+0000 7fcc66ffd640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc54078b90 0x7fcc5407b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcc6808c9c0 tx=0x7fcc58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.626+0000 7fcc4ffff640 1 -- 172.21.15.81:0/3536405687 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc60014030 con 0x7fcc6815c450 2024-09-21T06:46:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:39.841+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcc680d41a0 con 0x7fcc6815c450 2024-09-21T06:46:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.838+0000 7fcc4ffff640 1 -- 172.21.15.81:0/3536405687 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7fcc60063cc0 con 0x7fcc6815c450 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc54078b90 msgr2=0x7fcc5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc54078b90 0x7fcc5407b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcc6808c9c0 tx=0x7fcc58009040 comp rx=0 tx=0).stop 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6815c450 msgr2=0x7fcc680d0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6815c450 0x7fcc680d0890 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000cad0 tx=0x7fcc6000cf90 comp rx=0 tx=0).stop 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 shutdown_connections 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcc54078b90 0x7fcc5407b0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6815c450 0x7fcc680d0890 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc680d3220 0x7fcc681f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 --2- 172.21.15.81:0/3536405687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc680b9c00 0x7fcc6814a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.842+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 >> 172.21.15.81:0/3536405687 conn(0x7fcc680b7330 msgr2=0x7fcc6815dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:40.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.843+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 shutdown_connections 2024-09-21T06:46:40.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.843+0000 7fcc6d8de640 1 -- 172.21.15.81:0/3536405687 wait complete. 2024-09-21T06:46:40.857 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T06:46:40.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T06:46:40.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.978+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3397002961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 msgr2=0x7fb4b80b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:40.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.978+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3397002961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80b96c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80b93b0 tx=0x7fb4a802a510 comp rx=0 tx=0).stop 2024-09-21T06:46:40.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.978+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3397002961 shutdown_connections 2024-09-21T06:46:40.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.978+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3397002961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80b96c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:40.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.978+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3397002961 >> 172.21.15.81:0/3397002961 conn(0x7fb4b80b7330 msgr2=0x7fb4b80b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:40.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.978+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3397002961 shutdown_connections 2024-09-21T06:46:40.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.978+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3397002961 wait complete. 2024-09-21T06:46:40.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.980+0000 7fb4bf5c3640 1 Processor -- start 2024-09-21T06:46:40.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.980+0000 7fb4bf5c3640 1 -- start start 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bf5c3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4b80b9c00 0x7fb4b80b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bf5c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bf5c3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b815c450 0x7fb4b80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bf5c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b80b36a0 con 0x7fb4b80d3220 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bf5c3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b80b3520 con 0x7fb4b80b9c00 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bf5c3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b80b3820 con 0x7fb4b815c450 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bcb5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.981+0000 7fb4bcb5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58280/0 (socket says 172.21.15.81:58280) 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bcb5e640 1 -- 172.21.15.81:0/3911567605 learned_addr learned my addr 172.21.15.81:0/3911567605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bd35f640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4b80b9c00 0x7fb4b80b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bdb60640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b815c450 0x7fb4b80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bcb5e640 1 -- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b815c450 msgr2=0x7fb4b80cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bcb5e640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b815c450 0x7fb4b80cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bcb5e640 1 -- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4b80b9c00 msgr2=0x7fb4b80b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bcb5e640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4b80b9c00 0x7fb4b80b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bcb5e640 1 -- 172.21.15.81:0/3911567605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b80cdd00 con 0x7fb4b80d3220 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bdb60640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b815c450 0x7fb4b80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bcb5e640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80cccf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009780 tx=0x7fb4a8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4adffb640 1 -- 172.21.15.81:0/3911567605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8031d60 con 0x7fb4b80d3220 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4adffb640 1 -- 172.21.15.81:0/3911567605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4a8005020 con 0x7fb4b80d3220 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b80cdfe0 con 0x7fb4b80d3220 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.982+0000 7fb4adffb640 1 -- 172.21.15.81:0/3911567605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8005470 con 0x7fb4b80d3220 2024-09-21T06:46:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.983+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b80b4340 con 0x7fb4b80d3220 2024-09-21T06:46:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.984+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b808d110 con 0x7fb4b80d3220 2024-09-21T06:46:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.984+0000 7fb4adffb640 1 -- 172.21.15.81:0/3911567605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4a80047a0 con 0x7fb4b80d3220 2024-09-21T06:46:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.985+0000 7fb4adffb640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb49c078b90 0x7fb49c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.985+0000 7fb4adffb640 1 -- 172.21.15.81:0/3911567605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fb4a80bc1d0 con 0x7fb4b80d3220 2024-09-21T06:46:40.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.985+0000 7fb4bd35f640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb49c078b90 0x7fb49c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:40.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.985+0000 7fb4bd35f640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb49c078b90 0x7fb49c07b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4000f60 tx=0x7fb4b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:40.989+0000 7fb4adffb640 1 -- 172.21.15.81:0/3911567605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb4b808d110 con 0x7fb4b80d3220 2024-09-21T06:46:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.202+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb4b80b96c0 con 0x7fb4b80d3220 2024-09-21T06:46:41.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.842+0000 7fb4adffb640 1 -- 172.21.15.81:0/3911567605 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fb4a803f030 con 0x7fb4b80d3220 2024-09-21T06:46:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb49c078b90 msgr2=0x7fb49c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb49c078b90 0x7fb49c07b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4000f60 tx=0x7fb4b4009040 comp rx=0 tx=0).stop 2024-09-21T06:46:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 msgr2=0x7fb4b80cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80cccf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8009780 tx=0x7fb4a8033d60 comp rx=0 tx=0).stop 2024-09-21T06:46:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 shutdown_connections 2024-09-21T06:46:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb49c078b90 0x7fb49c07b0a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb4b815c450 0x7fb4b80cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80d3220 0x7fb4b80cccf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 --2- 172.21.15.81:0/3911567605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb4b80b9c00 0x7fb4b80b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 >> 172.21.15.81:0/3911567605 conn(0x7fb4b80b7330 msgr2=0x7fb4b80cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 shutdown_connections 2024-09-21T06:46:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.845+0000 7fb4bf5c3640 1 -- 172.21.15.81:0/3911567605 wait complete. 2024-09-21T06:46:41.859 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T06:46:41.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:41.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 -- 172.21.15.81:0/2411205290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 msgr2=0x7f586c15ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:41.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 --2- 172.21.15.81:0/2411205290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15ca50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f586c072b30 tx=0x7f586402a820 comp rx=0 tx=0).stop 2024-09-21T06:46:41.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 -- 172.21.15.81:0/2411205290 shutdown_connections 2024-09-21T06:46:41.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 --2- 172.21.15.81:0/2411205290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15ca50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 --2- 172.21.15.81:0/2411205290 >> v2:172.21.15.89:3300/0 conn(0x7f586c0ad8b0 0x7f586c06ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 -- 172.21.15.81:0/2411205290 >> 172.21.15.81:0/2411205290 conn(0x7f586c0b2030 msgr2=0x7f586c0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:41.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 -- 172.21.15.81:0/2411205290 shutdown_connections 2024-09-21T06:46:41.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.971+0000 7f587095f640 1 -- 172.21.15.81:0/2411205290 wait complete. 2024-09-21T06:46:41.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.973+0000 7f587095f640 1 Processor -- start 2024-09-21T06:46:41.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.973+0000 7f587095f640 1 -- start start 2024-09-21T06:46:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f587095f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f586c0b4b70 0x7f586c15fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f587095f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f587095f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f586c15bd00 0x7f586c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f587095f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f586c0b3640 con 0x7f586c15c640 2024-09-21T06:46:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f587095f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f586c0b34c0 con 0x7f586c0b4b70 2024-09-21T06:46:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f587095f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f586c0b37c0 con 0x7f586c15bd00 2024-09-21T06:46:41.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f5869d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f5869d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58290/0 (socket says 172.21.15.81:58290) 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.974+0000 7f5869d9b640 1 -- 172.21.15.81:0/3735722345 learned_addr learned my addr 172.21.15.81:0/3735722345 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f586ad9d640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f586c15bd00 0x7f586c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f5869d9b640 1 -- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f586c15bd00 msgr2=0x7f586c154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f5869d9b640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f586c15bd00 0x7f586c154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f5869d9b640 1 -- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f586c0b4b70 msgr2=0x7f586c15fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f586a59c640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f586c0b4b70 0x7f586c15fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f5869d9b640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f586c0b4b70 0x7f586c15fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f5869d9b640 1 -- 172.21.15.81:0/3735722345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c1f2ff0 con 0x7f586c15c640 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f5869d9b640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15b7c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f586000d740 tx=0x7f586000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f585affd640 1 -- 172.21.15.81:0/3735722345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860017070 con 0x7f586c15c640 2024-09-21T06:46:41.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f585affd640 1 -- 172.21.15.81:0/3735722345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5860009d20 con 0x7f586c15c640 2024-09-21T06:46:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586c1f32d0 con 0x7f586c15c640 2024-09-21T06:46:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f585affd640 1 -- 172.21.15.81:0/3735722345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600106c0 con 0x7f586c15c640 2024-09-21T06:46:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.975+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586c1f3890 con 0x7f586c15c640 2024-09-21T06:46:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.976+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586c0b3cf0 con 0x7f586c15c640 2024-09-21T06:46:41.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.977+0000 7f585affd640 1 -- 172.21.15.81:0/3735722345 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f586001a070 con 0x7f586c15c640 2024-09-21T06:46:41.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.977+0000 7f585affd640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f584c078b90 0x7f584c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:41.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.977+0000 7f585affd640 1 -- 172.21.15.81:0/3735722345 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f586009b0a0 con 0x7f586c15c640 2024-09-21T06:46:41.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.977+0000 7f586a59c640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f584c078b90 0x7f584c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:41.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.978+0000 7f586a59c640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f584c078b90 0x7f584c07b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f585c001540 tx=0x7f585c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:41.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:41.982+0000 7f585affd640 1 -- 172.21.15.81:0/3735722345 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5860063350 con 0x7f586c15c640 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.193+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f586c0ada90 con 0x7f586c15c640 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.194+0000 7f585affd640 1 -- 172.21.15.81:0/3735722345 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5220 (secure 0 0 0) 0x7f5860062c50 con 0x7f586c15c640 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T06:46:41:839050+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2835319060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2835319060},{"type":"v1","addr":"172.21.15.89:6836","nonce":2835319060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4230376453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4230376453},{"type":"v1","addr":"172.21.15.89:6837","nonce":4230376453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/325230929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":325230929},{"type":"v1","addr":"172.21.15.81:6834","nonce":325230929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:38.173502+0000","modified":"2024-09-21T06:46:41.202759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5430":{"gid":5430,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1408396045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1408396045},{"type":"v1","addr":"172.21.15.81:6835","nonce":1408396045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5430,"qdb_cluster":[5430]},"id":3}]} 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f584c078b90 msgr2=0x7f584c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f584c078b90 0x7f584c07b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f585c001540 tx=0x7f585c009040 comp rx=0 tx=0).stop 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 msgr2=0x7f586c15b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15b7c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f586000d740 tx=0x7f586000dc00 comp rx=0 tx=0).stop 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 shutdown_connections 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f584c078b90 0x7f584c07b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f586c15bd00 0x7f586c154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c15c640 0x7f586c15b7c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 --2- 172.21.15.81:0/3735722345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f586c0b4b70 0x7f586c15fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 >> 172.21.15.81:0/3735722345 conn(0x7f586c0b2030 msgr2=0x7f586c155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 shutdown_connections 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.196+0000 7f587095f640 1 -- 172.21.15.81:0/3735722345 wait complete. 2024-09-21T06:46:42.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:42.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 -- 172.21.15.81:0/2083029051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 msgr2=0x7f1ca815d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 --2- 172.21.15.81:0/2083029051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 0x7f1ca815d730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80d1030 tx=0x7f1c9802a870 comp rx=0 tx=0).stop 2024-09-21T06:46:42.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 -- 172.21.15.81:0/2083029051 shutdown_connections 2024-09-21T06:46:42.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 --2- 172.21.15.81:0/2083029051 >> v2:172.21.15.89:3300/0 conn(0x7f1ca815e0b0 0x7f1ca815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 --2- 172.21.15.81:0/2083029051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 0x7f1ca815d730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 -- 172.21.15.81:0/2083029051 >> 172.21.15.81:0/2083029051 conn(0x7f1ca80b4210 msgr2=0x7f1ca80b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:42.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 -- 172.21.15.81:0/2083029051 shutdown_connections 2024-09-21T06:46:42.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.321+0000 7f1caedc3640 1 -- 172.21.15.81:0/2083029051 wait complete. 2024-09-21T06:46:42.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.322+0000 7f1caedc3640 1 Processor -- start 2024-09-21T06:46:42.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.323+0000 7f1caedc3640 1 -- start start 2024-09-21T06:46:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1caedc3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 0x7f1ca814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1caedc3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca80d1340 0x7f1ca80c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1caedc3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca815e0b0 0x7f1ca8150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1caedc3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca815ed90 con 0x7f1ca80d1340 2024-09-21T06:46:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1caedc3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca815ec10 con 0x7f1ca815e0b0 2024-09-21T06:46:42.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1caedc3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca815ef10 con 0x7f1ca80cfda0 2024-09-21T06:46:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1ca7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca80d1340 0x7f1ca80c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1ca7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca80d1340 0x7f1ca80c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58294/0 (socket says 172.21.15.81:58294) 2024-09-21T06:46:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1ca7fff640 1 -- 172.21.15.81:0/4103434855 learned_addr learned my addr 172.21.15.81:0/4103434855 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1cacb5f640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 0x7f1ca814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1cad360640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca815e0b0 0x7f1ca8150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1ca7fff640 1 -- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 msgr2=0x7f1ca814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1ca7fff640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 0x7f1ca814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1ca7fff640 1 -- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca815e0b0 msgr2=0x7f1ca8150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.324+0000 7f1ca7fff640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca815e0b0 0x7f1ca8150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.325+0000 7f1ca7fff640 1 -- 172.21.15.81:0/4103434855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca80c6920 con 0x7f1ca80d1340 2024-09-21T06:46:42.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.325+0000 7f1ca7fff640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca80d1340 0x7f1ca80c7e30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c430 tx=0x7f1c9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:42.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.325+0000 7f1ca57fa640 1 -- 172.21.15.81:0/4103434855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90011790 con 0x7f1ca80d1340 2024-09-21T06:46:42.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.325+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca80c6c00 con 0x7f1ca80d1340 2024-09-21T06:46:42.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.325+0000 7f1ca57fa640 1 -- 172.21.15.81:0/4103434855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c90017070 con 0x7f1ca80d1340 2024-09-21T06:46:42.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.325+0000 7f1ca57fa640 1 -- 172.21.15.81:0/4103434855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90011cc0 con 0x7f1ca80d1340 2024-09-21T06:46:42.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.325+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca80c71c0 con 0x7f1ca80d1340 2024-09-21T06:46:42.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.326+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca815d730 con 0x7f1ca80d1340 2024-09-21T06:46:42.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.327+0000 7f1ca57fa640 1 -- 172.21.15.81:0/4103434855 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c9001c460 con 0x7f1ca80d1340 2024-09-21T06:46:42.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.327+0000 7f1ca57fa640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1c88078b90 0x7f1c8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.328+0000 7f1ca57fa640 1 -- 172.21.15.81:0/4103434855 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f1c9009a8d0 con 0x7f1ca80d1340 2024-09-21T06:46:42.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.328+0000 7f1cacb5f640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1c88078b90 0x7f1c8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.328+0000 7f1cacb5f640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1c88078b90 0x7f1c8807b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1c98034000 tx=0x7f1c98004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:42.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.332+0000 7f1ca57fa640 1 -- 172.21.15.81:0/4103434855 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1c90021020 con 0x7f1ca80d1340 2024-09-21T06:46:42.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.509+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ca80c5ae0 con 0x7f1ca80d1340 2024-09-21T06:46:42.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.511+0000 7f1ca57fa640 1 -- 172.21.15.81:0/4103434855 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16962 (secure 0 0 0) 0x7f1c90062600 con 0x7f1ca80d1340 2024-09-21T06:46:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:42.513 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":53,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:39.828773+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:35.820919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:37.143302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1c88078b90 msgr2=0x7f1c8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1c88078b90 0x7f1c8807b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1c98034000 tx=0x7f1c98004ab0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca80d1340 msgr2=0x7f1ca80c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca80d1340 0x7f1ca80c7e30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c430 tx=0x7f1c9000c8f0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 shutdown_connections 2024-09-21T06:46:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1c88078b90 0x7f1c8807b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ca815e0b0 0x7f1ca8150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca80d1340 0x7f1ca80c7e30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 --2- 172.21.15.81:0/4103434855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ca80cfda0 0x7f1ca814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 >> 172.21.15.81:0/4103434855 conn(0x7f1ca80b4210 msgr2=0x7f1ca8160bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 shutdown_connections 2024-09-21T06:46:42.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.513+0000 7f1caedc3640 1 -- 172.21.15.81:0/4103434855 wait complete. 2024-09-21T06:46:42.526 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:46:42.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.636+0000 7f3377e5c640 1 -- 172.21.15.81:0/843629917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 msgr2=0x7f33700d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.636+0000 7f3377e5c640 1 --2- 172.21.15.81:0/843629917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 0x7f33700d3220 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f336c005fd0 tx=0x7f336c02a8b0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.637+0000 7f3377e5c640 1 -- 172.21.15.81:0/843629917 shutdown_connections 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.637+0000 7f3377e5c640 1 --2- 172.21.15.81:0/843629917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f337015eda0 0x7f33700b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.637+0000 7f3377e5c640 1 --2- 172.21.15.81:0/843629917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 0x7f33700d3220 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.637+0000 7f3377e5c640 1 -- 172.21.15.81:0/843629917 >> 172.21.15.81:0/843629917 conn(0x7f33700b7330 msgr2=0x7f33700b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.637+0000 7f3377e5c640 1 -- 172.21.15.81:0/843629917 shutdown_connections 2024-09-21T06:46:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.637+0000 7f3377e5c640 1 -- 172.21.15.81:0/843629917 wait complete. 2024-09-21T06:46:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.638+0000 7f3377e5c640 1 Processor -- start 2024-09-21T06:46:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.638+0000 7f3377e5c640 1 -- start start 2024-09-21T06:46:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3377e5c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33700b9c00 0x7f337015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3377e5c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 0x7f337006d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3377e5c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f337015eda0 0x7f337006dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3377e5c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33700b35c0 con 0x7f33700b9c00 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3377e5c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f33700b3440 con 0x7f337015c450 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3377e5c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f33700b3740 con 0x7f337015eda0 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33700b9c00 0x7f337015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33700b9c00 0x7f337015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58304/0 (socket says 172.21.15.81:58304) 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 -- 172.21.15.81:0/175544317 learned_addr learned my addr 172.21.15.81:0/175544317 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f33753f7640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 0x7f337006d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f33763f9640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f337015eda0 0x7f337006dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 -- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f337015eda0 msgr2=0x7f337006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f337015eda0 0x7f337006dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 -- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 msgr2=0x7f337006d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 0x7f337006d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 -- 172.21.15.81:0/175544317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33701f5c90 con 0x7f33700b9c00 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f33753f7640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 0x7f337006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f33763f9640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f337015eda0 0x7f337006dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f3375bf8640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33700b9c00 0x7f337015a1c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f336c009cd0 tx=0x7f336c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.640+0000 7f33667fc640 1 -- 172.21.15.81:0/175544317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c031990 con 0x7f33700b9c00 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.641+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33701f5f70 con 0x7f33700b9c00 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.641+0000 7f33667fc640 1 -- 172.21.15.81:0/175544317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f336c031c20 con 0x7f33700b9c00 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.641+0000 7f33667fc640 1 -- 172.21.15.81:0/175544317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0330d0 con 0x7f33700b9c00 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.641+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337015aa20 con 0x7f33700b9c00 2024-09-21T06:46:42.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.642+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337008d110 con 0x7f33700b9c00 2024-09-21T06:46:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.642+0000 7f33667fc640 1 -- 172.21.15.81:0/175544317 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f336c033270 con 0x7f33700b9c00 2024-09-21T06:46:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.643+0000 7f33667fc640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3354078bc0 0x7f335407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.643+0000 7f33667fc640 1 -- 172.21.15.81:0/175544317 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f336c0bc040 con 0x7f33700b9c00 2024-09-21T06:46:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.643+0000 7f33753f7640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3354078bc0 0x7f335407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:42.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.644+0000 7f33753f7640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3354078bc0 0x7f335407b0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f337006f490 tx=0x7f3360005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:42.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.647+0000 7f33667fc640 1 -- 172.21.15.81:0/175544317 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f337008d110 con 0x7f33700b9c00 2024-09-21T06:46:42.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.820+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33700d3220 con 0x7f3354078bc0 2024-09-21T06:46:42.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.825+0000 7f33667fc640 1 -- 172.21.15.81:0/175544317 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249067 (secure 0 0 0) 0x7f33700d3220 con 0x7f3354078bc0 2024-09-21T06:46:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:42.833 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:42.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3354078bc0 msgr2=0x7f335407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3354078bc0 0x7f335407b0d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f337006f490 tx=0x7f3360005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33700b9c00 msgr2=0x7f337015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33700b9c00 0x7f337015a1c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f336c009cd0 tx=0x7f336c0316f0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 shutdown_connections 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3354078bc0 0x7f335407b0d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f337015eda0 0x7f337006dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f337015c450 0x7f337006d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 --2- 172.21.15.81:0/175544317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33700b9c00 0x7f337015a1c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 >> 172.21.15.81:0/175544317 conn(0x7f33700b7330 msgr2=0x7f3370160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 shutdown_connections 2024-09-21T06:46:42.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.828+0000 7f3377e5c640 1 -- 172.21.15.81:0/175544317 wait complete. 2024-09-21T06:46:42.841 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-21T06:46:42.673269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592140,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":127,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222116,"kb_used_data":5840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752604,"statfs":{"total":773094113280,"available":772866666496,"internally_reserved":0,"allocated":5980160,"data_stored":3277858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868427"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.819428+0000","last_change":"2024-09-21T06:46:37.819428+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.819428+0000","last_undegraded":"2024-09-21T06:46:37.819428+0000","last_fullsized":"2024-09-21T06:46:37.819428+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815734+0000","last_change":"2024-09-21T06:46:37.815734+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815734+0000","last_undegraded":"2024-09-21T06:46:37.815734+0000","last_fullsized":"2024-09-21T06:46:37.815734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844525+0000","last_change":"2024-09-21T06:46:38.836247+0000","last_active":"2024-09-21T06:46:38.844525+0000","last_peered":"2024-09-21T06:46:38.844525+0000","last_clean":"2024-09-21T06:46:38.844525+0000","last_became_active":"2024-09-21T06:46:38.835897+0000","last_became_peered":"2024-09-21T06:46:38.835897+0000","last_unstale":"2024-09-21T06:46:38.844525+0000","last_undegraded":"2024-09-21T06:46:38.844525+0000","last_fullsized":"2024-09-21T06:46:38.844525+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849825+0000","last_change":"2024-09-21T06:46:38.844482+0000","last_active":"2024-09-21T06:46:38.849825+0000","last_peered":"2024-09-21T06:46:38.849825+0000","last_clean":"2024-09-21T06:46:38.849825+0000","last_became_active":"2024-09-21T06:46:38.844161+0000","last_became_peered":"2024-09-21T06:46:38.844161+0000","last_unstale":"2024-09-21T06:46:38.849825+0000","last_undegraded":"2024-09-21T06:46:38.849825+0000","last_fullsized":"2024-09-21T06:46:38.849825+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:54.933768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.821160+0000","last_change":"2024-09-21T06:46:37.821160+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.821160+0000","last_undegraded":"2024-09-21T06:46:37.821160+0000","last_fullsized":"2024-09-21T06:46:37.821160+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820842+0000","last_change":"2024-09-21T06:46:37.820842+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820842+0000","last_undegraded":"2024-09-21T06:46:37.820842+0000","last_fullsized":"2024-09-21T06:46:37.820842+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849083+0000","last_change":"2024-09-21T06:46:38.837455+0000","last_active":"2024-09-21T06:46:38.849083+0000","last_peered":"2024-09-21T06:46:38.849083+0000","last_clean":"2024-09-21T06:46:38.849083+0000","last_became_active":"2024-09-21T06:46:38.837170+0000","last_became_peered":"2024-09-21T06:46:38.837170+0000","last_unstale":"2024-09-21T06:46:38.849083+0000","last_undegraded":"2024-09-21T06:46:38.849083+0000","last_fullsized":"2024-09-21T06:46:38.849083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:20.986258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820035+0000","last_change":"2024-09-21T06:46:37.820035+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820035+0000","last_undegraded":"2024-09-21T06:46:37.820035+0000","last_fullsized":"2024-09-21T06:46:37.820035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859845+0000","last_change":"2024-09-21T06:46:38.856546+0000","last_active":"2024-09-21T06:46:38.859845+0000","last_peered":"2024-09-21T06:46:38.859845+0000","last_clean":"2024-09-21T06:46:38.859845+0000","last_became_active":"2024-09-21T06:46:38.856240+0000","last_became_peered":"2024-09-21T06:46:38.856240+0000","last_unstale":"2024-09-21T06:46:38.859845+0000","last_undegraded":"2024-09-21T06:46:38.859845+0000","last_fullsized":"2024-09-21T06:46:38.859845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:12.306047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.822086+0000","last_change":"2024-09-21T06:46:37.822086+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.822086+0000","last_undegraded":"2024-09-21T06:46:37.822086+0000","last_fullsized":"2024-09-21T06:46:37.822086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810180+0000","last_change":"2024-09-21T06:46:37.810180+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810180+0000","last_undegraded":"2024-09-21T06:46:37.810180+0000","last_fullsized":"2024-09-21T06:46:37.810180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843454+0000","last_change":"2024-09-21T06:46:38.840765+0000","last_active":"2024-09-21T06:46:38.843454+0000","last_peered":"2024-09-21T06:46:38.843454+0000","last_clean":"2024-09-21T06:46:38.843454+0000","last_became_active":"2024-09-21T06:46:38.840430+0000","last_became_peered":"2024-09-21T06:46:38.840430+0000","last_unstale":"2024-09-21T06:46:38.843454+0000","last_undegraded":"2024-09-21T06:46:38.843454+0000","last_fullsized":"2024-09-21T06:46:38.843454+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851481+0000","last_change":"2024-09-21T06:46:38.844070+0000","last_active":"2024-09-21T06:46:38.851481+0000","last_peered":"2024-09-21T06:46:38.851481+0000","last_clean":"2024-09-21T06:46:38.851481+0000","last_became_active":"2024-09-21T06:46:38.843603+0000","last_became_peered":"2024-09-21T06:46:38.843603+0000","last_unstale":"2024-09-21T06:46:38.851481+0000","last_undegraded":"2024-09-21T06:46:38.851481+0000","last_fullsized":"2024-09-21T06:46:38.851481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:38.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.842407+0000","last_change":"2024-09-21T06:46:38.832845+0000","last_active":"2024-09-21T06:46:38.842407+0000","last_peered":"2024-09-21T06:46:38.842407+0000","last_clean":"2024-09-21T06:46:38.842407+0000","last_became_active":"2024-09-21T06:46:38.832523+0000","last_became_peered":"2024-09-21T06:46:38.832523+0000","last_unstale":"2024-09-21T06:46:38.842407+0000","last_undegraded":"2024-09-21T06:46:38.842407+0000","last_fullsized":"2024-09-21T06:46:38.842407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:27.403557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851351+0000","last_change":"2024-09-21T06:46:38.845822+0000","last_active":"2024-09-21T06:46:38.851351+0000","last_peered":"2024-09-21T06:46:38.851351+0000","last_clean":"2024-09-21T06:46:38.851351+0000","last_became_active":"2024-09-21T06:46:38.845446+0000","last_became_peered":"2024-09-21T06:46:38.845446+0000","last_unstale":"2024-09-21T06:46:38.851351+0000","last_undegraded":"2024-09-21T06:46:38.851351+0000","last_fullsized":"2024-09-21T06:46:38.851351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:56.261429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813254+0000","last_change":"2024-09-21T06:46:37.813254+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813254+0000","last_undegraded":"2024-09-21T06:46:37.813254+0000","last_fullsized":"2024-09-21T06:46:37.813254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815082+0000","last_change":"2024-09-21T06:46:37.815082+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815082+0000","last_undegraded":"2024-09-21T06:46:37.815082+0000","last_fullsized":"2024-09-21T06:46:37.815082+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844151+0000","last_change":"2024-09-21T06:46:38.841494+0000","last_active":"2024-09-21T06:46:38.844151+0000","last_peered":"2024-09-21T06:46:38.844151+0000","last_clean":"2024-09-21T06:46:38.844151+0000","last_became_active":"2024-09-21T06:46:38.841161+0000","last_became_peered":"2024-09-21T06:46:38.841161+0000","last_unstale":"2024-09-21T06:46:38.844151+0000","last_undegraded":"2024-09-21T06:46:38.844151+0000","last_fullsized":"2024-09-21T06:46:38.844151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:47.348432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816299+0000","last_change":"2024-09-21T06:46:37.816299+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816299+0000","last_undegraded":"2024-09-21T06:46:37.816299+0000","last_fullsized":"2024-09-21T06:46:37.816299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809496+0000","last_change":"2024-09-21T06:46:37.809496+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809496+0000","last_undegraded":"2024-09-21T06:46:37.809496+0000","last_fullsized":"2024-09-21T06:46:37.809496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851499+0000","last_change":"2024-09-21T06:46:38.844395+0000","last_active":"2024-09-21T06:46:38.851499+0000","last_peered":"2024-09-21T06:46:38.851499+0000","last_clean":"2024-09-21T06:46:38.851499+0000","last_became_active":"2024-09-21T06:46:38.844030+0000","last_became_peered":"2024-09-21T06:46:38.844030+0000","last_unstale":"2024-09-21T06:46:38.851499+0000","last_undegraded":"2024-09-21T06:46:38.851499+0000","last_fullsized":"2024-09-21T06:46:38.851499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:18.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809041+0000","last_change":"2024-09-21T06:46:37.809041+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809041+0000","last_undegraded":"2024-09-21T06:46:37.809041+0000","last_fullsized":"2024-09-21T06:46:37.809041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849108+0000","last_change":"2024-09-21T06:46:38.838558+0000","last_active":"2024-09-21T06:46:38.849108+0000","last_peered":"2024-09-21T06:46:38.849108+0000","last_clean":"2024-09-21T06:46:38.849108+0000","last_became_active":"2024-09-21T06:46:38.838256+0000","last_became_peered":"2024-09-21T06:46:38.838256+0000","last_unstale":"2024-09-21T06:46:38.849108+0000","last_undegraded":"2024-09-21T06:46:38.849108+0000","last_fullsized":"2024-09-21T06:46:38.849108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:37.987203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859870+0000","last_change":"2024-09-21T06:46:38.856520+0000","last_active":"2024-09-21T06:46:38.859870+0000","last_peered":"2024-09-21T06:46:38.859870+0000","last_clean":"2024-09-21T06:46:38.859870+0000","last_became_active":"2024-09-21T06:46:38.856171+0000","last_became_peered":"2024-09-21T06:46:38.856171+0000","last_unstale":"2024-09-21T06:46:38.859870+0000","last_undegraded":"2024-09-21T06:46:38.859870+0000","last_fullsized":"2024-09-21T06:46:38.859870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815856+0000","last_change":"2024-09-21T06:46:37.815856+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815856+0000","last_undegraded":"2024-09-21T06:46:37.815856+0000","last_fullsized":"2024-09-21T06:46:37.815856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.838885+0000","last_change":"2024-09-21T06:46:38.836327+0000","last_active":"2024-09-21T06:46:38.838885+0000","last_peered":"2024-09-21T06:46:38.838885+0000","last_clean":"2024-09-21T06:46:38.838885+0000","last_became_active":"2024-09-21T06:46:38.836032+0000","last_became_peered":"2024-09-21T06:46:38.836032+0000","last_unstale":"2024-09-21T06:46:38.838885+0000","last_undegraded":"2024-09-21T06:46:38.838885+0000","last_fullsized":"2024-09-21T06:46:38.838885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:46.918012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815262+0000","last_change":"2024-09-21T06:46:37.815262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815262+0000","last_undegraded":"2024-09-21T06:46:37.815262+0000","last_fullsized":"2024-09-21T06:46:37.815262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817360+0000","last_change":"2024-09-21T06:46:37.817360+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817360+0000","last_undegraded":"2024-09-21T06:46:37.817360+0000","last_fullsized":"2024-09-21T06:46:37.817360+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817262+0000","last_change":"2024-09-21T06:46:37.817262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817262+0000","last_undegraded":"2024-09-21T06:46:37.817262+0000","last_fullsized":"2024-09-21T06:46:37.817262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848749+0000","last_change":"2024-09-21T06:46:38.839817+0000","last_active":"2024-09-21T06:46:38.848749+0000","last_peered":"2024-09-21T06:46:38.848749+0000","last_clean":"2024-09-21T06:46:38.848749+0000","last_became_active":"2024-09-21T06:46:38.839497+0000","last_became_peered":"2024-09-21T06:46:38.839497+0000","last_unstale":"2024-09-21T06:46:38.848749+0000","last_undegraded":"2024-09-21T06:46:38.848749+0000","last_fullsized":"2024-09-21T06:46:38.848749+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:24.677702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815387+0000","last_change":"2024-09-21T06:46:37.815387+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815387+0000","last_undegraded":"2024-09-21T06:46:37.815387+0000","last_fullsized":"2024-09-21T06:46:37.815387+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809740+0000","last_change":"2024-09-21T06:46:37.809740+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809740+0000","last_undegraded":"2024-09-21T06:46:37.809740+0000","last_fullsized":"2024-09-21T06:46:37.809740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820704+0000","last_change":"2024-09-21T06:46:37.820704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820704+0000","last_undegraded":"2024-09-21T06:46:37.820704+0000","last_fullsized":"2024-09-21T06:46:37.820704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828350+0000","last_change":"2024-09-21T06:46:37.822060+0000","last_active":"2024-09-21T06:46:37.828350+0000","last_peered":"2024-09-21T06:46:37.828350+0000","last_clean":"2024-09-21T06:46:37.828350+0000","last_became_active":"2024-09-21T06:46:37.821749+0000","last_became_peered":"2024-09-21T06:46:37.821749+0000","last_unstale":"2024-09-21T06:46:37.828350+0000","last_undegraded":"2024-09-21T06:46:37.828350+0000","last_fullsized":"2024-09-21T06:46:37.828350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:33.823939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814559+0000","last_change":"2024-09-21T06:46:37.814559+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814559+0000","last_undegraded":"2024-09-21T06:46:37.814559+0000","last_fullsized":"2024-09-21T06:46:37.814559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828981+0000","last_change":"2024-09-21T06:46:37.825639+0000","last_active":"2024-09-21T06:46:37.828981+0000","last_peered":"2024-09-21T06:46:37.828981+0000","last_clean":"2024-09-21T06:46:37.828981+0000","last_became_active":"2024-09-21T06:46:37.825329+0000","last_became_peered":"2024-09-21T06:46:37.825329+0000","last_unstale":"2024-09-21T06:46:37.828981+0000","last_undegraded":"2024-09-21T06:46:37.828981+0000","last_fullsized":"2024-09-21T06:46:37.828981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816631+0000","last_change":"2024-09-21T06:46:37.816631+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816631+0000","last_undegraded":"2024-09-21T06:46:37.816631+0000","last_fullsized":"2024-09-21T06:46:37.816631+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833801+0000","last_change":"2024-09-21T06:46:37.827885+0000","last_active":"2024-09-21T06:46:37.833801+0000","last_peered":"2024-09-21T06:46:37.833801+0000","last_clean":"2024-09-21T06:46:37.833801+0000","last_became_active":"2024-09-21T06:46:37.827560+0000","last_became_peered":"2024-09-21T06:46:37.827560+0000","last_unstale":"2024-09-21T06:46:37.833801+0000","last_undegraded":"2024-09-21T06:46:37.833801+0000","last_fullsized":"2024-09-21T06:46:37.833801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:28.522713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813990+0000","last_change":"2024-09-21T06:46:37.813990+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813990+0000","last_undegraded":"2024-09-21T06:46:37.813990+0000","last_fullsized":"2024-09-21T06:46:37.813990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857526+0000","last_change":"2024-09-21T06:46:37.827573+0000","last_active":"2024-09-21T06:46:38.857526+0000","last_peered":"2024-09-21T06:46:38.857526+0000","last_clean":"2024-09-21T06:46:38.857526+0000","last_became_active":"2024-09-21T06:46:37.827205+0000","last_became_peered":"2024-09-21T06:46:37.827205+0000","last_unstale":"2024-09-21T06:46:38.857526+0000","last_undegraded":"2024-09-21T06:46:38.857526+0000","last_fullsized":"2024-09-21T06:46:38.857526+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:44.653930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812592+0000","last_change":"2024-09-21T06:46:37.812592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812592+0000","last_undegraded":"2024-09-21T06:46:37.812592+0000","last_fullsized":"2024-09-21T06:46:37.812592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851676+0000","last_change":"2024-09-21T06:46:37.829136+0000","last_active":"2024-09-21T06:46:38.851676+0000","last_peered":"2024-09-21T06:46:38.851676+0000","last_clean":"2024-09-21T06:46:38.851676+0000","last_became_active":"2024-09-21T06:46:37.828745+0000","last_became_peered":"2024-09-21T06:46:37.828745+0000","last_unstale":"2024-09-21T06:46:38.851676+0000","last_undegraded":"2024-09-21T06:46:38.851676+0000","last_fullsized":"2024-09-21T06:46:38.851676+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:32.045906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809538+0000","last_change":"2024-09-21T06:46:37.809538+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809538+0000","last_undegraded":"2024-09-21T06:46:37.809538+0000","last_fullsized":"2024-09-21T06:46:37.809538+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833769+0000","last_change":"2024-09-21T06:46:37.826987+0000","last_active":"2024-09-21T06:46:37.833769+0000","last_peered":"2024-09-21T06:46:37.833769+0000","last_clean":"2024-09-21T06:46:37.833769+0000","last_became_active":"2024-09-21T06:46:37.826675+0000","last_became_peered":"2024-09-21T06:46:37.826675+0000","last_unstale":"2024-09-21T06:46:37.833769+0000","last_undegraded":"2024-09-21T06:46:37.833769+0000","last_fullsized":"2024-09-21T06:46:37.833769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:00.728251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848403+0000","last_change":"2024-09-21T06:46:38.843367+0000","last_active":"2024-09-21T06:46:38.848403+0000","last_peered":"2024-09-21T06:46:38.848403+0000","last_clean":"2024-09-21T06:46:38.848403+0000","last_became_active":"2024-09-21T06:46:38.842758+0000","last_became_peered":"2024-09-21T06:46:38.842758+0000","last_unstale":"2024-09-21T06:46:38.848403+0000","last_undegraded":"2024-09-21T06:46:38.848403+0000","last_fullsized":"2024-09-21T06:46:38.848403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:49.726045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829337+0000","last_change":"2024-09-21T06:46:37.822573+0000","last_active":"2024-09-21T06:46:38.829337+0000","last_peered":"2024-09-21T06:46:38.829337+0000","last_clean":"2024-09-21T06:46:38.829337+0000","last_became_active":"2024-09-21T06:46:37.822248+0000","last_became_peered":"2024-09-21T06:46:37.822248+0000","last_unstale":"2024-09-21T06:46:38.829337+0000","last_undegraded":"2024-09-21T06:46:38.829337+0000","last_fullsized":"2024-09-21T06:46:38.829337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:47.124858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813565+0000","last_change":"2024-09-21T06:46:37.813565+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813565+0000","last_undegraded":"2024-09-21T06:46:37.813565+0000","last_fullsized":"2024-09-21T06:46:37.813565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833890+0000","last_change":"2024-09-21T06:46:37.821564+0000","last_active":"2024-09-21T06:46:38.833890+0000","last_peered":"2024-09-21T06:46:38.833890+0000","last_clean":"2024-09-21T06:46:38.833890+0000","last_became_active":"2024-09-21T06:46:37.821236+0000","last_became_peered":"2024-09-21T06:46:37.821236+0000","last_unstale":"2024-09-21T06:46:38.833890+0000","last_undegraded":"2024-09-21T06:46:38.833890+0000","last_fullsized":"2024-09-21T06:46:38.833890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:48.720460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.836742+0000","last_change":"2024-09-21T06:46:38.835282+0000","last_active":"2024-09-21T06:46:38.836742+0000","last_peered":"2024-09-21T06:46:38.836742+0000","last_clean":"2024-09-21T06:46:38.836742+0000","last_became_active":"2024-09-21T06:46:38.834952+0000","last_became_peered":"2024-09-21T06:46:38.834952+0000","last_unstale":"2024-09-21T06:46:38.836742+0000","last_undegraded":"2024-09-21T06:46:38.836742+0000","last_fullsized":"2024-09-21T06:46:38.836742+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:32.211076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830074+0000","last_change":"2024-09-21T06:46:37.825931+0000","last_active":"2024-09-21T06:46:38.830074+0000","last_peered":"2024-09-21T06:46:38.830074+0000","last_clean":"2024-09-21T06:46:38.830074+0000","last_became_active":"2024-09-21T06:46:37.825590+0000","last_became_peered":"2024-09-21T06:46:37.825590+0000","last_unstale":"2024-09-21T06:46:38.830074+0000","last_undegraded":"2024-09-21T06:46:38.830074+0000","last_fullsized":"2024-09-21T06:46:38.830074+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:26.397972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843137+0000","last_change":"2024-09-21T06:46:38.833931+0000","last_active":"2024-09-21T06:46:38.843137+0000","last_peered":"2024-09-21T06:46:38.843137+0000","last_clean":"2024-09-21T06:46:38.843137+0000","last_became_active":"2024-09-21T06:46:38.833613+0000","last_became_peered":"2024-09-21T06:46:38.833613+0000","last_unstale":"2024-09-21T06:46:38.843137+0000","last_undegraded":"2024-09-21T06:46:38.843137+0000","last_fullsized":"2024-09-21T06:46:38.843137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:35.886975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.826471+0000","last_change":"2024-09-21T06:46:37.819621+0000","last_active":"2024-09-21T06:46:37.826471+0000","last_peered":"2024-09-21T06:46:37.826471+0000","last_clean":"2024-09-21T06:46:37.826471+0000","last_became_active":"2024-09-21T06:46:37.817183+0000","last_became_peered":"2024-09-21T06:46:37.817183+0000","last_unstale":"2024-09-21T06:46:37.826471+0000","last_undegraded":"2024-09-21T06:46:37.826471+0000","last_fullsized":"2024-09-21T06:46:37.826471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:45.747826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815758+0000","last_change":"2024-09-21T06:46:37.815758+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815758+0000","last_undegraded":"2024-09-21T06:46:37.815758+0000","last_fullsized":"2024-09-21T06:46:37.815758+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.858068+0000","last_change":"2024-09-21T06:46:37.827697+0000","last_active":"2024-09-21T06:46:38.858068+0000","last_peered":"2024-09-21T06:46:38.858068+0000","last_clean":"2024-09-21T06:46:38.858068+0000","last_became_active":"2024-09-21T06:46:37.827400+0000","last_became_peered":"2024-09-21T06:46:37.827400+0000","last_unstale":"2024-09-21T06:46:38.858068+0000","last_undegraded":"2024-09-21T06:46:38.858068+0000","last_fullsized":"2024-09-21T06:46:38.858068+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:15.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849133+0000","last_change":"2024-09-21T06:46:38.836804+0000","last_active":"2024-09-21T06:46:38.849133+0000","last_peered":"2024-09-21T06:46:38.849133+0000","last_clean":"2024-09-21T06:46:38.849133+0000","last_became_active":"2024-09-21T06:46:38.836503+0000","last_became_peered":"2024-09-21T06:46:38.836503+0000","last_unstale":"2024-09-21T06:46:38.849133+0000","last_undegraded":"2024-09-21T06:46:38.849133+0000","last_fullsized":"2024-09-21T06:46:38.849133+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:42.432169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.861597+0000","last_change":"2024-09-21T06:46:37.827650+0000","last_active":"2024-09-21T06:46:38.861597+0000","last_peered":"2024-09-21T06:46:38.861597+0000","last_clean":"2024-09-21T06:46:38.861597+0000","last_became_active":"2024-09-21T06:46:37.827332+0000","last_became_peered":"2024-09-21T06:46:37.827332+0000","last_unstale":"2024-09-21T06:46:38.861597+0000","last_undegraded":"2024-09-21T06:46:38.861597+0000","last_fullsized":"2024-09-21T06:46:38.861597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:01.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843682+0000","last_change":"2024-09-21T06:46:38.841487+0000","last_active":"2024-09-21T06:46:38.843682+0000","last_peered":"2024-09-21T06:46:38.843682+0000","last_clean":"2024-09-21T06:46:38.843682+0000","last_became_active":"2024-09-21T06:46:38.840274+0000","last_became_peered":"2024-09-21T06:46:38.840274+0000","last_unstale":"2024-09-21T06:46:38.843682+0000","last_undegraded":"2024-09-21T06:46:38.843682+0000","last_fullsized":"2024-09-21T06:46:38.843682+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830508+0000","last_change":"2024-09-21T06:46:37.827132+0000","last_active":"2024-09-21T06:46:37.830508+0000","last_peered":"2024-09-21T06:46:37.830508+0000","last_clean":"2024-09-21T06:46:37.830508+0000","last_became_active":"2024-09-21T06:46:37.826820+0000","last_became_peered":"2024-09-21T06:46:37.826820+0000","last_unstale":"2024-09-21T06:46:37.830508+0000","last_undegraded":"2024-09-21T06:46:37.830508+0000","last_fullsized":"2024-09-21T06:46:37.830508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.814083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843545+0000","last_change":"2024-09-21T06:46:38.834710+0000","last_active":"2024-09-21T06:46:38.843545+0000","last_peered":"2024-09-21T06:46:38.843545+0000","last_clean":"2024-09-21T06:46:38.843545+0000","last_became_active":"2024-09-21T06:46:38.834411+0000","last_became_peered":"2024-09-21T06:46:38.834411+0000","last_unstale":"2024-09-21T06:46:38.843545+0000","last_undegraded":"2024-09-21T06:46:38.843545+0000","last_fullsized":"2024-09-21T06:46:38.843545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829721+0000","last_change":"2024-09-21T06:46:37.822155+0000","last_active":"2024-09-21T06:46:38.829721+0000","last_peered":"2024-09-21T06:46:38.829721+0000","last_clean":"2024-09-21T06:46:38.829721+0000","last_became_active":"2024-09-21T06:46:37.821875+0000","last_became_peered":"2024-09-21T06:46:37.821875+0000","last_unstale":"2024-09-21T06:46:38.829721+0000","last_undegraded":"2024-09-21T06:46:38.829721+0000","last_fullsized":"2024-09-21T06:46:38.829721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:49.673120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.847439+0000","last_change":"2024-09-21T06:46:38.846296+0000","last_active":"2024-09-21T06:46:38.847439+0000","last_peered":"2024-09-21T06:46:38.847439+0000","last_clean":"2024-09-21T06:46:38.847439+0000","last_became_active":"2024-09-21T06:46:38.845939+0000","last_became_peered":"2024-09-21T06:46:38.845939+0000","last_unstale":"2024-09-21T06:46:38.847439+0000","last_undegraded":"2024-09-21T06:46:38.847439+0000","last_fullsized":"2024-09-21T06:46:38.847439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830182+0000","last_change":"2024-09-21T06:46:37.822030+0000","last_active":"2024-09-21T06:46:38.830182+0000","last_peered":"2024-09-21T06:46:38.830182+0000","last_clean":"2024-09-21T06:46:38.830182+0000","last_became_active":"2024-09-21T06:46:37.821713+0000","last_became_peered":"2024-09-21T06:46:37.821713+0000","last_unstale":"2024-09-21T06:46:38.830182+0000","last_undegraded":"2024-09-21T06:46:38.830182+0000","last_fullsized":"2024-09-21T06:46:38.830182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:12.386604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849053+0000","last_change":"2024-09-21T06:46:38.837242+0000","last_active":"2024-09-21T06:46:38.849053+0000","last_peered":"2024-09-21T06:46:38.849053+0000","last_clean":"2024-09-21T06:46:38.849053+0000","last_became_active":"2024-09-21T06:46:38.836884+0000","last_became_peered":"2024-09-21T06:46:38.836884+0000","last_unstale":"2024-09-21T06:46:38.849053+0000","last_undegraded":"2024-09-21T06:46:38.849053+0000","last_fullsized":"2024-09-21T06:46:38.849053+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:58.975876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859858+0000","last_change":"2024-09-21T06:46:37.824758+0000","last_active":"2024-09-21T06:46:38.859858+0000","last_peered":"2024-09-21T06:46:38.859858+0000","last_clean":"2024-09-21T06:46:38.859858+0000","last_became_active":"2024-09-21T06:46:37.824463+0000","last_became_peered":"2024-09-21T06:46:37.824463+0000","last_unstale":"2024-09-21T06:46:38.859858+0000","last_undegraded":"2024-09-21T06:46:38.859858+0000","last_fullsized":"2024-09-21T06:46:38.859858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:55.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843228+0000","last_change":"2024-09-21T06:46:38.837576+0000","last_active":"2024-09-21T06:46:38.843228+0000","last_peered":"2024-09-21T06:46:38.843228+0000","last_clean":"2024-09-21T06:46:38.843228+0000","last_became_active":"2024-09-21T06:46:38.837272+0000","last_became_peered":"2024-09-21T06:46:38.837272+0000","last_unstale":"2024-09-21T06:46:38.843228+0000","last_undegraded":"2024-09-21T06:46:38.843228+0000","last_fullsized":"2024-09-21T06:46:38.843228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828588+0000","last_change":"2024-09-21T06:46:37.826755+0000","last_active":"2024-09-21T06:46:37.828588+0000","last_peered":"2024-09-21T06:46:37.828588+0000","last_clean":"2024-09-21T06:46:37.828588+0000","last_became_active":"2024-09-21T06:46:37.826407+0000","last_became_peered":"2024-09-21T06:46:37.826407+0000","last_unstale":"2024-09-21T06:46:37.828588+0000","last_undegraded":"2024-09-21T06:46:37.828588+0000","last_fullsized":"2024-09-21T06:46:37.828588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:54.435622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843165+0000","last_change":"2024-09-21T06:46:38.834034+0000","last_active":"2024-09-21T06:46:38.843165+0000","last_peered":"2024-09-21T06:46:38.843165+0000","last_clean":"2024-09-21T06:46:38.843165+0000","last_became_active":"2024-09-21T06:46:38.833752+0000","last_became_peered":"2024-09-21T06:46:38.833752+0000","last_unstale":"2024-09-21T06:46:38.843165+0000","last_undegraded":"2024-09-21T06:46:38.843165+0000","last_fullsized":"2024-09-21T06:46:38.843165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:54.472336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.824284+0000","last_change":"2024-09-21T06:46:37.819283+0000","last_active":"2024-09-21T06:46:37.824284+0000","last_peered":"2024-09-21T06:46:37.824284+0000","last_clean":"2024-09-21T06:46:37.824284+0000","last_became_active":"2024-09-21T06:46:37.816729+0000","last_became_peered":"2024-09-21T06:46:37.816729+0000","last_unstale":"2024-09-21T06:46:37.824284+0000","last_undegraded":"2024-09-21T06:46:37.824284+0000","last_fullsized":"2024-09-21T06:46:37.824284+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:31.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816973+0000","last_change":"2024-09-21T06:46:37.816973+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816973+0000","last_undegraded":"2024-09-21T06:46:37.816973+0000","last_fullsized":"2024-09-21T06:46:37.816973+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.852111+0000","last_change":"2024-09-21T06:46:37.826066+0000","last_active":"2024-09-21T06:46:38.852111+0000","last_peered":"2024-09-21T06:46:38.852111+0000","last_clean":"2024-09-21T06:46:38.852111+0000","last_became_active":"2024-09-21T06:46:37.825751+0000","last_became_peered":"2024-09-21T06:46:37.825751+0000","last_unstale":"2024-09-21T06:46:38.852111+0000","last_undegraded":"2024-09-21T06:46:38.852111+0000","last_fullsized":"2024-09-21T06:46:38.852111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:19.603484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857622+0000","last_change":"2024-09-21T06:46:38.856673+0000","last_active":"2024-09-21T06:46:38.857622+0000","last_peered":"2024-09-21T06:46:38.857622+0000","last_clean":"2024-09-21T06:46:38.857622+0000","last_became_active":"2024-09-21T06:46:38.856179+0000","last_became_peered":"2024-09-21T06:46:38.856179+0000","last_unstale":"2024-09-21T06:46:38.857622+0000","last_undegraded":"2024-09-21T06:46:38.857622+0000","last_fullsized":"2024-09-21T06:46:38.857622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:35.199395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829453+0000","last_change":"2024-09-21T06:46:37.824783+0000","last_active":"2024-09-21T06:46:37.829453+0000","last_peered":"2024-09-21T06:46:37.829453+0000","last_clean":"2024-09-21T06:46:37.829453+0000","last_became_active":"2024-09-21T06:46:37.824308+0000","last_became_peered":"2024-09-21T06:46:37.824308+0000","last_unstale":"2024-09-21T06:46:37.829453+0000","last_undegraded":"2024-09-21T06:46:37.829453+0000","last_fullsized":"2024-09-21T06:46:37.829453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:34.680388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.850459+0000","last_change":"2024-09-21T06:46:38.847150+0000","last_active":"2024-09-21T06:46:38.850459+0000","last_peered":"2024-09-21T06:46:38.850459+0000","last_clean":"2024-09-21T06:46:38.850459+0000","last_became_active":"2024-09-21T06:46:38.846860+0000","last_became_peered":"2024-09-21T06:46:38.846860+0000","last_unstale":"2024-09-21T06:46:38.850459+0000","last_undegraded":"2024-09-21T06:46:38.850459+0000","last_fullsized":"2024-09-21T06:46:38.850459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830955+0000","last_change":"2024-09-21T06:46:37.827714+0000","last_active":"2024-09-21T06:46:37.830955+0000","last_peered":"2024-09-21T06:46:37.830955+0000","last_clean":"2024-09-21T06:46:37.830955+0000","last_became_active":"2024-09-21T06:46:37.826848+0000","last_became_peered":"2024-09-21T06:46:37.826848+0000","last_unstale":"2024-09-21T06:46:37.830955+0000","last_undegraded":"2024-09-21T06:46:37.830955+0000","last_fullsized":"2024-09-21T06:46:37.830955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:08.486901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812441+0000","last_change":"2024-09-21T06:46:37.812441+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812441+0000","last_undegraded":"2024-09-21T06:46:37.812441+0000","last_fullsized":"2024-09-21T06:46:37.812441+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828032+0000","last_change":"2024-09-21T06:46:37.817451+0000","last_active":"2024-09-21T06:46:37.828032+0000","last_peered":"2024-09-21T06:46:37.828032+0000","last_clean":"2024-09-21T06:46:37.828032+0000","last_became_active":"2024-09-21T06:46:37.816755+0000","last_became_peered":"2024-09-21T06:46:37.816755+0000","last_unstale":"2024-09-21T06:46:37.828032+0000","last_undegraded":"2024-09-21T06:46:37.828032+0000","last_fullsized":"2024-09-21T06:46:37.828032+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:09.214508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812272+0000","last_change":"2024-09-21T06:46:37.812272+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812272+0000","last_undegraded":"2024-09-21T06:46:37.812272+0000","last_fullsized":"2024-09-21T06:46:37.812272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833333+0000","last_change":"2024-09-21T06:46:37.826535+0000","last_active":"2024-09-21T06:46:38.833333+0000","last_peered":"2024-09-21T06:46:38.833333+0000","last_clean":"2024-09-21T06:46:38.833333+0000","last_became_active":"2024-09-21T06:46:37.825753+0000","last_became_peered":"2024-09-21T06:46:37.825753+0000","last_unstale":"2024-09-21T06:46:38.833333+0000","last_undegraded":"2024-09-21T06:46:38.833333+0000","last_fullsized":"2024-09-21T06:46:38.833333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843260+0000","last_change":"2024-09-21T06:46:38.838456+0000","last_active":"2024-09-21T06:46:38.843260+0000","last_peered":"2024-09-21T06:46:38.843260+0000","last_clean":"2024-09-21T06:46:38.843260+0000","last_became_active":"2024-09-21T06:46:38.838138+0000","last_became_peered":"2024-09-21T06:46:38.838138+0000","last_unstale":"2024-09-21T06:46:38.843260+0000","last_undegraded":"2024-09-21T06:46:38.843260+0000","last_fullsized":"2024-09-21T06:46:38.843260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833479+0000","last_change":"2024-09-21T06:46:37.828361+0000","last_active":"2024-09-21T06:46:37.833479+0000","last_peered":"2024-09-21T06:46:37.833479+0000","last_clean":"2024-09-21T06:46:37.833479+0000","last_became_active":"2024-09-21T06:46:37.828053+0000","last_became_peered":"2024-09-21T06:46:37.828053+0000","last_unstale":"2024-09-21T06:46:37.833479+0000","last_undegraded":"2024-09-21T06:46:37.833479+0000","last_fullsized":"2024-09-21T06:46:37.833479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:55.015218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843192+0000","last_change":"2024-09-21T06:46:38.835519+0000","last_active":"2024-09-21T06:46:38.843192+0000","last_peered":"2024-09-21T06:46:38.843192+0000","last_clean":"2024-09-21T06:46:38.843192+0000","last_became_active":"2024-09-21T06:46:38.835226+0000","last_became_peered":"2024-09-21T06:46:38.835226+0000","last_unstale":"2024-09-21T06:46:38.843192+0000","last_undegraded":"2024-09-21T06:46:38.843192+0000","last_fullsized":"2024-09-21T06:46:38.843192+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833812+0000","last_change":"2024-09-21T06:46:37.828386+0000","last_active":"2024-09-21T06:46:37.833812+0000","last_peered":"2024-09-21T06:46:37.833812+0000","last_clean":"2024-09-21T06:46:37.833812+0000","last_became_active":"2024-09-21T06:46:37.827795+0000","last_became_peered":"2024-09-21T06:46:37.827795+0000","last_unstale":"2024-09-21T06:46:37.833812+0000","last_undegraded":"2024-09-21T06:46:37.833812+0000","last_fullsized":"2024-09-21T06:46:37.833812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:17.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815592+0000","last_change":"2024-09-21T06:46:37.815592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815592+0000","last_undegraded":"2024-09-21T06:46:37.815592+0000","last_fullsized":"2024-09-21T06:46:37.815592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831398+0000","last_change":"2024-09-21T06:46:37.828721+0000","last_active":"2024-09-21T06:46:38.831398+0000","last_peered":"2024-09-21T06:46:38.831398+0000","last_clean":"2024-09-21T06:46:38.831398+0000","last_became_active":"2024-09-21T06:46:37.827838+0000","last_became_peered":"2024-09-21T06:46:37.827838+0000","last_unstale":"2024-09-21T06:46:38.831398+0000","last_undegraded":"2024-09-21T06:46:38.831398+0000","last_fullsized":"2024-09-21T06:46:38.831398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:34.881390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811128+0000","last_change":"2024-09-21T06:46:37.811128+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811128+0000","last_undegraded":"2024-09-21T06:46:37.811128+0000","last_fullsized":"2024-09-21T06:46:37.811128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.824899+0000","last_change":"2024-09-21T06:46:37.828979+0000","last_active":"2024-09-21T06:46:38.824899+0000","last_peered":"2024-09-21T06:46:38.824899+0000","last_clean":"2024-09-21T06:46:38.824899+0000","last_became_active":"2024-09-21T06:46:37.827049+0000","last_became_peered":"2024-09-21T06:46:37.827049+0000","last_unstale":"2024-09-21T06:46:38.824899+0000","last_undegraded":"2024-09-21T06:46:38.824899+0000","last_fullsized":"2024-09-21T06:46:38.824899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:41.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813704+0000","last_change":"2024-09-21T06:46:37.813704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813704+0000","last_undegraded":"2024-09-21T06:46:37.813704+0000","last_fullsized":"2024-09-21T06:46:37.813704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828898+0000","last_change":"2024-09-21T06:46:37.824970+0000","last_active":"2024-09-21T06:46:37.828898+0000","last_peered":"2024-09-21T06:46:37.828898+0000","last_clean":"2024-09-21T06:46:37.828898+0000","last_became_active":"2024-09-21T06:46:37.824677+0000","last_became_peered":"2024-09-21T06:46:37.824677+0000","last_unstale":"2024-09-21T06:46:37.828898+0000","last_undegraded":"2024-09-21T06:46:37.828898+0000","last_fullsized":"2024-09-21T06:46:37.828898+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:05.066114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851514+0000","last_change":"2024-09-21T06:46:38.845165+0000","last_active":"2024-09-21T06:46:38.851514+0000","last_peered":"2024-09-21T06:46:38.851514+0000","last_clean":"2024-09-21T06:46:38.851514+0000","last_became_active":"2024-09-21T06:46:38.844715+0000","last_became_peered":"2024-09-21T06:46:38.844715+0000","last_unstale":"2024-09-21T06:46:38.851514+0000","last_undegraded":"2024-09-21T06:46:38.851514+0000","last_fullsized":"2024-09-21T06:46:38.851514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:34.402844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.825098+0000","last_change":"2024-09-21T06:46:37.824613+0000","last_active":"2024-09-21T06:46:38.825098+0000","last_peered":"2024-09-21T06:46:38.825098+0000","last_clean":"2024-09-21T06:46:38.825098+0000","last_became_active":"2024-09-21T06:46:37.824302+0000","last_became_peered":"2024-09-21T06:46:37.824302+0000","last_unstale":"2024-09-21T06:46:38.825098+0000","last_undegraded":"2024-09-21T06:46:38.825098+0000","last_fullsized":"2024-09-21T06:46:38.825098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:57.477737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810322+0000","last_change":"2024-09-21T06:46:37.810322+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810322+0000","last_undegraded":"2024-09-21T06:46:37.810322+0000","last_fullsized":"2024-09-21T06:46:37.810322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.823443+0000","last_change":"2024-09-21T06:46:37.821964+0000","last_active":"2024-09-21T06:46:37.823443+0000","last_peered":"2024-09-21T06:46:37.823443+0000","last_clean":"2024-09-21T06:46:37.823443+0000","last_became_active":"2024-09-21T06:46:37.821664+0000","last_became_peered":"2024-09-21T06:46:37.821664+0000","last_unstale":"2024-09-21T06:46:37.823443+0000","last_undegraded":"2024-09-21T06:46:37.823443+0000","last_fullsized":"2024-09-21T06:46:37.823443+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:47.227494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814544+0000","last_change":"2024-09-21T06:46:37.814544+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814544+0000","last_undegraded":"2024-09-21T06:46:37.814544+0000","last_fullsized":"2024-09-21T06:46:37.814544+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829366+0000","last_change":"2024-09-21T06:46:37.821294+0000","last_active":"2024-09-21T06:46:37.829366+0000","last_peered":"2024-09-21T06:46:37.829366+0000","last_clean":"2024-09-21T06:46:37.829366+0000","last_became_active":"2024-09-21T06:46:37.820623+0000","last_became_peered":"2024-09-21T06:46:37.820623+0000","last_unstale":"2024-09-21T06:46:37.829366+0000","last_undegraded":"2024-09-21T06:46:37.829366+0000","last_fullsized":"2024-09-21T06:46:37.829366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:15.971706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811935+0000","last_change":"2024-09-21T06:46:37.811935+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811935+0000","last_undegraded":"2024-09-21T06:46:37.811935+0000","last_fullsized":"2024-09-21T06:46:37.811935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831642+0000","last_change":"2024-09-21T06:46:37.829723+0000","last_active":"2024-09-21T06:46:38.831642+0000","last_peered":"2024-09-21T06:46:38.831642+0000","last_clean":"2024-09-21T06:46:38.831642+0000","last_became_active":"2024-09-21T06:46:37.829452+0000","last_became_peered":"2024-09-21T06:46:37.829452+0000","last_unstale":"2024-09-21T06:46:38.831642+0000","last_undegraded":"2024-09-21T06:46:38.831642+0000","last_fullsized":"2024-09-21T06:46:38.831642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.342847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":166,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833441+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:38.833441+0000","last_peered":"2024-09-21T06:46:38.833441+0000","last_clean":"2024-09-21T06:46:38.833441+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:38.833441+0000","last_undegraded":"2024-09-21T06:46:38.833441+0000","last_fullsized":"2024-09-21T06:46:38.833441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":4056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:42.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:42.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 -- 172.21.15.81:0/2801066241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef80afac0 msgr2=0x7fdef806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/2801066241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef80afac0 0x7fdef806f1c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009830 tx=0x7fdeec02a480 comp rx=0 tx=0).stop 2024-09-21T06:46:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 -- 172.21.15.81:0/2801066241 shutdown_connections 2024-09-21T06:46:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/2801066241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef80afac0 0x7fdef806f1c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/2801066241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdef8163300 0x7fdef8165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 -- 172.21.15.81:0/2801066241 >> 172.21.15.81:0/2801066241 conn(0x7fdef80740a0 msgr2=0x7fdef80b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 -- 172.21.15.81:0/2801066241 shutdown_connections 2024-09-21T06:46:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.993+0000 7fdefe4d3640 1 -- 172.21.15.81:0/2801066241 wait complete. 2024-09-21T06:46:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.995+0000 7fdefe4d3640 1 Processor -- start 2024-09-21T06:46:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.995+0000 7fdefe4d3640 1 -- start start 2024-09-21T06:46:42.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.996+0000 7fdefe4d3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef806e6a0 0x7fdef813a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.996+0000 7fdefe4d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef80afac0 0x7fdef814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.996+0000 7fdefe4d3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdef8163300 0x7fdef81f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.996+0000 7fdefe4d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdef806f880 con 0x7fdef80afac0 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.996+0000 7fdefe4d3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fdef806f700 con 0x7fdef806e6a0 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.996+0000 7fdefe4d3640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fdef8165c60 con 0x7fdef8163300 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.996+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef80afac0 0x7fdef814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef80afac0 0x7fdef814fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58318/0 (socket says 172.21.15.81:58318) 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 -- 172.21.15.81:0/3168811880 learned_addr learned my addr 172.21.15.81:0/3168811880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef7fff640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef806e6a0 0x7fdef813a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdefca70640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdef8163300 0x7fdef81f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 -- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdef8163300 msgr2=0x7fdef81f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdef8163300 0x7fdef81f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 -- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef806e6a0 msgr2=0x7fdef813a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef806e6a0 0x7fdef813a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 -- 172.21.15.81:0/3168811880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef81f66d0 con 0x7fdef80afac0 2024-09-21T06:46:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef77fe640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef80afac0 0x7fdef814fa20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009950 tx=0x7fdeec033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef4ff9640 1 -- 172.21.15.81:0/3168811880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec005c90 con 0x7fdef80afac0 2024-09-21T06:46:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef4ff9640 1 -- 172.21.15.81:0/3168811880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdeec031e50 con 0x7fdef80afac0 2024-09-21T06:46:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef81f63f0 con 0x7fdef80afac0 2024-09-21T06:46:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdef4ff9640 1 -- 172.21.15.81:0/3168811880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec005260 con 0x7fdef80afac0 2024-09-21T06:46:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.997+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef814f220 con 0x7fdef80afac0 2024-09-21T06:46:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.998+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef81f6160 con 0x7fdef80afac0 2024-09-21T06:46:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.999+0000 7fdef4ff9640 1 -- 172.21.15.81:0/3168811880 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdeec005400 con 0x7fdef80afac0 2024-09-21T06:46:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:42.999+0000 7fdef4ff9640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fdee4078bc0 0x7fdee407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.000+0000 7fdef4ff9640 1 -- 172.21.15.81:0/3168811880 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fdeec0bbe90 con 0x7fdef80afac0 2024-09-21T06:46:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.000+0000 7fdef7fff640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fdee4078bc0 0x7fdee407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.000+0000 7fdef7fff640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fdee4078bc0 0x7fdee407b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdee8001150 tx=0x7fdee80010e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:43.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.004+0000 7fdef4ff9640 1 -- 172.21.15.81:0/3168811880 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdeec03f030 con 0x7fdef80afac0 2024-09-21T06:46:43.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.176+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdef806eab0 con 0x7fdee4078bc0 2024-09-21T06:46:43.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.181+0000 7fdef4ff9640 1 -- 172.21.15.81:0/3168811880 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249067 (secure 0 0 0) 0x7fdef806eab0 con 0x7fdee4078bc0 2024-09-21T06:46:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:43.187 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fdee4078bc0 msgr2=0x7fdee407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fdee4078bc0 0x7fdee407b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdee8001150 tx=0x7fdee80010e0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef80afac0 msgr2=0x7fdef814fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef80afac0 0x7fdef814fa20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009950 tx=0x7fdeec033c20 comp rx=0 tx=0).stop 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 shutdown_connections 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fdee4078bc0 0x7fdee407b0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdef8163300 0x7fdef81f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdef80afac0 0x7fdef814fa20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 --2- 172.21.15.81:0/3168811880 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef806e6a0 0x7fdef813a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 >> 172.21.15.81:0/3168811880 conn(0x7fdef80740a0 msgr2=0x7fdef8151960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:43.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 shutdown_connections 2024-09-21T06:46:43.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.184+0000 7fdefe4d3640 1 -- 172.21.15.81:0/3168811880 wait complete. 2024-09-21T06:46:43.197 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-21T06:46:42.673269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592140,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":127,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222116,"kb_used_data":5840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752604,"statfs":{"total":773094113280,"available":772866666496,"internally_reserved":0,"allocated":5980160,"data_stored":3277858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868427"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.819428+0000","last_change":"2024-09-21T06:46:37.819428+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.819428+0000","last_undegraded":"2024-09-21T06:46:37.819428+0000","last_fullsized":"2024-09-21T06:46:37.819428+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815734+0000","last_change":"2024-09-21T06:46:37.815734+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815734+0000","last_undegraded":"2024-09-21T06:46:37.815734+0000","last_fullsized":"2024-09-21T06:46:37.815734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844525+0000","last_change":"2024-09-21T06:46:38.836247+0000","last_active":"2024-09-21T06:46:38.844525+0000","last_peered":"2024-09-21T06:46:38.844525+0000","last_clean":"2024-09-21T06:46:38.844525+0000","last_became_active":"2024-09-21T06:46:38.835897+0000","last_became_peered":"2024-09-21T06:46:38.835897+0000","last_unstale":"2024-09-21T06:46:38.844525+0000","last_undegraded":"2024-09-21T06:46:38.844525+0000","last_fullsized":"2024-09-21T06:46:38.844525+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849825+0000","last_change":"2024-09-21T06:46:38.844482+0000","last_active":"2024-09-21T06:46:38.849825+0000","last_peered":"2024-09-21T06:46:38.849825+0000","last_clean":"2024-09-21T06:46:38.849825+0000","last_became_active":"2024-09-21T06:46:38.844161+0000","last_became_peered":"2024-09-21T06:46:38.844161+0000","last_unstale":"2024-09-21T06:46:38.849825+0000","last_undegraded":"2024-09-21T06:46:38.849825+0000","last_fullsized":"2024-09-21T06:46:38.849825+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:54.933768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.821160+0000","last_change":"2024-09-21T06:46:37.821160+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.821160+0000","last_undegraded":"2024-09-21T06:46:37.821160+0000","last_fullsized":"2024-09-21T06:46:37.821160+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820842+0000","last_change":"2024-09-21T06:46:37.820842+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820842+0000","last_undegraded":"2024-09-21T06:46:37.820842+0000","last_fullsized":"2024-09-21T06:46:37.820842+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849083+0000","last_change":"2024-09-21T06:46:38.837455+0000","last_active":"2024-09-21T06:46:38.849083+0000","last_peered":"2024-09-21T06:46:38.849083+0000","last_clean":"2024-09-21T06:46:38.849083+0000","last_became_active":"2024-09-21T06:46:38.837170+0000","last_became_peered":"2024-09-21T06:46:38.837170+0000","last_unstale":"2024-09-21T06:46:38.849083+0000","last_undegraded":"2024-09-21T06:46:38.849083+0000","last_fullsized":"2024-09-21T06:46:38.849083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:20.986258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820035+0000","last_change":"2024-09-21T06:46:37.820035+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820035+0000","last_undegraded":"2024-09-21T06:46:37.820035+0000","last_fullsized":"2024-09-21T06:46:37.820035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859845+0000","last_change":"2024-09-21T06:46:38.856546+0000","last_active":"2024-09-21T06:46:38.859845+0000","last_peered":"2024-09-21T06:46:38.859845+0000","last_clean":"2024-09-21T06:46:38.859845+0000","last_became_active":"2024-09-21T06:46:38.856240+0000","last_became_peered":"2024-09-21T06:46:38.856240+0000","last_unstale":"2024-09-21T06:46:38.859845+0000","last_undegraded":"2024-09-21T06:46:38.859845+0000","last_fullsized":"2024-09-21T06:46:38.859845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:12.306047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.822086+0000","last_change":"2024-09-21T06:46:37.822086+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.822086+0000","last_undegraded":"2024-09-21T06:46:37.822086+0000","last_fullsized":"2024-09-21T06:46:37.822086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810180+0000","last_change":"2024-09-21T06:46:37.810180+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810180+0000","last_undegraded":"2024-09-21T06:46:37.810180+0000","last_fullsized":"2024-09-21T06:46:37.810180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843454+0000","last_change":"2024-09-21T06:46:38.840765+0000","last_active":"2024-09-21T06:46:38.843454+0000","last_peered":"2024-09-21T06:46:38.843454+0000","last_clean":"2024-09-21T06:46:38.843454+0000","last_became_active":"2024-09-21T06:46:38.840430+0000","last_became_peered":"2024-09-21T06:46:38.840430+0000","last_unstale":"2024-09-21T06:46:38.843454+0000","last_undegraded":"2024-09-21T06:46:38.843454+0000","last_fullsized":"2024-09-21T06:46:38.843454+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851481+0000","last_change":"2024-09-21T06:46:38.844070+0000","last_active":"2024-09-21T06:46:38.851481+0000","last_peered":"2024-09-21T06:46:38.851481+0000","last_clean":"2024-09-21T06:46:38.851481+0000","last_became_active":"2024-09-21T06:46:38.843603+0000","last_became_peered":"2024-09-21T06:46:38.843603+0000","last_unstale":"2024-09-21T06:46:38.851481+0000","last_undegraded":"2024-09-21T06:46:38.851481+0000","last_fullsized":"2024-09-21T06:46:38.851481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:38.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.842407+0000","last_change":"2024-09-21T06:46:38.832845+0000","last_active":"2024-09-21T06:46:38.842407+0000","last_peered":"2024-09-21T06:46:38.842407+0000","last_clean":"2024-09-21T06:46:38.842407+0000","last_became_active":"2024-09-21T06:46:38.832523+0000","last_became_peered":"2024-09-21T06:46:38.832523+0000","last_unstale":"2024-09-21T06:46:38.842407+0000","last_undegraded":"2024-09-21T06:46:38.842407+0000","last_fullsized":"2024-09-21T06:46:38.842407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:27.403557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851351+0000","last_change":"2024-09-21T06:46:38.845822+0000","last_active":"2024-09-21T06:46:38.851351+0000","last_peered":"2024-09-21T06:46:38.851351+0000","last_clean":"2024-09-21T06:46:38.851351+0000","last_became_active":"2024-09-21T06:46:38.845446+0000","last_became_peered":"2024-09-21T06:46:38.845446+0000","last_unstale":"2024-09-21T06:46:38.851351+0000","last_undegraded":"2024-09-21T06:46:38.851351+0000","last_fullsized":"2024-09-21T06:46:38.851351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:56.261429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813254+0000","last_change":"2024-09-21T06:46:37.813254+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813254+0000","last_undegraded":"2024-09-21T06:46:37.813254+0000","last_fullsized":"2024-09-21T06:46:37.813254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815082+0000","last_change":"2024-09-21T06:46:37.815082+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815082+0000","last_undegraded":"2024-09-21T06:46:37.815082+0000","last_fullsized":"2024-09-21T06:46:37.815082+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844151+0000","last_change":"2024-09-21T06:46:38.841494+0000","last_active":"2024-09-21T06:46:38.844151+0000","last_peered":"2024-09-21T06:46:38.844151+0000","last_clean":"2024-09-21T06:46:38.844151+0000","last_became_active":"2024-09-21T06:46:38.841161+0000","last_became_peered":"2024-09-21T06:46:38.841161+0000","last_unstale":"2024-09-21T06:46:38.844151+0000","last_undegraded":"2024-09-21T06:46:38.844151+0000","last_fullsized":"2024-09-21T06:46:38.844151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:47.348432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816299+0000","last_change":"2024-09-21T06:46:37.816299+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816299+0000","last_undegraded":"2024-09-21T06:46:37.816299+0000","last_fullsized":"2024-09-21T06:46:37.816299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809496+0000","last_change":"2024-09-21T06:46:37.809496+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809496+0000","last_undegraded":"2024-09-21T06:46:37.809496+0000","last_fullsized":"2024-09-21T06:46:37.809496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851499+0000","last_change":"2024-09-21T06:46:38.844395+0000","last_active":"2024-09-21T06:46:38.851499+0000","last_peered":"2024-09-21T06:46:38.851499+0000","last_clean":"2024-09-21T06:46:38.851499+0000","last_became_active":"2024-09-21T06:46:38.844030+0000","last_became_peered":"2024-09-21T06:46:38.844030+0000","last_unstale":"2024-09-21T06:46:38.851499+0000","last_undegraded":"2024-09-21T06:46:38.851499+0000","last_fullsized":"2024-09-21T06:46:38.851499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:18.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809041+0000","last_change":"2024-09-21T06:46:37.809041+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809041+0000","last_undegraded":"2024-09-21T06:46:37.809041+0000","last_fullsized":"2024-09-21T06:46:37.809041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849108+0000","last_change":"2024-09-21T06:46:38.838558+0000","last_active":"2024-09-21T06:46:38.849108+0000","last_peered":"2024-09-21T06:46:38.849108+0000","last_clean":"2024-09-21T06:46:38.849108+0000","last_became_active":"2024-09-21T06:46:38.838256+0000","last_became_peered":"2024-09-21T06:46:38.838256+0000","last_unstale":"2024-09-21T06:46:38.849108+0000","last_undegraded":"2024-09-21T06:46:38.849108+0000","last_fullsized":"2024-09-21T06:46:38.849108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:37.987203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859870+0000","last_change":"2024-09-21T06:46:38.856520+0000","last_active":"2024-09-21T06:46:38.859870+0000","last_peered":"2024-09-21T06:46:38.859870+0000","last_clean":"2024-09-21T06:46:38.859870+0000","last_became_active":"2024-09-21T06:46:38.856171+0000","last_became_peered":"2024-09-21T06:46:38.856171+0000","last_unstale":"2024-09-21T06:46:38.859870+0000","last_undegraded":"2024-09-21T06:46:38.859870+0000","last_fullsized":"2024-09-21T06:46:38.859870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815856+0000","last_change":"2024-09-21T06:46:37.815856+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815856+0000","last_undegraded":"2024-09-21T06:46:37.815856+0000","last_fullsized":"2024-09-21T06:46:37.815856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.838885+0000","last_change":"2024-09-21T06:46:38.836327+0000","last_active":"2024-09-21T06:46:38.838885+0000","last_peered":"2024-09-21T06:46:38.838885+0000","last_clean":"2024-09-21T06:46:38.838885+0000","last_became_active":"2024-09-21T06:46:38.836032+0000","last_became_peered":"2024-09-21T06:46:38.836032+0000","last_unstale":"2024-09-21T06:46:38.838885+0000","last_undegraded":"2024-09-21T06:46:38.838885+0000","last_fullsized":"2024-09-21T06:46:38.838885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:46.918012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815262+0000","last_change":"2024-09-21T06:46:37.815262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815262+0000","last_undegraded":"2024-09-21T06:46:37.815262+0000","last_fullsized":"2024-09-21T06:46:37.815262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817360+0000","last_change":"2024-09-21T06:46:37.817360+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817360+0000","last_undegraded":"2024-09-21T06:46:37.817360+0000","last_fullsized":"2024-09-21T06:46:37.817360+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817262+0000","last_change":"2024-09-21T06:46:37.817262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817262+0000","last_undegraded":"2024-09-21T06:46:37.817262+0000","last_fullsized":"2024-09-21T06:46:37.817262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848749+0000","last_change":"2024-09-21T06:46:38.839817+0000","last_active":"2024-09-21T06:46:38.848749+0000","last_peered":"2024-09-21T06:46:38.848749+0000","last_clean":"2024-09-21T06:46:38.848749+0000","last_became_active":"2024-09-21T06:46:38.839497+0000","last_became_peered":"2024-09-21T06:46:38.839497+0000","last_unstale":"2024-09-21T06:46:38.848749+0000","last_undegraded":"2024-09-21T06:46:38.848749+0000","last_fullsized":"2024-09-21T06:46:38.848749+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:24.677702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815387+0000","last_change":"2024-09-21T06:46:37.815387+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815387+0000","last_undegraded":"2024-09-21T06:46:37.815387+0000","last_fullsized":"2024-09-21T06:46:37.815387+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809740+0000","last_change":"2024-09-21T06:46:37.809740+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809740+0000","last_undegraded":"2024-09-21T06:46:37.809740+0000","last_fullsized":"2024-09-21T06:46:37.809740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820704+0000","last_change":"2024-09-21T06:46:37.820704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820704+0000","last_undegraded":"2024-09-21T06:46:37.820704+0000","last_fullsized":"2024-09-21T06:46:37.820704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828350+0000","last_change":"2024-09-21T06:46:37.822060+0000","last_active":"2024-09-21T06:46:37.828350+0000","last_peered":"2024-09-21T06:46:37.828350+0000","last_clean":"2024-09-21T06:46:37.828350+0000","last_became_active":"2024-09-21T06:46:37.821749+0000","last_became_peered":"2024-09-21T06:46:37.821749+0000","last_unstale":"2024-09-21T06:46:37.828350+0000","last_undegraded":"2024-09-21T06:46:37.828350+0000","last_fullsized":"2024-09-21T06:46:37.828350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:33.823939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814559+0000","last_change":"2024-09-21T06:46:37.814559+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814559+0000","last_undegraded":"2024-09-21T06:46:37.814559+0000","last_fullsized":"2024-09-21T06:46:37.814559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828981+0000","last_change":"2024-09-21T06:46:37.825639+0000","last_active":"2024-09-21T06:46:37.828981+0000","last_peered":"2024-09-21T06:46:37.828981+0000","last_clean":"2024-09-21T06:46:37.828981+0000","last_became_active":"2024-09-21T06:46:37.825329+0000","last_became_peered":"2024-09-21T06:46:37.825329+0000","last_unstale":"2024-09-21T06:46:37.828981+0000","last_undegraded":"2024-09-21T06:46:37.828981+0000","last_fullsized":"2024-09-21T06:46:37.828981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816631+0000","last_change":"2024-09-21T06:46:37.816631+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816631+0000","last_undegraded":"2024-09-21T06:46:37.816631+0000","last_fullsized":"2024-09-21T06:46:37.816631+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833801+0000","last_change":"2024-09-21T06:46:37.827885+0000","last_active":"2024-09-21T06:46:37.833801+0000","last_peered":"2024-09-21T06:46:37.833801+0000","last_clean":"2024-09-21T06:46:37.833801+0000","last_became_active":"2024-09-21T06:46:37.827560+0000","last_became_peered":"2024-09-21T06:46:37.827560+0000","last_unstale":"2024-09-21T06:46:37.833801+0000","last_undegraded":"2024-09-21T06:46:37.833801+0000","last_fullsized":"2024-09-21T06:46:37.833801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:28.522713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813990+0000","last_change":"2024-09-21T06:46:37.813990+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813990+0000","last_undegraded":"2024-09-21T06:46:37.813990+0000","last_fullsized":"2024-09-21T06:46:37.813990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857526+0000","last_change":"2024-09-21T06:46:37.827573+0000","last_active":"2024-09-21T06:46:38.857526+0000","last_peered":"2024-09-21T06:46:38.857526+0000","last_clean":"2024-09-21T06:46:38.857526+0000","last_became_active":"2024-09-21T06:46:37.827205+0000","last_became_peered":"2024-09-21T06:46:37.827205+0000","last_unstale":"2024-09-21T06:46:38.857526+0000","last_undegraded":"2024-09-21T06:46:38.857526+0000","last_fullsized":"2024-09-21T06:46:38.857526+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:44.653930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812592+0000","last_change":"2024-09-21T06:46:37.812592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812592+0000","last_undegraded":"2024-09-21T06:46:37.812592+0000","last_fullsized":"2024-09-21T06:46:37.812592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851676+0000","last_change":"2024-09-21T06:46:37.829136+0000","last_active":"2024-09-21T06:46:38.851676+0000","last_peered":"2024-09-21T06:46:38.851676+0000","last_clean":"2024-09-21T06:46:38.851676+0000","last_became_active":"2024-09-21T06:46:37.828745+0000","last_became_peered":"2024-09-21T06:46:37.828745+0000","last_unstale":"2024-09-21T06:46:38.851676+0000","last_undegraded":"2024-09-21T06:46:38.851676+0000","last_fullsized":"2024-09-21T06:46:38.851676+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:32.045906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809538+0000","last_change":"2024-09-21T06:46:37.809538+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809538+0000","last_undegraded":"2024-09-21T06:46:37.809538+0000","last_fullsized":"2024-09-21T06:46:37.809538+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833769+0000","last_change":"2024-09-21T06:46:37.826987+0000","last_active":"2024-09-21T06:46:37.833769+0000","last_peered":"2024-09-21T06:46:37.833769+0000","last_clean":"2024-09-21T06:46:37.833769+0000","last_became_active":"2024-09-21T06:46:37.826675+0000","last_became_peered":"2024-09-21T06:46:37.826675+0000","last_unstale":"2024-09-21T06:46:37.833769+0000","last_undegraded":"2024-09-21T06:46:37.833769+0000","last_fullsized":"2024-09-21T06:46:37.833769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:00.728251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848403+0000","last_change":"2024-09-21T06:46:38.843367+0000","last_active":"2024-09-21T06:46:38.848403+0000","last_peered":"2024-09-21T06:46:38.848403+0000","last_clean":"2024-09-21T06:46:38.848403+0000","last_became_active":"2024-09-21T06:46:38.842758+0000","last_became_peered":"2024-09-21T06:46:38.842758+0000","last_unstale":"2024-09-21T06:46:38.848403+0000","last_undegraded":"2024-09-21T06:46:38.848403+0000","last_fullsized":"2024-09-21T06:46:38.848403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:49.726045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829337+0000","last_change":"2024-09-21T06:46:37.822573+0000","last_active":"2024-09-21T06:46:38.829337+0000","last_peered":"2024-09-21T06:46:38.829337+0000","last_clean":"2024-09-21T06:46:38.829337+0000","last_became_active":"2024-09-21T06:46:37.822248+0000","last_became_peered":"2024-09-21T06:46:37.822248+0000","last_unstale":"2024-09-21T06:46:38.829337+0000","last_undegraded":"2024-09-21T06:46:38.829337+0000","last_fullsized":"2024-09-21T06:46:38.829337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:47.124858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813565+0000","last_change":"2024-09-21T06:46:37.813565+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813565+0000","last_undegraded":"2024-09-21T06:46:37.813565+0000","last_fullsized":"2024-09-21T06:46:37.813565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833890+0000","last_change":"2024-09-21T06:46:37.821564+0000","last_active":"2024-09-21T06:46:38.833890+0000","last_peered":"2024-09-21T06:46:38.833890+0000","last_clean":"2024-09-21T06:46:38.833890+0000","last_became_active":"2024-09-21T06:46:37.821236+0000","last_became_peered":"2024-09-21T06:46:37.821236+0000","last_unstale":"2024-09-21T06:46:38.833890+0000","last_undegraded":"2024-09-21T06:46:38.833890+0000","last_fullsized":"2024-09-21T06:46:38.833890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:48.720460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.836742+0000","last_change":"2024-09-21T06:46:38.835282+0000","last_active":"2024-09-21T06:46:38.836742+0000","last_peered":"2024-09-21T06:46:38.836742+0000","last_clean":"2024-09-21T06:46:38.836742+0000","last_became_active":"2024-09-21T06:46:38.834952+0000","last_became_peered":"2024-09-21T06:46:38.834952+0000","last_unstale":"2024-09-21T06:46:38.836742+0000","last_undegraded":"2024-09-21T06:46:38.836742+0000","last_fullsized":"2024-09-21T06:46:38.836742+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:32.211076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830074+0000","last_change":"2024-09-21T06:46:37.825931+0000","last_active":"2024-09-21T06:46:38.830074+0000","last_peered":"2024-09-21T06:46:38.830074+0000","last_clean":"2024-09-21T06:46:38.830074+0000","last_became_active":"2024-09-21T06:46:37.825590+0000","last_became_peered":"2024-09-21T06:46:37.825590+0000","last_unstale":"2024-09-21T06:46:38.830074+0000","last_undegraded":"2024-09-21T06:46:38.830074+0000","last_fullsized":"2024-09-21T06:46:38.830074+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:26.397972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843137+0000","last_change":"2024-09-21T06:46:38.833931+0000","last_active":"2024-09-21T06:46:38.843137+0000","last_peered":"2024-09-21T06:46:38.843137+0000","last_clean":"2024-09-21T06:46:38.843137+0000","last_became_active":"2024-09-21T06:46:38.833613+0000","last_became_peered":"2024-09-21T06:46:38.833613+0000","last_unstale":"2024-09-21T06:46:38.843137+0000","last_undegraded":"2024-09-21T06:46:38.843137+0000","last_fullsized":"2024-09-21T06:46:38.843137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:35.886975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.826471+0000","last_change":"2024-09-21T06:46:37.819621+0000","last_active":"2024-09-21T06:46:37.826471+0000","last_peered":"2024-09-21T06:46:37.826471+0000","last_clean":"2024-09-21T06:46:37.826471+0000","last_became_active":"2024-09-21T06:46:37.817183+0000","last_became_peered":"2024-09-21T06:46:37.817183+0000","last_unstale":"2024-09-21T06:46:37.826471+0000","last_undegraded":"2024-09-21T06:46:37.826471+0000","last_fullsized":"2024-09-21T06:46:37.826471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:45.747826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815758+0000","last_change":"2024-09-21T06:46:37.815758+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815758+0000","last_undegraded":"2024-09-21T06:46:37.815758+0000","last_fullsized":"2024-09-21T06:46:37.815758+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.858068+0000","last_change":"2024-09-21T06:46:37.827697+0000","last_active":"2024-09-21T06:46:38.858068+0000","last_peered":"2024-09-21T06:46:38.858068+0000","last_clean":"2024-09-21T06:46:38.858068+0000","last_became_active":"2024-09-21T06:46:37.827400+0000","last_became_peered":"2024-09-21T06:46:37.827400+0000","last_unstale":"2024-09-21T06:46:38.858068+0000","last_undegraded":"2024-09-21T06:46:38.858068+0000","last_fullsized":"2024-09-21T06:46:38.858068+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:15.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849133+0000","last_change":"2024-09-21T06:46:38.836804+0000","last_active":"2024-09-21T06:46:38.849133+0000","last_peered":"2024-09-21T06:46:38.849133+0000","last_clean":"2024-09-21T06:46:38.849133+0000","last_became_active":"2024-09-21T06:46:38.836503+0000","last_became_peered":"2024-09-21T06:46:38.836503+0000","last_unstale":"2024-09-21T06:46:38.849133+0000","last_undegraded":"2024-09-21T06:46:38.849133+0000","last_fullsized":"2024-09-21T06:46:38.849133+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:42.432169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.861597+0000","last_change":"2024-09-21T06:46:37.827650+0000","last_active":"2024-09-21T06:46:38.861597+0000","last_peered":"2024-09-21T06:46:38.861597+0000","last_clean":"2024-09-21T06:46:38.861597+0000","last_became_active":"2024-09-21T06:46:37.827332+0000","last_became_peered":"2024-09-21T06:46:37.827332+0000","last_unstale":"2024-09-21T06:46:38.861597+0000","last_undegraded":"2024-09-21T06:46:38.861597+0000","last_fullsized":"2024-09-21T06:46:38.861597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:01.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843682+0000","last_change":"2024-09-21T06:46:38.841487+0000","last_active":"2024-09-21T06:46:38.843682+0000","last_peered":"2024-09-21T06:46:38.843682+0000","last_clean":"2024-09-21T06:46:38.843682+0000","last_became_active":"2024-09-21T06:46:38.840274+0000","last_became_peered":"2024-09-21T06:46:38.840274+0000","last_unstale":"2024-09-21T06:46:38.843682+0000","last_undegraded":"2024-09-21T06:46:38.843682+0000","last_fullsized":"2024-09-21T06:46:38.843682+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830508+0000","last_change":"2024-09-21T06:46:37.827132+0000","last_active":"2024-09-21T06:46:37.830508+0000","last_peered":"2024-09-21T06:46:37.830508+0000","last_clean":"2024-09-21T06:46:37.830508+0000","last_became_active":"2024-09-21T06:46:37.826820+0000","last_became_peered":"2024-09-21T06:46:37.826820+0000","last_unstale":"2024-09-21T06:46:37.830508+0000","last_undegraded":"2024-09-21T06:46:37.830508+0000","last_fullsized":"2024-09-21T06:46:37.830508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.814083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843545+0000","last_change":"2024-09-21T06:46:38.834710+0000","last_active":"2024-09-21T06:46:38.843545+0000","last_peered":"2024-09-21T06:46:38.843545+0000","last_clean":"2024-09-21T06:46:38.843545+0000","last_became_active":"2024-09-21T06:46:38.834411+0000","last_became_peered":"2024-09-21T06:46:38.834411+0000","last_unstale":"2024-09-21T06:46:38.843545+0000","last_undegraded":"2024-09-21T06:46:38.843545+0000","last_fullsized":"2024-09-21T06:46:38.843545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829721+0000","last_change":"2024-09-21T06:46:37.822155+0000","last_active":"2024-09-21T06:46:38.829721+0000","last_peered":"2024-09-21T06:46:38.829721+0000","last_clean":"2024-09-21T06:46:38.829721+0000","last_became_active":"2024-09-21T06:46:37.821875+0000","last_became_peered":"2024-09-21T06:46:37.821875+0000","last_unstale":"2024-09-21T06:46:38.829721+0000","last_undegraded":"2024-09-21T06:46:38.829721+0000","last_fullsized":"2024-09-21T06:46:38.829721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:49.673120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.847439+0000","last_change":"2024-09-21T06:46:38.846296+0000","last_active":"2024-09-21T06:46:38.847439+0000","last_peered":"2024-09-21T06:46:38.847439+0000","last_clean":"2024-09-21T06:46:38.847439+0000","last_became_active":"2024-09-21T06:46:38.845939+0000","last_became_peered":"2024-09-21T06:46:38.845939+0000","last_unstale":"2024-09-21T06:46:38.847439+0000","last_undegraded":"2024-09-21T06:46:38.847439+0000","last_fullsized":"2024-09-21T06:46:38.847439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830182+0000","last_change":"2024-09-21T06:46:37.822030+0000","last_active":"2024-09-21T06:46:38.830182+0000","last_peered":"2024-09-21T06:46:38.830182+0000","last_clean":"2024-09-21T06:46:38.830182+0000","last_became_active":"2024-09-21T06:46:37.821713+0000","last_became_peered":"2024-09-21T06:46:37.821713+0000","last_unstale":"2024-09-21T06:46:38.830182+0000","last_undegraded":"2024-09-21T06:46:38.830182+0000","last_fullsized":"2024-09-21T06:46:38.830182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:12.386604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849053+0000","last_change":"2024-09-21T06:46:38.837242+0000","last_active":"2024-09-21T06:46:38.849053+0000","last_peered":"2024-09-21T06:46:38.849053+0000","last_clean":"2024-09-21T06:46:38.849053+0000","last_became_active":"2024-09-21T06:46:38.836884+0000","last_became_peered":"2024-09-21T06:46:38.836884+0000","last_unstale":"2024-09-21T06:46:38.849053+0000","last_undegraded":"2024-09-21T06:46:38.849053+0000","last_fullsized":"2024-09-21T06:46:38.849053+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:58.975876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859858+0000","last_change":"2024-09-21T06:46:37.824758+0000","last_active":"2024-09-21T06:46:38.859858+0000","last_peered":"2024-09-21T06:46:38.859858+0000","last_clean":"2024-09-21T06:46:38.859858+0000","last_became_active":"2024-09-21T06:46:37.824463+0000","last_became_peered":"2024-09-21T06:46:37.824463+0000","last_unstale":"2024-09-21T06:46:38.859858+0000","last_undegraded":"2024-09-21T06:46:38.859858+0000","last_fullsized":"2024-09-21T06:46:38.859858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:55.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843228+0000","last_change":"2024-09-21T06:46:38.837576+0000","last_active":"2024-09-21T06:46:38.843228+0000","last_peered":"2024-09-21T06:46:38.843228+0000","last_clean":"2024-09-21T06:46:38.843228+0000","last_became_active":"2024-09-21T06:46:38.837272+0000","last_became_peered":"2024-09-21T06:46:38.837272+0000","last_unstale":"2024-09-21T06:46:38.843228+0000","last_undegraded":"2024-09-21T06:46:38.843228+0000","last_fullsized":"2024-09-21T06:46:38.843228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828588+0000","last_change":"2024-09-21T06:46:37.826755+0000","last_active":"2024-09-21T06:46:37.828588+0000","last_peered":"2024-09-21T06:46:37.828588+0000","last_clean":"2024-09-21T06:46:37.828588+0000","last_became_active":"2024-09-21T06:46:37.826407+0000","last_became_peered":"2024-09-21T06:46:37.826407+0000","last_unstale":"2024-09-21T06:46:37.828588+0000","last_undegraded":"2024-09-21T06:46:37.828588+0000","last_fullsized":"2024-09-21T06:46:37.828588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:54.435622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843165+0000","last_change":"2024-09-21T06:46:38.834034+0000","last_active":"2024-09-21T06:46:38.843165+0000","last_peered":"2024-09-21T06:46:38.843165+0000","last_clean":"2024-09-21T06:46:38.843165+0000","last_became_active":"2024-09-21T06:46:38.833752+0000","last_became_peered":"2024-09-21T06:46:38.833752+0000","last_unstale":"2024-09-21T06:46:38.843165+0000","last_undegraded":"2024-09-21T06:46:38.843165+0000","last_fullsized":"2024-09-21T06:46:38.843165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:54.472336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.824284+0000","last_change":"2024-09-21T06:46:37.819283+0000","last_active":"2024-09-21T06:46:37.824284+0000","last_peered":"2024-09-21T06:46:37.824284+0000","last_clean":"2024-09-21T06:46:37.824284+0000","last_became_active":"2024-09-21T06:46:37.816729+0000","last_became_peered":"2024-09-21T06:46:37.816729+0000","last_unstale":"2024-09-21T06:46:37.824284+0000","last_undegraded":"2024-09-21T06:46:37.824284+0000","last_fullsized":"2024-09-21T06:46:37.824284+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:31.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816973+0000","last_change":"2024-09-21T06:46:37.816973+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816973+0000","last_undegraded":"2024-09-21T06:46:37.816973+0000","last_fullsized":"2024-09-21T06:46:37.816973+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.852111+0000","last_change":"2024-09-21T06:46:37.826066+0000","last_active":"2024-09-21T06:46:38.852111+0000","last_peered":"2024-09-21T06:46:38.852111+0000","last_clean":"2024-09-21T06:46:38.852111+0000","last_became_active":"2024-09-21T06:46:37.825751+0000","last_became_peered":"2024-09-21T06:46:37.825751+0000","last_unstale":"2024-09-21T06:46:38.852111+0000","last_undegraded":"2024-09-21T06:46:38.852111+0000","last_fullsized":"2024-09-21T06:46:38.852111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:19.603484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857622+0000","last_change":"2024-09-21T06:46:38.856673+0000","last_active":"2024-09-21T06:46:38.857622+0000","last_peered":"2024-09-21T06:46:38.857622+0000","last_clean":"2024-09-21T06:46:38.857622+0000","last_became_active":"2024-09-21T06:46:38.856179+0000","last_became_peered":"2024-09-21T06:46:38.856179+0000","last_unstale":"2024-09-21T06:46:38.857622+0000","last_undegraded":"2024-09-21T06:46:38.857622+0000","last_fullsized":"2024-09-21T06:46:38.857622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:35.199395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829453+0000","last_change":"2024-09-21T06:46:37.824783+0000","last_active":"2024-09-21T06:46:37.829453+0000","last_peered":"2024-09-21T06:46:37.829453+0000","last_clean":"2024-09-21T06:46:37.829453+0000","last_became_active":"2024-09-21T06:46:37.824308+0000","last_became_peered":"2024-09-21T06:46:37.824308+0000","last_unstale":"2024-09-21T06:46:37.829453+0000","last_undegraded":"2024-09-21T06:46:37.829453+0000","last_fullsized":"2024-09-21T06:46:37.829453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:34.680388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.850459+0000","last_change":"2024-09-21T06:46:38.847150+0000","last_active":"2024-09-21T06:46:38.850459+0000","last_peered":"2024-09-21T06:46:38.850459+0000","last_clean":"2024-09-21T06:46:38.850459+0000","last_became_active":"2024-09-21T06:46:38.846860+0000","last_became_peered":"2024-09-21T06:46:38.846860+0000","last_unstale":"2024-09-21T06:46:38.850459+0000","last_undegraded":"2024-09-21T06:46:38.850459+0000","last_fullsized":"2024-09-21T06:46:38.850459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830955+0000","last_change":"2024-09-21T06:46:37.827714+0000","last_active":"2024-09-21T06:46:37.830955+0000","last_peered":"2024-09-21T06:46:37.830955+0000","last_clean":"2024-09-21T06:46:37.830955+0000","last_became_active":"2024-09-21T06:46:37.826848+0000","last_became_peered":"2024-09-21T06:46:37.826848+0000","last_unstale":"2024-09-21T06:46:37.830955+0000","last_undegraded":"2024-09-21T06:46:37.830955+0000","last_fullsized":"2024-09-21T06:46:37.830955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:08.486901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812441+0000","last_change":"2024-09-21T06:46:37.812441+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812441+0000","last_undegraded":"2024-09-21T06:46:37.812441+0000","last_fullsized":"2024-09-21T06:46:37.812441+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828032+0000","last_change":"2024-09-21T06:46:37.817451+0000","last_active":"2024-09-21T06:46:37.828032+0000","last_peered":"2024-09-21T06:46:37.828032+0000","last_clean":"2024-09-21T06:46:37.828032+0000","last_became_active":"2024-09-21T06:46:37.816755+0000","last_became_peered":"2024-09-21T06:46:37.816755+0000","last_unstale":"2024-09-21T06:46:37.828032+0000","last_undegraded":"2024-09-21T06:46:37.828032+0000","last_fullsized":"2024-09-21T06:46:37.828032+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:09.214508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812272+0000","last_change":"2024-09-21T06:46:37.812272+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812272+0000","last_undegraded":"2024-09-21T06:46:37.812272+0000","last_fullsized":"2024-09-21T06:46:37.812272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833333+0000","last_change":"2024-09-21T06:46:37.826535+0000","last_active":"2024-09-21T06:46:38.833333+0000","last_peered":"2024-09-21T06:46:38.833333+0000","last_clean":"2024-09-21T06:46:38.833333+0000","last_became_active":"2024-09-21T06:46:37.825753+0000","last_became_peered":"2024-09-21T06:46:37.825753+0000","last_unstale":"2024-09-21T06:46:38.833333+0000","last_undegraded":"2024-09-21T06:46:38.833333+0000","last_fullsized":"2024-09-21T06:46:38.833333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843260+0000","last_change":"2024-09-21T06:46:38.838456+0000","last_active":"2024-09-21T06:46:38.843260+0000","last_peered":"2024-09-21T06:46:38.843260+0000","last_clean":"2024-09-21T06:46:38.843260+0000","last_became_active":"2024-09-21T06:46:38.838138+0000","last_became_peered":"2024-09-21T06:46:38.838138+0000","last_unstale":"2024-09-21T06:46:38.843260+0000","last_undegraded":"2024-09-21T06:46:38.843260+0000","last_fullsized":"2024-09-21T06:46:38.843260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833479+0000","last_change":"2024-09-21T06:46:37.828361+0000","last_active":"2024-09-21T06:46:37.833479+0000","last_peered":"2024-09-21T06:46:37.833479+0000","last_clean":"2024-09-21T06:46:37.833479+0000","last_became_active":"2024-09-21T06:46:37.828053+0000","last_became_peered":"2024-09-21T06:46:37.828053+0000","last_unstale":"2024-09-21T06:46:37.833479+0000","last_undegraded":"2024-09-21T06:46:37.833479+0000","last_fullsized":"2024-09-21T06:46:37.833479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:55.015218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843192+0000","last_change":"2024-09-21T06:46:38.835519+0000","last_active":"2024-09-21T06:46:38.843192+0000","last_peered":"2024-09-21T06:46:38.843192+0000","last_clean":"2024-09-21T06:46:38.843192+0000","last_became_active":"2024-09-21T06:46:38.835226+0000","last_became_peered":"2024-09-21T06:46:38.835226+0000","last_unstale":"2024-09-21T06:46:38.843192+0000","last_undegraded":"2024-09-21T06:46:38.843192+0000","last_fullsized":"2024-09-21T06:46:38.843192+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833812+0000","last_change":"2024-09-21T06:46:37.828386+0000","last_active":"2024-09-21T06:46:37.833812+0000","last_peered":"2024-09-21T06:46:37.833812+0000","last_clean":"2024-09-21T06:46:37.833812+0000","last_became_active":"2024-09-21T06:46:37.827795+0000","last_became_peered":"2024-09-21T06:46:37.827795+0000","last_unstale":"2024-09-21T06:46:37.833812+0000","last_undegraded":"2024-09-21T06:46:37.833812+0000","last_fullsized":"2024-09-21T06:46:37.833812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:17.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815592+0000","last_change":"2024-09-21T06:46:37.815592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815592+0000","last_undegraded":"2024-09-21T06:46:37.815592+0000","last_fullsized":"2024-09-21T06:46:37.815592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831398+0000","last_change":"2024-09-21T06:46:37.828721+0000","last_active":"2024-09-21T06:46:38.831398+0000","last_peered":"2024-09-21T06:46:38.831398+0000","last_clean":"2024-09-21T06:46:38.831398+0000","last_became_active":"2024-09-21T06:46:37.827838+0000","last_became_peered":"2024-09-21T06:46:37.827838+0000","last_unstale":"2024-09-21T06:46:38.831398+0000","last_undegraded":"2024-09-21T06:46:38.831398+0000","last_fullsized":"2024-09-21T06:46:38.831398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:34.881390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811128+0000","last_change":"2024-09-21T06:46:37.811128+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811128+0000","last_undegraded":"2024-09-21T06:46:37.811128+0000","last_fullsized":"2024-09-21T06:46:37.811128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.824899+0000","last_change":"2024-09-21T06:46:37.828979+0000","last_active":"2024-09-21T06:46:38.824899+0000","last_peered":"2024-09-21T06:46:38.824899+0000","last_clean":"2024-09-21T06:46:38.824899+0000","last_became_active":"2024-09-21T06:46:37.827049+0000","last_became_peered":"2024-09-21T06:46:37.827049+0000","last_unstale":"2024-09-21T06:46:38.824899+0000","last_undegraded":"2024-09-21T06:46:38.824899+0000","last_fullsized":"2024-09-21T06:46:38.824899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:41.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813704+0000","last_change":"2024-09-21T06:46:37.813704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813704+0000","last_undegraded":"2024-09-21T06:46:37.813704+0000","last_fullsized":"2024-09-21T06:46:37.813704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828898+0000","last_change":"2024-09-21T06:46:37.824970+0000","last_active":"2024-09-21T06:46:37.828898+0000","last_peered":"2024-09-21T06:46:37.828898+0000","last_clean":"2024-09-21T06:46:37.828898+0000","last_became_active":"2024-09-21T06:46:37.824677+0000","last_became_peered":"2024-09-21T06:46:37.824677+0000","last_unstale":"2024-09-21T06:46:37.828898+0000","last_undegraded":"2024-09-21T06:46:37.828898+0000","last_fullsized":"2024-09-21T06:46:37.828898+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:05.066114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851514+0000","last_change":"2024-09-21T06:46:38.845165+0000","last_active":"2024-09-21T06:46:38.851514+0000","last_peered":"2024-09-21T06:46:38.851514+0000","last_clean":"2024-09-21T06:46:38.851514+0000","last_became_active":"2024-09-21T06:46:38.844715+0000","last_became_peered":"2024-09-21T06:46:38.844715+0000","last_unstale":"2024-09-21T06:46:38.851514+0000","last_undegraded":"2024-09-21T06:46:38.851514+0000","last_fullsized":"2024-09-21T06:46:38.851514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:34.402844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.825098+0000","last_change":"2024-09-21T06:46:37.824613+0000","last_active":"2024-09-21T06:46:38.825098+0000","last_peered":"2024-09-21T06:46:38.825098+0000","last_clean":"2024-09-21T06:46:38.825098+0000","last_became_active":"2024-09-21T06:46:37.824302+0000","last_became_peered":"2024-09-21T06:46:37.824302+0000","last_unstale":"2024-09-21T06:46:38.825098+0000","last_undegraded":"2024-09-21T06:46:38.825098+0000","last_fullsized":"2024-09-21T06:46:38.825098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:57.477737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810322+0000","last_change":"2024-09-21T06:46:37.810322+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810322+0000","last_undegraded":"2024-09-21T06:46:37.810322+0000","last_fullsized":"2024-09-21T06:46:37.810322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.823443+0000","last_change":"2024-09-21T06:46:37.821964+0000","last_active":"2024-09-21T06:46:37.823443+0000","last_peered":"2024-09-21T06:46:37.823443+0000","last_clean":"2024-09-21T06:46:37.823443+0000","last_became_active":"2024-09-21T06:46:37.821664+0000","last_became_peered":"2024-09-21T06:46:37.821664+0000","last_unstale":"2024-09-21T06:46:37.823443+0000","last_undegraded":"2024-09-21T06:46:37.823443+0000","last_fullsized":"2024-09-21T06:46:37.823443+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:47.227494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814544+0000","last_change":"2024-09-21T06:46:37.814544+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814544+0000","last_undegraded":"2024-09-21T06:46:37.814544+0000","last_fullsized":"2024-09-21T06:46:37.814544+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829366+0000","last_change":"2024-09-21T06:46:37.821294+0000","last_active":"2024-09-21T06:46:37.829366+0000","last_peered":"2024-09-21T06:46:37.829366+0000","last_clean":"2024-09-21T06:46:37.829366+0000","last_became_active":"2024-09-21T06:46:37.820623+0000","last_became_peered":"2024-09-21T06:46:37.820623+0000","last_unstale":"2024-09-21T06:46:37.829366+0000","last_undegraded":"2024-09-21T06:46:37.829366+0000","last_fullsized":"2024-09-21T06:46:37.829366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:15.971706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811935+0000","last_change":"2024-09-21T06:46:37.811935+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811935+0000","last_undegraded":"2024-09-21T06:46:37.811935+0000","last_fullsized":"2024-09-21T06:46:37.811935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831642+0000","last_change":"2024-09-21T06:46:37.829723+0000","last_active":"2024-09-21T06:46:38.831642+0000","last_peered":"2024-09-21T06:46:38.831642+0000","last_clean":"2024-09-21T06:46:38.831642+0000","last_became_active":"2024-09-21T06:46:37.829452+0000","last_became_peered":"2024-09-21T06:46:37.829452+0000","last_unstale":"2024-09-21T06:46:38.831642+0000","last_undegraded":"2024-09-21T06:46:38.831642+0000","last_fullsized":"2024-09-21T06:46:38.831642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.342847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":166,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833441+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:38.833441+0000","last_peered":"2024-09-21T06:46:38.833441+0000","last_clean":"2024-09-21T06:46:38.833441+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:38.833441+0000","last_undegraded":"2024-09-21T06:46:38.833441+0000","last_fullsized":"2024-09-21T06:46:38.833441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":4056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:43.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:43.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 -- 172.21.15.81:0/3252235223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f815e0b0 msgr2=0x7f20f815e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 --2- 172.21.15.81:0/3252235223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f815e0b0 0x7f20f815e4c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f20f80d1030 tx=0x7f20f002a890 comp rx=0 tx=0).stop 2024-09-21T06:46:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 -- 172.21.15.81:0/3252235223 shutdown_connections 2024-09-21T06:46:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 --2- 172.21.15.81:0/3252235223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f815e0b0 0x7f20f815e4c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 --2- 172.21.15.81:0/3252235223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80d1a50 0x7f20f815d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 -- 172.21.15.81:0/3252235223 >> 172.21.15.81:0/3252235223 conn(0x7f20f80b4210 msgr2=0x7f20f80b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 -- 172.21.15.81:0/3252235223 shutdown_connections 2024-09-21T06:46:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.348+0000 7f20ff141640 1 -- 172.21.15.81:0/3252235223 wait complete. 2024-09-21T06:46:43.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.350+0000 7f20ff141640 1 Processor -- start 2024-09-21T06:46:43.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.350+0000 7f20ff141640 1 -- start start 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.351+0000 7f20ff141640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f80cfda0 0x7f20f80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20ff141640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f815e0b0 0x7f20f815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20ff141640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f806f860 0x7f20f815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20ff141640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20f815ed90 con 0x7f20f80cfda0 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20ff141640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f20f815ec10 con 0x7f20f815e0b0 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20ff141640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f20f815ef10 con 0x7f20f806f860 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f80cfda0 0x7f20f80cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f80cfda0 0x7f20f80cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58340/0 (socket says 172.21.15.81:58340) 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 -- 172.21.15.81:0/418482093 learned_addr learned my addr 172.21.15.81:0/418482093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 -- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f806f860 msgr2=0x7f20f815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fd6de640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f806f860 0x7f20f815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f806f860 0x7f20f815bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20f7fff640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f815e0b0 0x7f20f815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 -- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f815e0b0 msgr2=0x7f20f815b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f815e0b0 0x7f20f815b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 -- 172.21.15.81:0/418482093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f80c6d50 con 0x7f20f80cfda0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20fcedd640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f80cfda0 0x7f20f80cc1d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c430 tx=0x7f20e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20f57fa640 1 -- 172.21.15.81:0/418482093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8011790 con 0x7f20f80cfda0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20f57fa640 1 -- 172.21.15.81:0/418482093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20e8017070 con 0x7f20f80cfda0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f80c6ff0 con 0x7f20f80cfda0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20f57fa640 1 -- 172.21.15.81:0/418482093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e8011ce0 con 0x7f20f80cfda0 2024-09-21T06:46:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.352+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f80c72b0 con 0x7f20f80cfda0 2024-09-21T06:46:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.353+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f815d730 con 0x7f20f80cfda0 2024-09-21T06:46:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.354+0000 7f20f57fa640 1 -- 172.21.15.81:0/418482093 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20e801c460 con 0x7f20f80cfda0 2024-09-21T06:46:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.355+0000 7f20f57fa640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f20d8078b90 0x7f20d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.355+0000 7f20f57fa640 1 -- 172.21.15.81:0/418482093 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f20e809ad60 con 0x7f20f80cfda0 2024-09-21T06:46:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.355+0000 7f20f7fff640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f20d8078b90 0x7f20d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.355+0000 7f20f7fff640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f20d8078b90 0x7f20d807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20f81f6370 tx=0x7f20e0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.359+0000 7f20f57fa640 1 -- 172.21.15.81:0/418482093 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f20e8063010 con 0x7f20f80cfda0 2024-09-21T06:46:43.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.532+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20f81f8880 con 0x7f20d8078b90 2024-09-21T06:46:43.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.537+0000 7f20f57fa640 1 -- 172.21.15.81:0/418482093 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249067 (secure 0 0 0) 0x7f20f81f8880 con 0x7f20d8078b90 2024-09-21T06:46:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:43.542 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f20d8078b90 msgr2=0x7f20d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f20d8078b90 0x7f20d807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20f81f6370 tx=0x7f20e0005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f80cfda0 msgr2=0x7f20f80cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f80cfda0 0x7f20f80cc1d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f20e800c430 tx=0x7f20e800c8f0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 shutdown_connections 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f20d8078b90 0x7f20d807b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f806f860 0x7f20f815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f815e0b0 0x7f20f815b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 --2- 172.21.15.81:0/418482093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20f80cfda0 0x7f20f80cc1d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 >> 172.21.15.81:0/418482093 conn(0x7f20f80b4210 msgr2=0x7f20f8156630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 shutdown_connections 2024-09-21T06:46:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.540+0000 7f20ff141640 1 -- 172.21.15.81:0/418482093 wait complete. 2024-09-21T06:46:43.553 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-21T06:46:42.673269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592140,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":127,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222116,"kb_used_data":5840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752604,"statfs":{"total":773094113280,"available":772866666496,"internally_reserved":0,"allocated":5980160,"data_stored":3277858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868427"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.819428+0000","last_change":"2024-09-21T06:46:37.819428+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.819428+0000","last_undegraded":"2024-09-21T06:46:37.819428+0000","last_fullsized":"2024-09-21T06:46:37.819428+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815734+0000","last_change":"2024-09-21T06:46:37.815734+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815734+0000","last_undegraded":"2024-09-21T06:46:37.815734+0000","last_fullsized":"2024-09-21T06:46:37.815734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844525+0000","last_change":"2024-09-21T06:46:38.836247+0000","last_active":"2024-09-21T06:46:38.844525+0000","last_peered":"2024-09-21T06:46:38.844525+0000","last_clean":"2024-09-21T06:46:38.844525+0000","last_became_active":"2024-09-21T06:46:38.835897+0000","last_became_peered":"2024-09-21T06:46:38.835897+0000","last_unstale":"2024-09-21T06:46:38.844525+0000","last_undegraded":"2024-09-21T06:46:38.844525+0000","last_fullsized":"2024-09-21T06:46:38.844525+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849825+0000","last_change":"2024-09-21T06:46:38.844482+0000","last_active":"2024-09-21T06:46:38.849825+0000","last_peered":"2024-09-21T06:46:38.849825+0000","last_clean":"2024-09-21T06:46:38.849825+0000","last_became_active":"2024-09-21T06:46:38.844161+0000","last_became_peered":"2024-09-21T06:46:38.844161+0000","last_unstale":"2024-09-21T06:46:38.849825+0000","last_undegraded":"2024-09-21T06:46:38.849825+0000","last_fullsized":"2024-09-21T06:46:38.849825+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:54.933768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.821160+0000","last_change":"2024-09-21T06:46:37.821160+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.821160+0000","last_undegraded":"2024-09-21T06:46:37.821160+0000","last_fullsized":"2024-09-21T06:46:37.821160+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820842+0000","last_change":"2024-09-21T06:46:37.820842+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820842+0000","last_undegraded":"2024-09-21T06:46:37.820842+0000","last_fullsized":"2024-09-21T06:46:37.820842+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849083+0000","last_change":"2024-09-21T06:46:38.837455+0000","last_active":"2024-09-21T06:46:38.849083+0000","last_peered":"2024-09-21T06:46:38.849083+0000","last_clean":"2024-09-21T06:46:38.849083+0000","last_became_active":"2024-09-21T06:46:38.837170+0000","last_became_peered":"2024-09-21T06:46:38.837170+0000","last_unstale":"2024-09-21T06:46:38.849083+0000","last_undegraded":"2024-09-21T06:46:38.849083+0000","last_fullsized":"2024-09-21T06:46:38.849083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:20.986258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820035+0000","last_change":"2024-09-21T06:46:37.820035+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820035+0000","last_undegraded":"2024-09-21T06:46:37.820035+0000","last_fullsized":"2024-09-21T06:46:37.820035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859845+0000","last_change":"2024-09-21T06:46:38.856546+0000","last_active":"2024-09-21T06:46:38.859845+0000","last_peered":"2024-09-21T06:46:38.859845+0000","last_clean":"2024-09-21T06:46:38.859845+0000","last_became_active":"2024-09-21T06:46:38.856240+0000","last_became_peered":"2024-09-21T06:46:38.856240+0000","last_unstale":"2024-09-21T06:46:38.859845+0000","last_undegraded":"2024-09-21T06:46:38.859845+0000","last_fullsized":"2024-09-21T06:46:38.859845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:12.306047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.822086+0000","last_change":"2024-09-21T06:46:37.822086+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.822086+0000","last_undegraded":"2024-09-21T06:46:37.822086+0000","last_fullsized":"2024-09-21T06:46:37.822086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810180+0000","last_change":"2024-09-21T06:46:37.810180+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810180+0000","last_undegraded":"2024-09-21T06:46:37.810180+0000","last_fullsized":"2024-09-21T06:46:37.810180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843454+0000","last_change":"2024-09-21T06:46:38.840765+0000","last_active":"2024-09-21T06:46:38.843454+0000","last_peered":"2024-09-21T06:46:38.843454+0000","last_clean":"2024-09-21T06:46:38.843454+0000","last_became_active":"2024-09-21T06:46:38.840430+0000","last_became_peered":"2024-09-21T06:46:38.840430+0000","last_unstale":"2024-09-21T06:46:38.843454+0000","last_undegraded":"2024-09-21T06:46:38.843454+0000","last_fullsized":"2024-09-21T06:46:38.843454+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851481+0000","last_change":"2024-09-21T06:46:38.844070+0000","last_active":"2024-09-21T06:46:38.851481+0000","last_peered":"2024-09-21T06:46:38.851481+0000","last_clean":"2024-09-21T06:46:38.851481+0000","last_became_active":"2024-09-21T06:46:38.843603+0000","last_became_peered":"2024-09-21T06:46:38.843603+0000","last_unstale":"2024-09-21T06:46:38.851481+0000","last_undegraded":"2024-09-21T06:46:38.851481+0000","last_fullsized":"2024-09-21T06:46:38.851481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:38.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.842407+0000","last_change":"2024-09-21T06:46:38.832845+0000","last_active":"2024-09-21T06:46:38.842407+0000","last_peered":"2024-09-21T06:46:38.842407+0000","last_clean":"2024-09-21T06:46:38.842407+0000","last_became_active":"2024-09-21T06:46:38.832523+0000","last_became_peered":"2024-09-21T06:46:38.832523+0000","last_unstale":"2024-09-21T06:46:38.842407+0000","last_undegraded":"2024-09-21T06:46:38.842407+0000","last_fullsized":"2024-09-21T06:46:38.842407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:27.403557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851351+0000","last_change":"2024-09-21T06:46:38.845822+0000","last_active":"2024-09-21T06:46:38.851351+0000","last_peered":"2024-09-21T06:46:38.851351+0000","last_clean":"2024-09-21T06:46:38.851351+0000","last_became_active":"2024-09-21T06:46:38.845446+0000","last_became_peered":"2024-09-21T06:46:38.845446+0000","last_unstale":"2024-09-21T06:46:38.851351+0000","last_undegraded":"2024-09-21T06:46:38.851351+0000","last_fullsized":"2024-09-21T06:46:38.851351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:56.261429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813254+0000","last_change":"2024-09-21T06:46:37.813254+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813254+0000","last_undegraded":"2024-09-21T06:46:37.813254+0000","last_fullsized":"2024-09-21T06:46:37.813254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815082+0000","last_change":"2024-09-21T06:46:37.815082+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815082+0000","last_undegraded":"2024-09-21T06:46:37.815082+0000","last_fullsized":"2024-09-21T06:46:37.815082+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844151+0000","last_change":"2024-09-21T06:46:38.841494+0000","last_active":"2024-09-21T06:46:38.844151+0000","last_peered":"2024-09-21T06:46:38.844151+0000","last_clean":"2024-09-21T06:46:38.844151+0000","last_became_active":"2024-09-21T06:46:38.841161+0000","last_became_peered":"2024-09-21T06:46:38.841161+0000","last_unstale":"2024-09-21T06:46:38.844151+0000","last_undegraded":"2024-09-21T06:46:38.844151+0000","last_fullsized":"2024-09-21T06:46:38.844151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:47.348432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816299+0000","last_change":"2024-09-21T06:46:37.816299+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816299+0000","last_undegraded":"2024-09-21T06:46:37.816299+0000","last_fullsized":"2024-09-21T06:46:37.816299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809496+0000","last_change":"2024-09-21T06:46:37.809496+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809496+0000","last_undegraded":"2024-09-21T06:46:37.809496+0000","last_fullsized":"2024-09-21T06:46:37.809496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851499+0000","last_change":"2024-09-21T06:46:38.844395+0000","last_active":"2024-09-21T06:46:38.851499+0000","last_peered":"2024-09-21T06:46:38.851499+0000","last_clean":"2024-09-21T06:46:38.851499+0000","last_became_active":"2024-09-21T06:46:38.844030+0000","last_became_peered":"2024-09-21T06:46:38.844030+0000","last_unstale":"2024-09-21T06:46:38.851499+0000","last_undegraded":"2024-09-21T06:46:38.851499+0000","last_fullsized":"2024-09-21T06:46:38.851499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:18.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809041+0000","last_change":"2024-09-21T06:46:37.809041+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809041+0000","last_undegraded":"2024-09-21T06:46:37.809041+0000","last_fullsized":"2024-09-21T06:46:37.809041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849108+0000","last_change":"2024-09-21T06:46:38.838558+0000","last_active":"2024-09-21T06:46:38.849108+0000","last_peered":"2024-09-21T06:46:38.849108+0000","last_clean":"2024-09-21T06:46:38.849108+0000","last_became_active":"2024-09-21T06:46:38.838256+0000","last_became_peered":"2024-09-21T06:46:38.838256+0000","last_unstale":"2024-09-21T06:46:38.849108+0000","last_undegraded":"2024-09-21T06:46:38.849108+0000","last_fullsized":"2024-09-21T06:46:38.849108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:37.987203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859870+0000","last_change":"2024-09-21T06:46:38.856520+0000","last_active":"2024-09-21T06:46:38.859870+0000","last_peered":"2024-09-21T06:46:38.859870+0000","last_clean":"2024-09-21T06:46:38.859870+0000","last_became_active":"2024-09-21T06:46:38.856171+0000","last_became_peered":"2024-09-21T06:46:38.856171+0000","last_unstale":"2024-09-21T06:46:38.859870+0000","last_undegraded":"2024-09-21T06:46:38.859870+0000","last_fullsized":"2024-09-21T06:46:38.859870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815856+0000","last_change":"2024-09-21T06:46:37.815856+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815856+0000","last_undegraded":"2024-09-21T06:46:37.815856+0000","last_fullsized":"2024-09-21T06:46:37.815856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.838885+0000","last_change":"2024-09-21T06:46:38.836327+0000","last_active":"2024-09-21T06:46:38.838885+0000","last_peered":"2024-09-21T06:46:38.838885+0000","last_clean":"2024-09-21T06:46:38.838885+0000","last_became_active":"2024-09-21T06:46:38.836032+0000","last_became_peered":"2024-09-21T06:46:38.836032+0000","last_unstale":"2024-09-21T06:46:38.838885+0000","last_undegraded":"2024-09-21T06:46:38.838885+0000","last_fullsized":"2024-09-21T06:46:38.838885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:46.918012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815262+0000","last_change":"2024-09-21T06:46:37.815262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815262+0000","last_undegraded":"2024-09-21T06:46:37.815262+0000","last_fullsized":"2024-09-21T06:46:37.815262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817360+0000","last_change":"2024-09-21T06:46:37.817360+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817360+0000","last_undegraded":"2024-09-21T06:46:37.817360+0000","last_fullsized":"2024-09-21T06:46:37.817360+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817262+0000","last_change":"2024-09-21T06:46:37.817262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817262+0000","last_undegraded":"2024-09-21T06:46:37.817262+0000","last_fullsized":"2024-09-21T06:46:37.817262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848749+0000","last_change":"2024-09-21T06:46:38.839817+0000","last_active":"2024-09-21T06:46:38.848749+0000","last_peered":"2024-09-21T06:46:38.848749+0000","last_clean":"2024-09-21T06:46:38.848749+0000","last_became_active":"2024-09-21T06:46:38.839497+0000","last_became_peered":"2024-09-21T06:46:38.839497+0000","last_unstale":"2024-09-21T06:46:38.848749+0000","last_undegraded":"2024-09-21T06:46:38.848749+0000","last_fullsized":"2024-09-21T06:46:38.848749+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:24.677702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815387+0000","last_change":"2024-09-21T06:46:37.815387+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815387+0000","last_undegraded":"2024-09-21T06:46:37.815387+0000","last_fullsized":"2024-09-21T06:46:37.815387+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809740+0000","last_change":"2024-09-21T06:46:37.809740+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809740+0000","last_undegraded":"2024-09-21T06:46:37.809740+0000","last_fullsized":"2024-09-21T06:46:37.809740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820704+0000","last_change":"2024-09-21T06:46:37.820704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820704+0000","last_undegraded":"2024-09-21T06:46:37.820704+0000","last_fullsized":"2024-09-21T06:46:37.820704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828350+0000","last_change":"2024-09-21T06:46:37.822060+0000","last_active":"2024-09-21T06:46:37.828350+0000","last_peered":"2024-09-21T06:46:37.828350+0000","last_clean":"2024-09-21T06:46:37.828350+0000","last_became_active":"2024-09-21T06:46:37.821749+0000","last_became_peered":"2024-09-21T06:46:37.821749+0000","last_unstale":"2024-09-21T06:46:37.828350+0000","last_undegraded":"2024-09-21T06:46:37.828350+0000","last_fullsized":"2024-09-21T06:46:37.828350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:33.823939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814559+0000","last_change":"2024-09-21T06:46:37.814559+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814559+0000","last_undegraded":"2024-09-21T06:46:37.814559+0000","last_fullsized":"2024-09-21T06:46:37.814559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828981+0000","last_change":"2024-09-21T06:46:37.825639+0000","last_active":"2024-09-21T06:46:37.828981+0000","last_peered":"2024-09-21T06:46:37.828981+0000","last_clean":"2024-09-21T06:46:37.828981+0000","last_became_active":"2024-09-21T06:46:37.825329+0000","last_became_peered":"2024-09-21T06:46:37.825329+0000","last_unstale":"2024-09-21T06:46:37.828981+0000","last_undegraded":"2024-09-21T06:46:37.828981+0000","last_fullsized":"2024-09-21T06:46:37.828981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816631+0000","last_change":"2024-09-21T06:46:37.816631+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816631+0000","last_undegraded":"2024-09-21T06:46:37.816631+0000","last_fullsized":"2024-09-21T06:46:37.816631+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833801+0000","last_change":"2024-09-21T06:46:37.827885+0000","last_active":"2024-09-21T06:46:37.833801+0000","last_peered":"2024-09-21T06:46:37.833801+0000","last_clean":"2024-09-21T06:46:37.833801+0000","last_became_active":"2024-09-21T06:46:37.827560+0000","last_became_peered":"2024-09-21T06:46:37.827560+0000","last_unstale":"2024-09-21T06:46:37.833801+0000","last_undegraded":"2024-09-21T06:46:37.833801+0000","last_fullsized":"2024-09-21T06:46:37.833801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:28.522713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813990+0000","last_change":"2024-09-21T06:46:37.813990+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813990+0000","last_undegraded":"2024-09-21T06:46:37.813990+0000","last_fullsized":"2024-09-21T06:46:37.813990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857526+0000","last_change":"2024-09-21T06:46:37.827573+0000","last_active":"2024-09-21T06:46:38.857526+0000","last_peered":"2024-09-21T06:46:38.857526+0000","last_clean":"2024-09-21T06:46:38.857526+0000","last_became_active":"2024-09-21T06:46:37.827205+0000","last_became_peered":"2024-09-21T06:46:37.827205+0000","last_unstale":"2024-09-21T06:46:38.857526+0000","last_undegraded":"2024-09-21T06:46:38.857526+0000","last_fullsized":"2024-09-21T06:46:38.857526+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:44.653930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812592+0000","last_change":"2024-09-21T06:46:37.812592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812592+0000","last_undegraded":"2024-09-21T06:46:37.812592+0000","last_fullsized":"2024-09-21T06:46:37.812592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851676+0000","last_change":"2024-09-21T06:46:37.829136+0000","last_active":"2024-09-21T06:46:38.851676+0000","last_peered":"2024-09-21T06:46:38.851676+0000","last_clean":"2024-09-21T06:46:38.851676+0000","last_became_active":"2024-09-21T06:46:37.828745+0000","last_became_peered":"2024-09-21T06:46:37.828745+0000","last_unstale":"2024-09-21T06:46:38.851676+0000","last_undegraded":"2024-09-21T06:46:38.851676+0000","last_fullsized":"2024-09-21T06:46:38.851676+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:32.045906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809538+0000","last_change":"2024-09-21T06:46:37.809538+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809538+0000","last_undegraded":"2024-09-21T06:46:37.809538+0000","last_fullsized":"2024-09-21T06:46:37.809538+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833769+0000","last_change":"2024-09-21T06:46:37.826987+0000","last_active":"2024-09-21T06:46:37.833769+0000","last_peered":"2024-09-21T06:46:37.833769+0000","last_clean":"2024-09-21T06:46:37.833769+0000","last_became_active":"2024-09-21T06:46:37.826675+0000","last_became_peered":"2024-09-21T06:46:37.826675+0000","last_unstale":"2024-09-21T06:46:37.833769+0000","last_undegraded":"2024-09-21T06:46:37.833769+0000","last_fullsized":"2024-09-21T06:46:37.833769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:00.728251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848403+0000","last_change":"2024-09-21T06:46:38.843367+0000","last_active":"2024-09-21T06:46:38.848403+0000","last_peered":"2024-09-21T06:46:38.848403+0000","last_clean":"2024-09-21T06:46:38.848403+0000","last_became_active":"2024-09-21T06:46:38.842758+0000","last_became_peered":"2024-09-21T06:46:38.842758+0000","last_unstale":"2024-09-21T06:46:38.848403+0000","last_undegraded":"2024-09-21T06:46:38.848403+0000","last_fullsized":"2024-09-21T06:46:38.848403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:49.726045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829337+0000","last_change":"2024-09-21T06:46:37.822573+0000","last_active":"2024-09-21T06:46:38.829337+0000","last_peered":"2024-09-21T06:46:38.829337+0000","last_clean":"2024-09-21T06:46:38.829337+0000","last_became_active":"2024-09-21T06:46:37.822248+0000","last_became_peered":"2024-09-21T06:46:37.822248+0000","last_unstale":"2024-09-21T06:46:38.829337+0000","last_undegraded":"2024-09-21T06:46:38.829337+0000","last_fullsized":"2024-09-21T06:46:38.829337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:47.124858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813565+0000","last_change":"2024-09-21T06:46:37.813565+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813565+0000","last_undegraded":"2024-09-21T06:46:37.813565+0000","last_fullsized":"2024-09-21T06:46:37.813565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833890+0000","last_change":"2024-09-21T06:46:37.821564+0000","last_active":"2024-09-21T06:46:38.833890+0000","last_peered":"2024-09-21T06:46:38.833890+0000","last_clean":"2024-09-21T06:46:38.833890+0000","last_became_active":"2024-09-21T06:46:37.821236+0000","last_became_peered":"2024-09-21T06:46:37.821236+0000","last_unstale":"2024-09-21T06:46:38.833890+0000","last_undegraded":"2024-09-21T06:46:38.833890+0000","last_fullsized":"2024-09-21T06:46:38.833890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:48.720460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.836742+0000","last_change":"2024-09-21T06:46:38.835282+0000","last_active":"2024-09-21T06:46:38.836742+0000","last_peered":"2024-09-21T06:46:38.836742+0000","last_clean":"2024-09-21T06:46:38.836742+0000","last_became_active":"2024-09-21T06:46:38.834952+0000","last_became_peered":"2024-09-21T06:46:38.834952+0000","last_unstale":"2024-09-21T06:46:38.836742+0000","last_undegraded":"2024-09-21T06:46:38.836742+0000","last_fullsized":"2024-09-21T06:46:38.836742+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:32.211076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830074+0000","last_change":"2024-09-21T06:46:37.825931+0000","last_active":"2024-09-21T06:46:38.830074+0000","last_peered":"2024-09-21T06:46:38.830074+0000","last_clean":"2024-09-21T06:46:38.830074+0000","last_became_active":"2024-09-21T06:46:37.825590+0000","last_became_peered":"2024-09-21T06:46:37.825590+0000","last_unstale":"2024-09-21T06:46:38.830074+0000","last_undegraded":"2024-09-21T06:46:38.830074+0000","last_fullsized":"2024-09-21T06:46:38.830074+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:26.397972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843137+0000","last_change":"2024-09-21T06:46:38.833931+0000","last_active":"2024-09-21T06:46:38.843137+0000","last_peered":"2024-09-21T06:46:38.843137+0000","last_clean":"2024-09-21T06:46:38.843137+0000","last_became_active":"2024-09-21T06:46:38.833613+0000","last_became_peered":"2024-09-21T06:46:38.833613+0000","last_unstale":"2024-09-21T06:46:38.843137+0000","last_undegraded":"2024-09-21T06:46:38.843137+0000","last_fullsized":"2024-09-21T06:46:38.843137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:35.886975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.826471+0000","last_change":"2024-09-21T06:46:37.819621+0000","last_active":"2024-09-21T06:46:37.826471+0000","last_peered":"2024-09-21T06:46:37.826471+0000","last_clean":"2024-09-21T06:46:37.826471+0000","last_became_active":"2024-09-21T06:46:37.817183+0000","last_became_peered":"2024-09-21T06:46:37.817183+0000","last_unstale":"2024-09-21T06:46:37.826471+0000","last_undegraded":"2024-09-21T06:46:37.826471+0000","last_fullsized":"2024-09-21T06:46:37.826471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:45.747826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815758+0000","last_change":"2024-09-21T06:46:37.815758+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815758+0000","last_undegraded":"2024-09-21T06:46:37.815758+0000","last_fullsized":"2024-09-21T06:46:37.815758+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.858068+0000","last_change":"2024-09-21T06:46:37.827697+0000","last_active":"2024-09-21T06:46:38.858068+0000","last_peered":"2024-09-21T06:46:38.858068+0000","last_clean":"2024-09-21T06:46:38.858068+0000","last_became_active":"2024-09-21T06:46:37.827400+0000","last_became_peered":"2024-09-21T06:46:37.827400+0000","last_unstale":"2024-09-21T06:46:38.858068+0000","last_undegraded":"2024-09-21T06:46:38.858068+0000","last_fullsized":"2024-09-21T06:46:38.858068+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:15.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849133+0000","last_change":"2024-09-21T06:46:38.836804+0000","last_active":"2024-09-21T06:46:38.849133+0000","last_peered":"2024-09-21T06:46:38.849133+0000","last_clean":"2024-09-21T06:46:38.849133+0000","last_became_active":"2024-09-21T06:46:38.836503+0000","last_became_peered":"2024-09-21T06:46:38.836503+0000","last_unstale":"2024-09-21T06:46:38.849133+0000","last_undegraded":"2024-09-21T06:46:38.849133+0000","last_fullsized":"2024-09-21T06:46:38.849133+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:42.432169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.861597+0000","last_change":"2024-09-21T06:46:37.827650+0000","last_active":"2024-09-21T06:46:38.861597+0000","last_peered":"2024-09-21T06:46:38.861597+0000","last_clean":"2024-09-21T06:46:38.861597+0000","last_became_active":"2024-09-21T06:46:37.827332+0000","last_became_peered":"2024-09-21T06:46:37.827332+0000","last_unstale":"2024-09-21T06:46:38.861597+0000","last_undegraded":"2024-09-21T06:46:38.861597+0000","last_fullsized":"2024-09-21T06:46:38.861597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:01.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843682+0000","last_change":"2024-09-21T06:46:38.841487+0000","last_active":"2024-09-21T06:46:38.843682+0000","last_peered":"2024-09-21T06:46:38.843682+0000","last_clean":"2024-09-21T06:46:38.843682+0000","last_became_active":"2024-09-21T06:46:38.840274+0000","last_became_peered":"2024-09-21T06:46:38.840274+0000","last_unstale":"2024-09-21T06:46:38.843682+0000","last_undegraded":"2024-09-21T06:46:38.843682+0000","last_fullsized":"2024-09-21T06:46:38.843682+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830508+0000","last_change":"2024-09-21T06:46:37.827132+0000","last_active":"2024-09-21T06:46:37.830508+0000","last_peered":"2024-09-21T06:46:37.830508+0000","last_clean":"2024-09-21T06:46:37.830508+0000","last_became_active":"2024-09-21T06:46:37.826820+0000","last_became_peered":"2024-09-21T06:46:37.826820+0000","last_unstale":"2024-09-21T06:46:37.830508+0000","last_undegraded":"2024-09-21T06:46:37.830508+0000","last_fullsized":"2024-09-21T06:46:37.830508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.814083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843545+0000","last_change":"2024-09-21T06:46:38.834710+0000","last_active":"2024-09-21T06:46:38.843545+0000","last_peered":"2024-09-21T06:46:38.843545+0000","last_clean":"2024-09-21T06:46:38.843545+0000","last_became_active":"2024-09-21T06:46:38.834411+0000","last_became_peered":"2024-09-21T06:46:38.834411+0000","last_unstale":"2024-09-21T06:46:38.843545+0000","last_undegraded":"2024-09-21T06:46:38.843545+0000","last_fullsized":"2024-09-21T06:46:38.843545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829721+0000","last_change":"2024-09-21T06:46:37.822155+0000","last_active":"2024-09-21T06:46:38.829721+0000","last_peered":"2024-09-21T06:46:38.829721+0000","last_clean":"2024-09-21T06:46:38.829721+0000","last_became_active":"2024-09-21T06:46:37.821875+0000","last_became_peered":"2024-09-21T06:46:37.821875+0000","last_unstale":"2024-09-21T06:46:38.829721+0000","last_undegraded":"2024-09-21T06:46:38.829721+0000","last_fullsized":"2024-09-21T06:46:38.829721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:49.673120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.847439+0000","last_change":"2024-09-21T06:46:38.846296+0000","last_active":"2024-09-21T06:46:38.847439+0000","last_peered":"2024-09-21T06:46:38.847439+0000","last_clean":"2024-09-21T06:46:38.847439+0000","last_became_active":"2024-09-21T06:46:38.845939+0000","last_became_peered":"2024-09-21T06:46:38.845939+0000","last_unstale":"2024-09-21T06:46:38.847439+0000","last_undegraded":"2024-09-21T06:46:38.847439+0000","last_fullsized":"2024-09-21T06:46:38.847439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830182+0000","last_change":"2024-09-21T06:46:37.822030+0000","last_active":"2024-09-21T06:46:38.830182+0000","last_peered":"2024-09-21T06:46:38.830182+0000","last_clean":"2024-09-21T06:46:38.830182+0000","last_became_active":"2024-09-21T06:46:37.821713+0000","last_became_peered":"2024-09-21T06:46:37.821713+0000","last_unstale":"2024-09-21T06:46:38.830182+0000","last_undegraded":"2024-09-21T06:46:38.830182+0000","last_fullsized":"2024-09-21T06:46:38.830182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:12.386604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849053+0000","last_change":"2024-09-21T06:46:38.837242+0000","last_active":"2024-09-21T06:46:38.849053+0000","last_peered":"2024-09-21T06:46:38.849053+0000","last_clean":"2024-09-21T06:46:38.849053+0000","last_became_active":"2024-09-21T06:46:38.836884+0000","last_became_peered":"2024-09-21T06:46:38.836884+0000","last_unstale":"2024-09-21T06:46:38.849053+0000","last_undegraded":"2024-09-21T06:46:38.849053+0000","last_fullsized":"2024-09-21T06:46:38.849053+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:58.975876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859858+0000","last_change":"2024-09-21T06:46:37.824758+0000","last_active":"2024-09-21T06:46:38.859858+0000","last_peered":"2024-09-21T06:46:38.859858+0000","last_clean":"2024-09-21T06:46:38.859858+0000","last_became_active":"2024-09-21T06:46:37.824463+0000","last_became_peered":"2024-09-21T06:46:37.824463+0000","last_unstale":"2024-09-21T06:46:38.859858+0000","last_undegraded":"2024-09-21T06:46:38.859858+0000","last_fullsized":"2024-09-21T06:46:38.859858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:55.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843228+0000","last_change":"2024-09-21T06:46:38.837576+0000","last_active":"2024-09-21T06:46:38.843228+0000","last_peered":"2024-09-21T06:46:38.843228+0000","last_clean":"2024-09-21T06:46:38.843228+0000","last_became_active":"2024-09-21T06:46:38.837272+0000","last_became_peered":"2024-09-21T06:46:38.837272+0000","last_unstale":"2024-09-21T06:46:38.843228+0000","last_undegraded":"2024-09-21T06:46:38.843228+0000","last_fullsized":"2024-09-21T06:46:38.843228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828588+0000","last_change":"2024-09-21T06:46:37.826755+0000","last_active":"2024-09-21T06:46:37.828588+0000","last_peered":"2024-09-21T06:46:37.828588+0000","last_clean":"2024-09-21T06:46:37.828588+0000","last_became_active":"2024-09-21T06:46:37.826407+0000","last_became_peered":"2024-09-21T06:46:37.826407+0000","last_unstale":"2024-09-21T06:46:37.828588+0000","last_undegraded":"2024-09-21T06:46:37.828588+0000","last_fullsized":"2024-09-21T06:46:37.828588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:54.435622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843165+0000","last_change":"2024-09-21T06:46:38.834034+0000","last_active":"2024-09-21T06:46:38.843165+0000","last_peered":"2024-09-21T06:46:38.843165+0000","last_clean":"2024-09-21T06:46:38.843165+0000","last_became_active":"2024-09-21T06:46:38.833752+0000","last_became_peered":"2024-09-21T06:46:38.833752+0000","last_unstale":"2024-09-21T06:46:38.843165+0000","last_undegraded":"2024-09-21T06:46:38.843165+0000","last_fullsized":"2024-09-21T06:46:38.843165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:54.472336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.824284+0000","last_change":"2024-09-21T06:46:37.819283+0000","last_active":"2024-09-21T06:46:37.824284+0000","last_peered":"2024-09-21T06:46:37.824284+0000","last_clean":"2024-09-21T06:46:37.824284+0000","last_became_active":"2024-09-21T06:46:37.816729+0000","last_became_peered":"2024-09-21T06:46:37.816729+0000","last_unstale":"2024-09-21T06:46:37.824284+0000","last_undegraded":"2024-09-21T06:46:37.824284+0000","last_fullsized":"2024-09-21T06:46:37.824284+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:31.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816973+0000","last_change":"2024-09-21T06:46:37.816973+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816973+0000","last_undegraded":"2024-09-21T06:46:37.816973+0000","last_fullsized":"2024-09-21T06:46:37.816973+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.852111+0000","last_change":"2024-09-21T06:46:37.826066+0000","last_active":"2024-09-21T06:46:38.852111+0000","last_peered":"2024-09-21T06:46:38.852111+0000","last_clean":"2024-09-21T06:46:38.852111+0000","last_became_active":"2024-09-21T06:46:37.825751+0000","last_became_peered":"2024-09-21T06:46:37.825751+0000","last_unstale":"2024-09-21T06:46:38.852111+0000","last_undegraded":"2024-09-21T06:46:38.852111+0000","last_fullsized":"2024-09-21T06:46:38.852111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:19.603484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857622+0000","last_change":"2024-09-21T06:46:38.856673+0000","last_active":"2024-09-21T06:46:38.857622+0000","last_peered":"2024-09-21T06:46:38.857622+0000","last_clean":"2024-09-21T06:46:38.857622+0000","last_became_active":"2024-09-21T06:46:38.856179+0000","last_became_peered":"2024-09-21T06:46:38.856179+0000","last_unstale":"2024-09-21T06:46:38.857622+0000","last_undegraded":"2024-09-21T06:46:38.857622+0000","last_fullsized":"2024-09-21T06:46:38.857622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:35.199395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829453+0000","last_change":"2024-09-21T06:46:37.824783+0000","last_active":"2024-09-21T06:46:37.829453+0000","last_peered":"2024-09-21T06:46:37.829453+0000","last_clean":"2024-09-21T06:46:37.829453+0000","last_became_active":"2024-09-21T06:46:37.824308+0000","last_became_peered":"2024-09-21T06:46:37.824308+0000","last_unstale":"2024-09-21T06:46:37.829453+0000","last_undegraded":"2024-09-21T06:46:37.829453+0000","last_fullsized":"2024-09-21T06:46:37.829453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:34.680388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.850459+0000","last_change":"2024-09-21T06:46:38.847150+0000","last_active":"2024-09-21T06:46:38.850459+0000","last_peered":"2024-09-21T06:46:38.850459+0000","last_clean":"2024-09-21T06:46:38.850459+0000","last_became_active":"2024-09-21T06:46:38.846860+0000","last_became_peered":"2024-09-21T06:46:38.846860+0000","last_unstale":"2024-09-21T06:46:38.850459+0000","last_undegraded":"2024-09-21T06:46:38.850459+0000","last_fullsized":"2024-09-21T06:46:38.850459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830955+0000","last_change":"2024-09-21T06:46:37.827714+0000","last_active":"2024-09-21T06:46:37.830955+0000","last_peered":"2024-09-21T06:46:37.830955+0000","last_clean":"2024-09-21T06:46:37.830955+0000","last_became_active":"2024-09-21T06:46:37.826848+0000","last_became_peered":"2024-09-21T06:46:37.826848+0000","last_unstale":"2024-09-21T06:46:37.830955+0000","last_undegraded":"2024-09-21T06:46:37.830955+0000","last_fullsized":"2024-09-21T06:46:37.830955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:08.486901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812441+0000","last_change":"2024-09-21T06:46:37.812441+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812441+0000","last_undegraded":"2024-09-21T06:46:37.812441+0000","last_fullsized":"2024-09-21T06:46:37.812441+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828032+0000","last_change":"2024-09-21T06:46:37.817451+0000","last_active":"2024-09-21T06:46:37.828032+0000","last_peered":"2024-09-21T06:46:37.828032+0000","last_clean":"2024-09-21T06:46:37.828032+0000","last_became_active":"2024-09-21T06:46:37.816755+0000","last_became_peered":"2024-09-21T06:46:37.816755+0000","last_unstale":"2024-09-21T06:46:37.828032+0000","last_undegraded":"2024-09-21T06:46:37.828032+0000","last_fullsized":"2024-09-21T06:46:37.828032+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:09.214508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812272+0000","last_change":"2024-09-21T06:46:37.812272+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812272+0000","last_undegraded":"2024-09-21T06:46:37.812272+0000","last_fullsized":"2024-09-21T06:46:37.812272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833333+0000","last_change":"2024-09-21T06:46:37.826535+0000","last_active":"2024-09-21T06:46:38.833333+0000","last_peered":"2024-09-21T06:46:38.833333+0000","last_clean":"2024-09-21T06:46:38.833333+0000","last_became_active":"2024-09-21T06:46:37.825753+0000","last_became_peered":"2024-09-21T06:46:37.825753+0000","last_unstale":"2024-09-21T06:46:38.833333+0000","last_undegraded":"2024-09-21T06:46:38.833333+0000","last_fullsized":"2024-09-21T06:46:38.833333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843260+0000","last_change":"2024-09-21T06:46:38.838456+0000","last_active":"2024-09-21T06:46:38.843260+0000","last_peered":"2024-09-21T06:46:38.843260+0000","last_clean":"2024-09-21T06:46:38.843260+0000","last_became_active":"2024-09-21T06:46:38.838138+0000","last_became_peered":"2024-09-21T06:46:38.838138+0000","last_unstale":"2024-09-21T06:46:38.843260+0000","last_undegraded":"2024-09-21T06:46:38.843260+0000","last_fullsized":"2024-09-21T06:46:38.843260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833479+0000","last_change":"2024-09-21T06:46:37.828361+0000","last_active":"2024-09-21T06:46:37.833479+0000","last_peered":"2024-09-21T06:46:37.833479+0000","last_clean":"2024-09-21T06:46:37.833479+0000","last_became_active":"2024-09-21T06:46:37.828053+0000","last_became_peered":"2024-09-21T06:46:37.828053+0000","last_unstale":"2024-09-21T06:46:37.833479+0000","last_undegraded":"2024-09-21T06:46:37.833479+0000","last_fullsized":"2024-09-21T06:46:37.833479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:55.015218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843192+0000","last_change":"2024-09-21T06:46:38.835519+0000","last_active":"2024-09-21T06:46:38.843192+0000","last_peered":"2024-09-21T06:46:38.843192+0000","last_clean":"2024-09-21T06:46:38.843192+0000","last_became_active":"2024-09-21T06:46:38.835226+0000","last_became_peered":"2024-09-21T06:46:38.835226+0000","last_unstale":"2024-09-21T06:46:38.843192+0000","last_undegraded":"2024-09-21T06:46:38.843192+0000","last_fullsized":"2024-09-21T06:46:38.843192+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833812+0000","last_change":"2024-09-21T06:46:37.828386+0000","last_active":"2024-09-21T06:46:37.833812+0000","last_peered":"2024-09-21T06:46:37.833812+0000","last_clean":"2024-09-21T06:46:37.833812+0000","last_became_active":"2024-09-21T06:46:37.827795+0000","last_became_peered":"2024-09-21T06:46:37.827795+0000","last_unstale":"2024-09-21T06:46:37.833812+0000","last_undegraded":"2024-09-21T06:46:37.833812+0000","last_fullsized":"2024-09-21T06:46:37.833812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:17.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815592+0000","last_change":"2024-09-21T06:46:37.815592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815592+0000","last_undegraded":"2024-09-21T06:46:37.815592+0000","last_fullsized":"2024-09-21T06:46:37.815592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831398+0000","last_change":"2024-09-21T06:46:37.828721+0000","last_active":"2024-09-21T06:46:38.831398+0000","last_peered":"2024-09-21T06:46:38.831398+0000","last_clean":"2024-09-21T06:46:38.831398+0000","last_became_active":"2024-09-21T06:46:37.827838+0000","last_became_peered":"2024-09-21T06:46:37.827838+0000","last_unstale":"2024-09-21T06:46:38.831398+0000","last_undegraded":"2024-09-21T06:46:38.831398+0000","last_fullsized":"2024-09-21T06:46:38.831398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:34.881390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811128+0000","last_change":"2024-09-21T06:46:37.811128+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811128+0000","last_undegraded":"2024-09-21T06:46:37.811128+0000","last_fullsized":"2024-09-21T06:46:37.811128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.824899+0000","last_change":"2024-09-21T06:46:37.828979+0000","last_active":"2024-09-21T06:46:38.824899+0000","last_peered":"2024-09-21T06:46:38.824899+0000","last_clean":"2024-09-21T06:46:38.824899+0000","last_became_active":"2024-09-21T06:46:37.827049+0000","last_became_peered":"2024-09-21T06:46:37.827049+0000","last_unstale":"2024-09-21T06:46:38.824899+0000","last_undegraded":"2024-09-21T06:46:38.824899+0000","last_fullsized":"2024-09-21T06:46:38.824899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:41.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813704+0000","last_change":"2024-09-21T06:46:37.813704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813704+0000","last_undegraded":"2024-09-21T06:46:37.813704+0000","last_fullsized":"2024-09-21T06:46:37.813704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828898+0000","last_change":"2024-09-21T06:46:37.824970+0000","last_active":"2024-09-21T06:46:37.828898+0000","last_peered":"2024-09-21T06:46:37.828898+0000","last_clean":"2024-09-21T06:46:37.828898+0000","last_became_active":"2024-09-21T06:46:37.824677+0000","last_became_peered":"2024-09-21T06:46:37.824677+0000","last_unstale":"2024-09-21T06:46:37.828898+0000","last_undegraded":"2024-09-21T06:46:37.828898+0000","last_fullsized":"2024-09-21T06:46:37.828898+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:05.066114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851514+0000","last_change":"2024-09-21T06:46:38.845165+0000","last_active":"2024-09-21T06:46:38.851514+0000","last_peered":"2024-09-21T06:46:38.851514+0000","last_clean":"2024-09-21T06:46:38.851514+0000","last_became_active":"2024-09-21T06:46:38.844715+0000","last_became_peered":"2024-09-21T06:46:38.844715+0000","last_unstale":"2024-09-21T06:46:38.851514+0000","last_undegraded":"2024-09-21T06:46:38.851514+0000","last_fullsized":"2024-09-21T06:46:38.851514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:34.402844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.825098+0000","last_change":"2024-09-21T06:46:37.824613+0000","last_active":"2024-09-21T06:46:38.825098+0000","last_peered":"2024-09-21T06:46:38.825098+0000","last_clean":"2024-09-21T06:46:38.825098+0000","last_became_active":"2024-09-21T06:46:37.824302+0000","last_became_peered":"2024-09-21T06:46:37.824302+0000","last_unstale":"2024-09-21T06:46:38.825098+0000","last_undegraded":"2024-09-21T06:46:38.825098+0000","last_fullsized":"2024-09-21T06:46:38.825098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:57.477737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810322+0000","last_change":"2024-09-21T06:46:37.810322+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810322+0000","last_undegraded":"2024-09-21T06:46:37.810322+0000","last_fullsized":"2024-09-21T06:46:37.810322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.823443+0000","last_change":"2024-09-21T06:46:37.821964+0000","last_active":"2024-09-21T06:46:37.823443+0000","last_peered":"2024-09-21T06:46:37.823443+0000","last_clean":"2024-09-21T06:46:37.823443+0000","last_became_active":"2024-09-21T06:46:37.821664+0000","last_became_peered":"2024-09-21T06:46:37.821664+0000","last_unstale":"2024-09-21T06:46:37.823443+0000","last_undegraded":"2024-09-21T06:46:37.823443+0000","last_fullsized":"2024-09-21T06:46:37.823443+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:47.227494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814544+0000","last_change":"2024-09-21T06:46:37.814544+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814544+0000","last_undegraded":"2024-09-21T06:46:37.814544+0000","last_fullsized":"2024-09-21T06:46:37.814544+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829366+0000","last_change":"2024-09-21T06:46:37.821294+0000","last_active":"2024-09-21T06:46:37.829366+0000","last_peered":"2024-09-21T06:46:37.829366+0000","last_clean":"2024-09-21T06:46:37.829366+0000","last_became_active":"2024-09-21T06:46:37.820623+0000","last_became_peered":"2024-09-21T06:46:37.820623+0000","last_unstale":"2024-09-21T06:46:37.829366+0000","last_undegraded":"2024-09-21T06:46:37.829366+0000","last_fullsized":"2024-09-21T06:46:37.829366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:15.971706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811935+0000","last_change":"2024-09-21T06:46:37.811935+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811935+0000","last_undegraded":"2024-09-21T06:46:37.811935+0000","last_fullsized":"2024-09-21T06:46:37.811935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831642+0000","last_change":"2024-09-21T06:46:37.829723+0000","last_active":"2024-09-21T06:46:38.831642+0000","last_peered":"2024-09-21T06:46:38.831642+0000","last_clean":"2024-09-21T06:46:38.831642+0000","last_became_active":"2024-09-21T06:46:37.829452+0000","last_became_peered":"2024-09-21T06:46:37.829452+0000","last_unstale":"2024-09-21T06:46:38.831642+0000","last_undegraded":"2024-09-21T06:46:38.831642+0000","last_fullsized":"2024-09-21T06:46:38.831642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.342847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":166,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833441+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:38.833441+0000","last_peered":"2024-09-21T06:46:38.833441+0000","last_clean":"2024-09-21T06:46:38.833441+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:38.833441+0000","last_undegraded":"2024-09-21T06:46:38.833441+0000","last_fullsized":"2024-09-21T06:46:38.833441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":4056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:43.557 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-21T06:46:43.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.819428+0000', 'last_change': '2024-09-21T06:46:37.819428+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.819428+0000', 'last_undegraded': '2024-09-21T06:46:37.819428+0000', 'last_fullsized': '2024-09-21T06:46:37.819428+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.557 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-21T06:46:43.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.815734+0000', 'last_change': '2024-09-21T06:46:37.815734+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.815734+0000', 'last_undegraded': '2024-09-21T06:46:37.815734+0000', 'last_fullsized': '2024-09-21T06:46:37.815734+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.557 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.821160+0000', 'last_change': '2024-09-21T06:46:37.821160+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.821160+0000', 'last_undegraded': '2024-09-21T06:46:37.821160+0000', 'last_fullsized': '2024-09-21T06:46:37.821160+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.820842+0000', 'last_change': '2024-09-21T06:46:37.820842+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.820842+0000', 'last_undegraded': '2024-09-21T06:46:37.820842+0000', 'last_fullsized': '2024-09-21T06:46:37.820842+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.820035+0000', 'last_change': '2024-09-21T06:46:37.820035+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.820035+0000', 'last_undegraded': '2024-09-21T06:46:37.820035+0000', 'last_fullsized': '2024-09-21T06:46:37.820035+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.822086+0000', 'last_change': '2024-09-21T06:46:37.822086+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.822086+0000', 'last_undegraded': '2024-09-21T06:46:37.822086+0000', 'last_fullsized': '2024-09-21T06:46:37.822086+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.810180+0000', 'last_change': '2024-09-21T06:46:37.810180+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.810180+0000', 'last_undegraded': '2024-09-21T06:46:37.810180+0000', 'last_fullsized': '2024-09-21T06:46:37.810180+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-09-21T06:46:43.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.813254+0000', 'last_change': '2024-09-21T06:46:37.813254+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.813254+0000', 'last_undegraded': '2024-09-21T06:46:37.813254+0000', 'last_fullsized': '2024-09-21T06:46:37.813254+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.815082+0000', 'last_change': '2024-09-21T06:46:37.815082+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.815082+0000', 'last_undegraded': '2024-09-21T06:46:37.815082+0000', 'last_fullsized': '2024-09-21T06:46:37.815082+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.816299+0000', 'last_change': '2024-09-21T06:46:37.816299+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.816299+0000', 'last_undegraded': '2024-09-21T06:46:37.816299+0000', 'last_fullsized': '2024-09-21T06:46:37.816299+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.809496+0000', 'last_change': '2024-09-21T06:46:37.809496+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.809496+0000', 'last_undegraded': '2024-09-21T06:46:37.809496+0000', 'last_fullsized': '2024-09-21T06:46:37.809496+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.809041+0000', 'last_change': '2024-09-21T06:46:37.809041+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.809041+0000', 'last_undegraded': '2024-09-21T06:46:37.809041+0000', 'last_fullsized': '2024-09-21T06:46:37.809041+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.815856+0000', 'last_change': '2024-09-21T06:46:37.815856+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.815856+0000', 'last_undegraded': '2024-09-21T06:46:37.815856+0000', 'last_fullsized': '2024-09-21T06:46:37.815856+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-09-21T06:46:43.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.815262+0000', 'last_change': '2024-09-21T06:46:37.815262+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.815262+0000', 'last_undegraded': '2024-09-21T06:46:37.815262+0000', 'last_fullsized': '2024-09-21T06:46:37.815262+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.817360+0000', 'last_change': '2024-09-21T06:46:37.817360+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.817360+0000', 'last_undegraded': '2024-09-21T06:46:37.817360+0000', 'last_fullsized': '2024-09-21T06:46:37.817360+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.817262+0000', 'last_change': '2024-09-21T06:46:37.817262+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.817262+0000', 'last_undegraded': '2024-09-21T06:46:37.817262+0000', 'last_fullsized': '2024-09-21T06:46:37.817262+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.815387+0000', 'last_change': '2024-09-21T06:46:37.815387+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.815387+0000', 'last_undegraded': '2024-09-21T06:46:37.815387+0000', 'last_fullsized': '2024-09-21T06:46:37.815387+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.809740+0000', 'last_change': '2024-09-21T06:46:37.809740+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.809740+0000', 'last_undegraded': '2024-09-21T06:46:37.809740+0000', 'last_fullsized': '2024-09-21T06:46:37.809740+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.820704+0000', 'last_change': '2024-09-21T06:46:37.820704+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.820704+0000', 'last_undegraded': '2024-09-21T06:46:37.820704+0000', 'last_fullsized': '2024-09-21T06:46:37.820704+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.560 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.814559+0000', 'last_change': '2024-09-21T06:46:37.814559+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.814559+0000', 'last_undegraded': '2024-09-21T06:46:37.814559+0000', 'last_fullsized': '2024-09-21T06:46:37.814559+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.816631+0000', 'last_change': '2024-09-21T06:46:37.816631+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.816631+0000', 'last_undegraded': '2024-09-21T06:46:37.816631+0000', 'last_fullsized': '2024-09-21T06:46:37.816631+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.813990+0000', 'last_change': '2024-09-21T06:46:37.813990+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.813990+0000', 'last_undegraded': '2024-09-21T06:46:37.813990+0000', 'last_fullsized': '2024-09-21T06:46:37.813990+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.812592+0000', 'last_change': '2024-09-21T06:46:37.812592+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.812592+0000', 'last_undegraded': '2024-09-21T06:46:37.812592+0000', 'last_fullsized': '2024-09-21T06:46:37.812592+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.809538+0000', 'last_change': '2024-09-21T06:46:37.809538+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.809538+0000', 'last_undegraded': '2024-09-21T06:46:37.809538+0000', 'last_fullsized': '2024-09-21T06:46:37.809538+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-21T06:46:43.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.813565+0000', 'last_change': '2024-09-21T06:46:37.813565+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.813565+0000', 'last_undegraded': '2024-09-21T06:46:37.813565+0000', 'last_fullsized': '2024-09-21T06:46:37.813565+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.815758+0000', 'last_change': '2024-09-21T06:46:37.815758+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.815758+0000', 'last_undegraded': '2024-09-21T06:46:37.815758+0000', 'last_fullsized': '2024-09-21T06:46:37.815758+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.816973+0000', 'last_change': '2024-09-21T06:46:37.816973+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.816973+0000', 'last_undegraded': '2024-09-21T06:46:37.816973+0000', 'last_fullsized': '2024-09-21T06:46:37.816973+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.812441+0000', 'last_change': '2024-09-21T06:46:37.812441+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.812441+0000', 'last_undegraded': '2024-09-21T06:46:37.812441+0000', 'last_fullsized': '2024-09-21T06:46:37.812441+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.812272+0000', 'last_change': '2024-09-21T06:46:37.812272+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.812272+0000', 'last_undegraded': '2024-09-21T06:46:37.812272+0000', 'last_fullsized': '2024-09-21T06:46:37.812272+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.815592+0000', 'last_change': '2024-09-21T06:46:37.815592+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.815592+0000', 'last_undegraded': '2024-09-21T06:46:37.815592+0000', 'last_fullsized': '2024-09-21T06:46:37.815592+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-09-21T06:46:43.562 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.811128+0000', 'last_change': '2024-09-21T06:46:37.811128+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.811128+0000', 'last_undegraded': '2024-09-21T06:46:37.811128+0000', 'last_fullsized': '2024-09-21T06:46:37.811128+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.813704+0000', 'last_change': '2024-09-21T06:46:37.813704+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.813704+0000', 'last_undegraded': '2024-09-21T06:46:37.813704+0000', 'last_fullsized': '2024-09-21T06:46:37.813704+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.810322+0000', 'last_change': '2024-09-21T06:46:37.810322+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.810322+0000', 'last_undegraded': '2024-09-21T06:46:37.810322+0000', 'last_fullsized': '2024-09-21T06:46:37.810322+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.814544+0000', 'last_change': '2024-09-21T06:46:37.814544+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.814544+0000', 'last_undegraded': '2024-09-21T06:46:37.814544+0000', 'last_fullsized': '2024-09-21T06:46:37.814544+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-21T06:46:43.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-09-21T06:46:37.811935+0000', 'last_change': '2024-09-21T06:46:37.811935+0000', 'last_active': '2024-09-21T06:46:37.803143+0000', 'last_peered': '2024-09-21T06:46:37.803143+0000', 'last_clean': '2024-09-21T06:46:37.803143+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T06:46:37.811935+0000', 'last_undegraded': '2024-09-21T06:46:37.811935+0000', 'last_fullsized': '2024-09-21T06:46:37.811935+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'last_clean_scrub_stamp': '2024-09-21T06:46:37.803143+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T06:46:43.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T06:46:43.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 -- 172.21.15.81:0/2538513139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 msgr2=0x7f23480d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 --2- 172.21.15.81:0/2538513139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f23480d3220 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23480d3e70 tx=0x7f233802aa30 comp rx=0 tx=0).stop 2024-09-21T06:46:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 -- 172.21.15.81:0/2538513139 shutdown_connections 2024-09-21T06:46:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 --2- 172.21.15.81:0/2538513139 >> v2:172.21.15.89:3300/0 conn(0x7f23480b9c00 0x7f23480d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 --2- 172.21.15.81:0/2538513139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f234815eda0 0x7f23480b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 --2- 172.21.15.81:0/2538513139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f23480d3220 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 -- 172.21.15.81:0/2538513139 >> 172.21.15.81:0/2538513139 conn(0x7f23480b7330 msgr2=0x7f23480b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 -- 172.21.15.81:0/2538513139 shutdown_connections 2024-09-21T06:46:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.704+0000 7f234de38640 1 -- 172.21.15.81:0/2538513139 wait complete. 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.705+0000 7f234de38640 1 Processor -- start 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.706+0000 7f234de38640 1 -- start start 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f234de38640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23480b9c00 0x7f234806f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f234de38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f234814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f234de38640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f234815eda0 0x7f234814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f234de38640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23480b3230 con 0x7f234815c450 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f234de38640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f23480d4ae0 con 0x7f23480b9c00 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f234de38640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f23480b33b0 con 0x7f234815eda0 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f234814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f234814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58370/0 (socket says 172.21.15.81:58370) 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 -- 172.21.15.81:0/2659769366 learned_addr learned my addr 172.21.15.81:0/2659769366 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f23477fe640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23480b9c00 0x7f234806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2347fff640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f234815eda0 0x7f234814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 -- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f234815eda0 msgr2=0x7f234814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f234815eda0 0x7f234814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 -- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23480b9c00 msgr2=0x7f234806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23480b9c00 0x7f234806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.707+0000 7f2346ffd640 1 -- 172.21.15.81:0/2659769366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234806cf20 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.708+0000 7f2346ffd640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f234814b2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e7c0 tx=0x7f233c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.708+0000 7f232ffff640 1 -- 172.21.15.81:0/2659769366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c00cc60 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.708+0000 7f232ffff640 1 -- 172.21.15.81:0/2659769366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f233c00ce20 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.708+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234814bcd0 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.708+0000 7f232ffff640 1 -- 172.21.15.81:0/2659769366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c005280 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.708+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234806d1c0 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.709+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234808d110 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.710+0000 7f232ffff640 1 -- 172.21.15.81:0/2659769366 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f233c005420 con 0x7f234815c450 2024-09-21T06:46:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.710+0000 7f232ffff640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2334078bc0 0x7f233407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.710+0000 7f232ffff640 1 -- 172.21.15.81:0/2659769366 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f233c09b6e0 con 0x7f234815c450 2024-09-21T06:46:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.711+0000 7f23477fe640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2334078bc0 0x7f233407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.711+0000 7f23477fe640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2334078bc0 0x7f233407b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2338035000 tx=0x7f233803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.715+0000 7f232ffff640 1 -- 172.21.15.81:0/2659769366 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f234808d110 con 0x7f234815c450 2024-09-21T06:46:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.959+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f23480b3870 con 0x7f234815c450 2024-09-21T06:46:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.959+0000 7f232ffff640 1 -- 172.21.15.81:0/2659769366 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f233c063340 con 0x7f234815c450 2024-09-21T06:46:43.962 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:43.962 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1726901103,"num_in_osds":8,"osd_in_since":1726901093,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":62},{"state_name":"creating+peering","count":35}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":592140,"bytes_used":227446784,"bytes_avail":772866666496,"bytes_total":773094113280,"inactive_pgs_ratio":0.36082473397254944,"write_bytes_sec":872,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":27,"btime":"2024-09-21T06:46:41:839050+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5430}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-21T06:46:26.669447+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T06:46:43.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2334078bc0 msgr2=0x7f233407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2334078bc0 0x7f233407b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2338035000 tx=0x7f233803b040 comp rx=0 tx=0).stop 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 msgr2=0x7f234814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f234814b2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e7c0 tx=0x7f233c00ec80 comp rx=0 tx=0).stop 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 shutdown_connections 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2334078bc0 0x7f233407b0d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f234815eda0 0x7f234814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234815c450 0x7f234814b2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 --2- 172.21.15.81:0/2659769366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23480b9c00 0x7f234806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 >> 172.21.15.81:0/2659769366 conn(0x7f23480b7330 msgr2=0x7f2348160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 shutdown_connections 2024-09-21T06:46:43.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:43.961+0000 7f234de38640 1 -- 172.21.15.81:0/2659769366 wait complete. 2024-09-21T06:46:43.975 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T06:46:43.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.085+0000 7fa10301d640 1 -- 172.21.15.81:0/2243002842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 msgr2=0x7fa0fc0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.085+0000 7fa10301d640 1 --2- 172.21.15.81:0/2243002842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc0d3220 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0b93b0 tx=0x7fa0f802a480 comp rx=0 tx=0).stop 2024-09-21T06:46:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.085+0000 7fa10301d640 1 -- 172.21.15.81:0/2243002842 shutdown_connections 2024-09-21T06:46:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.085+0000 7fa10301d640 1 --2- 172.21.15.81:0/2243002842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc0d3220 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.085+0000 7fa10301d640 1 -- 172.21.15.81:0/2243002842 >> 172.21.15.81:0/2243002842 conn(0x7fa0fc0b7330 msgr2=0x7fa0fc0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.085+0000 7fa10301d640 1 -- 172.21.15.81:0/2243002842 shutdown_connections 2024-09-21T06:46:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.085+0000 7fa10301d640 1 -- 172.21.15.81:0/2243002842 wait complete. 2024-09-21T06:46:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.087+0000 7fa10301d640 1 Processor -- start 2024-09-21T06:46:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.087+0000 7fa10301d640 1 -- start start 2024-09-21T06:46:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.088+0000 7fa10301d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0fc0d41a0 0x7fa0fc06f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.088+0000 7fa10301d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc14e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.088+0000 7fa10301d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0fc15eda0 0x7fa0fc0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa10301d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0b3700 con 0x7fa0fc15c450 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa10301d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc0b3580 con 0x7fa0fc0d41a0 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa10301d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa0fc0b3880 con 0x7fa0fc15eda0 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc14e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc14e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58400/0 (socket says 172.21.15.81:58400) 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 -- 172.21.15.81:0/3918186896 learned_addr learned my addr 172.21.15.81:0/3918186896 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 -- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0fc15eda0 msgr2=0x7fa0fc0ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0fc15eda0 0x7fa0fc0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 -- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0fc0d41a0 msgr2=0x7fa0fc06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa100db9640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0fc0d41a0 0x7fa0fc06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0fc0d41a0 0x7fa0fc06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 -- 172.21.15.81:0/3918186896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc06e0c0 con 0x7fa0fc15c450 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f3fff640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc14e930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00c3a0 tx=0x7fa0ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f17fa640 1 -- 172.21.15.81:0/3918186896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec011790 con 0x7fa0fc15c450 2024-09-21T06:46:44.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f17fa640 1 -- 172.21.15.81:0/3918186896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0ec017070 con 0x7fa0fc15c450 2024-09-21T06:46:44.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc06e3a0 con 0x7fa0fc15c450 2024-09-21T06:46:44.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa0f17fa640 1 -- 172.21.15.81:0/3918186896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec011c80 con 0x7fa0fc15c450 2024-09-21T06:46:44.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.089+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc06e960 con 0x7fa0fc15c450 2024-09-21T06:46:44.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.090+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0fc06de30 con 0x7fa0fc15c450 2024-09-21T06:46:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.091+0000 7fa0f17fa640 1 -- 172.21.15.81:0/3918186896 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0ec01c460 con 0x7fa0fc15c450 2024-09-21T06:46:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.091+0000 7fa0f17fa640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa0e8078b90 0x7fa0e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.092+0000 7fa0f17fa640 1 -- 172.21.15.81:0/3918186896 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fa0ec09acd0 con 0x7fa0fc15c450 2024-09-21T06:46:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.092+0000 7fa100db9640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa0e8078b90 0x7fa0e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.092+0000 7fa100db9640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa0e8078b90 0x7fa0e807b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8034000 tx=0x7fa0f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:44.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.096+0000 7fa0f17fa640 1 -- 172.21.15.81:0/3918186896 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa0ec062f80 con 0x7fa0fc15c450 2024-09-21T06:46:44.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.272+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0fc08d0e0 con 0x7fa0e8078b90 2024-09-21T06:46:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.277+0000 7fa0f17fa640 1 -- 172.21.15.81:0/3918186896 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249067 (secure 0 0 0) 0x7fa0fc08d0e0 con 0x7fa0e8078b90 2024-09-21T06:46:44.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:44.282 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa0e8078b90 msgr2=0x7fa0e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa0e8078b90 0x7fa0e807b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8034000 tx=0x7fa0f8004730 comp rx=0 tx=0).stop 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 msgr2=0x7fa0fc14e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc14e930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00c3a0 tx=0x7fa0ec00c860 comp rx=0 tx=0).stop 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 shutdown_connections 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa0e8078b90 0x7fa0e807b0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0fc15eda0 0x7fa0fc0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0fc15c450 0x7fa0fc14e930 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 --2- 172.21.15.81:0/3918186896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0fc0d41a0 0x7fa0fc06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 >> 172.21.15.81:0/3918186896 conn(0x7fa0fc0b7330 msgr2=0x7fa0fc160ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 shutdown_connections 2024-09-21T06:46:44.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:44.280+0000 7fa10301d640 1 -- 172.21.15.81:0/3918186896 wait complete. 2024-09-21T06:46:44.294 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-09-21T06:46:42.673269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592140,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":127,"num_write_kb":1633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":93,"ondisk_log_size":93,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222116,"kb_used_data":5840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752604,"statfs":{"total":773094113280,"available":772866666496,"internally_reserved":0,"allocated":5980160,"data_stored":3277858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868427"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.819428+0000","last_change":"2024-09-21T06:46:37.819428+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.819428+0000","last_undegraded":"2024-09-21T06:46:37.819428+0000","last_fullsized":"2024-09-21T06:46:37.819428+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815734+0000","last_change":"2024-09-21T06:46:37.815734+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815734+0000","last_undegraded":"2024-09-21T06:46:37.815734+0000","last_fullsized":"2024-09-21T06:46:37.815734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844525+0000","last_change":"2024-09-21T06:46:38.836247+0000","last_active":"2024-09-21T06:46:38.844525+0000","last_peered":"2024-09-21T06:46:38.844525+0000","last_clean":"2024-09-21T06:46:38.844525+0000","last_became_active":"2024-09-21T06:46:38.835897+0000","last_became_peered":"2024-09-21T06:46:38.835897+0000","last_unstale":"2024-09-21T06:46:38.844525+0000","last_undegraded":"2024-09-21T06:46:38.844525+0000","last_fullsized":"2024-09-21T06:46:38.844525+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849825+0000","last_change":"2024-09-21T06:46:38.844482+0000","last_active":"2024-09-21T06:46:38.849825+0000","last_peered":"2024-09-21T06:46:38.849825+0000","last_clean":"2024-09-21T06:46:38.849825+0000","last_became_active":"2024-09-21T06:46:38.844161+0000","last_became_peered":"2024-09-21T06:46:38.844161+0000","last_unstale":"2024-09-21T06:46:38.849825+0000","last_undegraded":"2024-09-21T06:46:38.849825+0000","last_fullsized":"2024-09-21T06:46:38.849825+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:54.933768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.821160+0000","last_change":"2024-09-21T06:46:37.821160+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.821160+0000","last_undegraded":"2024-09-21T06:46:37.821160+0000","last_fullsized":"2024-09-21T06:46:37.821160+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820842+0000","last_change":"2024-09-21T06:46:37.820842+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820842+0000","last_undegraded":"2024-09-21T06:46:37.820842+0000","last_fullsized":"2024-09-21T06:46:37.820842+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849083+0000","last_change":"2024-09-21T06:46:38.837455+0000","last_active":"2024-09-21T06:46:38.849083+0000","last_peered":"2024-09-21T06:46:38.849083+0000","last_clean":"2024-09-21T06:46:38.849083+0000","last_became_active":"2024-09-21T06:46:38.837170+0000","last_became_peered":"2024-09-21T06:46:38.837170+0000","last_unstale":"2024-09-21T06:46:38.849083+0000","last_undegraded":"2024-09-21T06:46:38.849083+0000","last_fullsized":"2024-09-21T06:46:38.849083+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:20.986258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820035+0000","last_change":"2024-09-21T06:46:37.820035+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820035+0000","last_undegraded":"2024-09-21T06:46:37.820035+0000","last_fullsized":"2024-09-21T06:46:37.820035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859845+0000","last_change":"2024-09-21T06:46:38.856546+0000","last_active":"2024-09-21T06:46:38.859845+0000","last_peered":"2024-09-21T06:46:38.859845+0000","last_clean":"2024-09-21T06:46:38.859845+0000","last_became_active":"2024-09-21T06:46:38.856240+0000","last_became_peered":"2024-09-21T06:46:38.856240+0000","last_unstale":"2024-09-21T06:46:38.859845+0000","last_undegraded":"2024-09-21T06:46:38.859845+0000","last_fullsized":"2024-09-21T06:46:38.859845+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:12.306047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.822086+0000","last_change":"2024-09-21T06:46:37.822086+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.822086+0000","last_undegraded":"2024-09-21T06:46:37.822086+0000","last_fullsized":"2024-09-21T06:46:37.822086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810180+0000","last_change":"2024-09-21T06:46:37.810180+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810180+0000","last_undegraded":"2024-09-21T06:46:37.810180+0000","last_fullsized":"2024-09-21T06:46:37.810180+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843454+0000","last_change":"2024-09-21T06:46:38.840765+0000","last_active":"2024-09-21T06:46:38.843454+0000","last_peered":"2024-09-21T06:46:38.843454+0000","last_clean":"2024-09-21T06:46:38.843454+0000","last_became_active":"2024-09-21T06:46:38.840430+0000","last_became_peered":"2024-09-21T06:46:38.840430+0000","last_unstale":"2024-09-21T06:46:38.843454+0000","last_undegraded":"2024-09-21T06:46:38.843454+0000","last_fullsized":"2024-09-21T06:46:38.843454+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851481+0000","last_change":"2024-09-21T06:46:38.844070+0000","last_active":"2024-09-21T06:46:38.851481+0000","last_peered":"2024-09-21T06:46:38.851481+0000","last_clean":"2024-09-21T06:46:38.851481+0000","last_became_active":"2024-09-21T06:46:38.843603+0000","last_became_peered":"2024-09-21T06:46:38.843603+0000","last_unstale":"2024-09-21T06:46:38.851481+0000","last_undegraded":"2024-09-21T06:46:38.851481+0000","last_fullsized":"2024-09-21T06:46:38.851481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:38.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.842407+0000","last_change":"2024-09-21T06:46:38.832845+0000","last_active":"2024-09-21T06:46:38.842407+0000","last_peered":"2024-09-21T06:46:38.842407+0000","last_clean":"2024-09-21T06:46:38.842407+0000","last_became_active":"2024-09-21T06:46:38.832523+0000","last_became_peered":"2024-09-21T06:46:38.832523+0000","last_unstale":"2024-09-21T06:46:38.842407+0000","last_undegraded":"2024-09-21T06:46:38.842407+0000","last_fullsized":"2024-09-21T06:46:38.842407+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:27.403557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851351+0000","last_change":"2024-09-21T06:46:38.845822+0000","last_active":"2024-09-21T06:46:38.851351+0000","last_peered":"2024-09-21T06:46:38.851351+0000","last_clean":"2024-09-21T06:46:38.851351+0000","last_became_active":"2024-09-21T06:46:38.845446+0000","last_became_peered":"2024-09-21T06:46:38.845446+0000","last_unstale":"2024-09-21T06:46:38.851351+0000","last_undegraded":"2024-09-21T06:46:38.851351+0000","last_fullsized":"2024-09-21T06:46:38.851351+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:56.261429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813254+0000","last_change":"2024-09-21T06:46:37.813254+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813254+0000","last_undegraded":"2024-09-21T06:46:37.813254+0000","last_fullsized":"2024-09-21T06:46:37.813254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815082+0000","last_change":"2024-09-21T06:46:37.815082+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815082+0000","last_undegraded":"2024-09-21T06:46:37.815082+0000","last_fullsized":"2024-09-21T06:46:37.815082+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.844151+0000","last_change":"2024-09-21T06:46:38.841494+0000","last_active":"2024-09-21T06:46:38.844151+0000","last_peered":"2024-09-21T06:46:38.844151+0000","last_clean":"2024-09-21T06:46:38.844151+0000","last_became_active":"2024-09-21T06:46:38.841161+0000","last_became_peered":"2024-09-21T06:46:38.841161+0000","last_unstale":"2024-09-21T06:46:38.844151+0000","last_undegraded":"2024-09-21T06:46:38.844151+0000","last_fullsized":"2024-09-21T06:46:38.844151+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:47.348432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816299+0000","last_change":"2024-09-21T06:46:37.816299+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816299+0000","last_undegraded":"2024-09-21T06:46:37.816299+0000","last_fullsized":"2024-09-21T06:46:37.816299+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809496+0000","last_change":"2024-09-21T06:46:37.809496+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809496+0000","last_undegraded":"2024-09-21T06:46:37.809496+0000","last_fullsized":"2024-09-21T06:46:37.809496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851499+0000","last_change":"2024-09-21T06:46:38.844395+0000","last_active":"2024-09-21T06:46:38.851499+0000","last_peered":"2024-09-21T06:46:38.851499+0000","last_clean":"2024-09-21T06:46:38.851499+0000","last_became_active":"2024-09-21T06:46:38.844030+0000","last_became_peered":"2024-09-21T06:46:38.844030+0000","last_unstale":"2024-09-21T06:46:38.851499+0000","last_undegraded":"2024-09-21T06:46:38.851499+0000","last_fullsized":"2024-09-21T06:46:38.851499+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:18.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809041+0000","last_change":"2024-09-21T06:46:37.809041+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809041+0000","last_undegraded":"2024-09-21T06:46:37.809041+0000","last_fullsized":"2024-09-21T06:46:37.809041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849108+0000","last_change":"2024-09-21T06:46:38.838558+0000","last_active":"2024-09-21T06:46:38.849108+0000","last_peered":"2024-09-21T06:46:38.849108+0000","last_clean":"2024-09-21T06:46:38.849108+0000","last_became_active":"2024-09-21T06:46:38.838256+0000","last_became_peered":"2024-09-21T06:46:38.838256+0000","last_unstale":"2024-09-21T06:46:38.849108+0000","last_undegraded":"2024-09-21T06:46:38.849108+0000","last_fullsized":"2024-09-21T06:46:38.849108+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:37.987203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859870+0000","last_change":"2024-09-21T06:46:38.856520+0000","last_active":"2024-09-21T06:46:38.859870+0000","last_peered":"2024-09-21T06:46:38.859870+0000","last_clean":"2024-09-21T06:46:38.859870+0000","last_became_active":"2024-09-21T06:46:38.856171+0000","last_became_peered":"2024-09-21T06:46:38.856171+0000","last_unstale":"2024-09-21T06:46:38.859870+0000","last_undegraded":"2024-09-21T06:46:38.859870+0000","last_fullsized":"2024-09-21T06:46:38.859870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815856+0000","last_change":"2024-09-21T06:46:37.815856+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815856+0000","last_undegraded":"2024-09-21T06:46:37.815856+0000","last_fullsized":"2024-09-21T06:46:37.815856+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.838885+0000","last_change":"2024-09-21T06:46:38.836327+0000","last_active":"2024-09-21T06:46:38.838885+0000","last_peered":"2024-09-21T06:46:38.838885+0000","last_clean":"2024-09-21T06:46:38.838885+0000","last_became_active":"2024-09-21T06:46:38.836032+0000","last_became_peered":"2024-09-21T06:46:38.836032+0000","last_unstale":"2024-09-21T06:46:38.838885+0000","last_undegraded":"2024-09-21T06:46:38.838885+0000","last_fullsized":"2024-09-21T06:46:38.838885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:46.918012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815262+0000","last_change":"2024-09-21T06:46:37.815262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815262+0000","last_undegraded":"2024-09-21T06:46:37.815262+0000","last_fullsized":"2024-09-21T06:46:37.815262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817360+0000","last_change":"2024-09-21T06:46:37.817360+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817360+0000","last_undegraded":"2024-09-21T06:46:37.817360+0000","last_fullsized":"2024-09-21T06:46:37.817360+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.817262+0000","last_change":"2024-09-21T06:46:37.817262+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.817262+0000","last_undegraded":"2024-09-21T06:46:37.817262+0000","last_fullsized":"2024-09-21T06:46:37.817262+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848749+0000","last_change":"2024-09-21T06:46:38.839817+0000","last_active":"2024-09-21T06:46:38.848749+0000","last_peered":"2024-09-21T06:46:38.848749+0000","last_clean":"2024-09-21T06:46:38.848749+0000","last_became_active":"2024-09-21T06:46:38.839497+0000","last_became_peered":"2024-09-21T06:46:38.839497+0000","last_unstale":"2024-09-21T06:46:38.848749+0000","last_undegraded":"2024-09-21T06:46:38.848749+0000","last_fullsized":"2024-09-21T06:46:38.848749+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:24.677702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815387+0000","last_change":"2024-09-21T06:46:37.815387+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815387+0000","last_undegraded":"2024-09-21T06:46:37.815387+0000","last_fullsized":"2024-09-21T06:46:37.815387+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809740+0000","last_change":"2024-09-21T06:46:37.809740+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809740+0000","last_undegraded":"2024-09-21T06:46:37.809740+0000","last_fullsized":"2024-09-21T06:46:37.809740+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.820704+0000","last_change":"2024-09-21T06:46:37.820704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.820704+0000","last_undegraded":"2024-09-21T06:46:37.820704+0000","last_fullsized":"2024-09-21T06:46:37.820704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828350+0000","last_change":"2024-09-21T06:46:37.822060+0000","last_active":"2024-09-21T06:46:37.828350+0000","last_peered":"2024-09-21T06:46:37.828350+0000","last_clean":"2024-09-21T06:46:37.828350+0000","last_became_active":"2024-09-21T06:46:37.821749+0000","last_became_peered":"2024-09-21T06:46:37.821749+0000","last_unstale":"2024-09-21T06:46:37.828350+0000","last_undegraded":"2024-09-21T06:46:37.828350+0000","last_fullsized":"2024-09-21T06:46:37.828350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:33.823939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814559+0000","last_change":"2024-09-21T06:46:37.814559+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814559+0000","last_undegraded":"2024-09-21T06:46:37.814559+0000","last_fullsized":"2024-09-21T06:46:37.814559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828981+0000","last_change":"2024-09-21T06:46:37.825639+0000","last_active":"2024-09-21T06:46:37.828981+0000","last_peered":"2024-09-21T06:46:37.828981+0000","last_clean":"2024-09-21T06:46:37.828981+0000","last_became_active":"2024-09-21T06:46:37.825329+0000","last_became_peered":"2024-09-21T06:46:37.825329+0000","last_unstale":"2024-09-21T06:46:37.828981+0000","last_undegraded":"2024-09-21T06:46:37.828981+0000","last_fullsized":"2024-09-21T06:46:37.828981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:09.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816631+0000","last_change":"2024-09-21T06:46:37.816631+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816631+0000","last_undegraded":"2024-09-21T06:46:37.816631+0000","last_fullsized":"2024-09-21T06:46:37.816631+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833801+0000","last_change":"2024-09-21T06:46:37.827885+0000","last_active":"2024-09-21T06:46:37.833801+0000","last_peered":"2024-09-21T06:46:37.833801+0000","last_clean":"2024-09-21T06:46:37.833801+0000","last_became_active":"2024-09-21T06:46:37.827560+0000","last_became_peered":"2024-09-21T06:46:37.827560+0000","last_unstale":"2024-09-21T06:46:37.833801+0000","last_undegraded":"2024-09-21T06:46:37.833801+0000","last_fullsized":"2024-09-21T06:46:37.833801+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:28.522713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813990+0000","last_change":"2024-09-21T06:46:37.813990+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813990+0000","last_undegraded":"2024-09-21T06:46:37.813990+0000","last_fullsized":"2024-09-21T06:46:37.813990+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857526+0000","last_change":"2024-09-21T06:46:37.827573+0000","last_active":"2024-09-21T06:46:38.857526+0000","last_peered":"2024-09-21T06:46:38.857526+0000","last_clean":"2024-09-21T06:46:38.857526+0000","last_became_active":"2024-09-21T06:46:37.827205+0000","last_became_peered":"2024-09-21T06:46:37.827205+0000","last_unstale":"2024-09-21T06:46:38.857526+0000","last_undegraded":"2024-09-21T06:46:38.857526+0000","last_fullsized":"2024-09-21T06:46:38.857526+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:44.653930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812592+0000","last_change":"2024-09-21T06:46:37.812592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812592+0000","last_undegraded":"2024-09-21T06:46:37.812592+0000","last_fullsized":"2024-09-21T06:46:37.812592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851676+0000","last_change":"2024-09-21T06:46:37.829136+0000","last_active":"2024-09-21T06:46:38.851676+0000","last_peered":"2024-09-21T06:46:38.851676+0000","last_clean":"2024-09-21T06:46:38.851676+0000","last_became_active":"2024-09-21T06:46:37.828745+0000","last_became_peered":"2024-09-21T06:46:37.828745+0000","last_unstale":"2024-09-21T06:46:38.851676+0000","last_undegraded":"2024-09-21T06:46:38.851676+0000","last_fullsized":"2024-09-21T06:46:38.851676+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:32.045906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.809538+0000","last_change":"2024-09-21T06:46:37.809538+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.809538+0000","last_undegraded":"2024-09-21T06:46:37.809538+0000","last_fullsized":"2024-09-21T06:46:37.809538+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833769+0000","last_change":"2024-09-21T06:46:37.826987+0000","last_active":"2024-09-21T06:46:37.833769+0000","last_peered":"2024-09-21T06:46:37.833769+0000","last_clean":"2024-09-21T06:46:37.833769+0000","last_became_active":"2024-09-21T06:46:37.826675+0000","last_became_peered":"2024-09-21T06:46:37.826675+0000","last_unstale":"2024-09-21T06:46:37.833769+0000","last_undegraded":"2024-09-21T06:46:37.833769+0000","last_fullsized":"2024-09-21T06:46:37.833769+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:00.728251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.848403+0000","last_change":"2024-09-21T06:46:38.843367+0000","last_active":"2024-09-21T06:46:38.848403+0000","last_peered":"2024-09-21T06:46:38.848403+0000","last_clean":"2024-09-21T06:46:38.848403+0000","last_became_active":"2024-09-21T06:46:38.842758+0000","last_became_peered":"2024-09-21T06:46:38.842758+0000","last_unstale":"2024-09-21T06:46:38.848403+0000","last_undegraded":"2024-09-21T06:46:38.848403+0000","last_fullsized":"2024-09-21T06:46:38.848403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:49.726045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829337+0000","last_change":"2024-09-21T06:46:37.822573+0000","last_active":"2024-09-21T06:46:38.829337+0000","last_peered":"2024-09-21T06:46:38.829337+0000","last_clean":"2024-09-21T06:46:38.829337+0000","last_became_active":"2024-09-21T06:46:37.822248+0000","last_became_peered":"2024-09-21T06:46:37.822248+0000","last_unstale":"2024-09-21T06:46:38.829337+0000","last_undegraded":"2024-09-21T06:46:38.829337+0000","last_fullsized":"2024-09-21T06:46:38.829337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:47.124858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813565+0000","last_change":"2024-09-21T06:46:37.813565+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813565+0000","last_undegraded":"2024-09-21T06:46:37.813565+0000","last_fullsized":"2024-09-21T06:46:37.813565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833890+0000","last_change":"2024-09-21T06:46:37.821564+0000","last_active":"2024-09-21T06:46:38.833890+0000","last_peered":"2024-09-21T06:46:38.833890+0000","last_clean":"2024-09-21T06:46:38.833890+0000","last_became_active":"2024-09-21T06:46:37.821236+0000","last_became_peered":"2024-09-21T06:46:37.821236+0000","last_unstale":"2024-09-21T06:46:38.833890+0000","last_undegraded":"2024-09-21T06:46:38.833890+0000","last_fullsized":"2024-09-21T06:46:38.833890+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:48.720460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.836742+0000","last_change":"2024-09-21T06:46:38.835282+0000","last_active":"2024-09-21T06:46:38.836742+0000","last_peered":"2024-09-21T06:46:38.836742+0000","last_clean":"2024-09-21T06:46:38.836742+0000","last_became_active":"2024-09-21T06:46:38.834952+0000","last_became_peered":"2024-09-21T06:46:38.834952+0000","last_unstale":"2024-09-21T06:46:38.836742+0000","last_undegraded":"2024-09-21T06:46:38.836742+0000","last_fullsized":"2024-09-21T06:46:38.836742+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:32.211076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830074+0000","last_change":"2024-09-21T06:46:37.825931+0000","last_active":"2024-09-21T06:46:38.830074+0000","last_peered":"2024-09-21T06:46:38.830074+0000","last_clean":"2024-09-21T06:46:38.830074+0000","last_became_active":"2024-09-21T06:46:37.825590+0000","last_became_peered":"2024-09-21T06:46:37.825590+0000","last_unstale":"2024-09-21T06:46:38.830074+0000","last_undegraded":"2024-09-21T06:46:38.830074+0000","last_fullsized":"2024-09-21T06:46:38.830074+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:26.397972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843137+0000","last_change":"2024-09-21T06:46:38.833931+0000","last_active":"2024-09-21T06:46:38.843137+0000","last_peered":"2024-09-21T06:46:38.843137+0000","last_clean":"2024-09-21T06:46:38.843137+0000","last_became_active":"2024-09-21T06:46:38.833613+0000","last_became_peered":"2024-09-21T06:46:38.833613+0000","last_unstale":"2024-09-21T06:46:38.843137+0000","last_undegraded":"2024-09-21T06:46:38.843137+0000","last_fullsized":"2024-09-21T06:46:38.843137+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:35.886975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.826471+0000","last_change":"2024-09-21T06:46:37.819621+0000","last_active":"2024-09-21T06:46:37.826471+0000","last_peered":"2024-09-21T06:46:37.826471+0000","last_clean":"2024-09-21T06:46:37.826471+0000","last_became_active":"2024-09-21T06:46:37.817183+0000","last_became_peered":"2024-09-21T06:46:37.817183+0000","last_unstale":"2024-09-21T06:46:37.826471+0000","last_undegraded":"2024-09-21T06:46:37.826471+0000","last_fullsized":"2024-09-21T06:46:37.826471+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:45.747826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815758+0000","last_change":"2024-09-21T06:46:37.815758+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815758+0000","last_undegraded":"2024-09-21T06:46:37.815758+0000","last_fullsized":"2024-09-21T06:46:37.815758+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.858068+0000","last_change":"2024-09-21T06:46:37.827697+0000","last_active":"2024-09-21T06:46:38.858068+0000","last_peered":"2024-09-21T06:46:38.858068+0000","last_clean":"2024-09-21T06:46:38.858068+0000","last_became_active":"2024-09-21T06:46:37.827400+0000","last_became_peered":"2024-09-21T06:46:37.827400+0000","last_unstale":"2024-09-21T06:46:38.858068+0000","last_undegraded":"2024-09-21T06:46:38.858068+0000","last_fullsized":"2024-09-21T06:46:38.858068+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:15.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849133+0000","last_change":"2024-09-21T06:46:38.836804+0000","last_active":"2024-09-21T06:46:38.849133+0000","last_peered":"2024-09-21T06:46:38.849133+0000","last_clean":"2024-09-21T06:46:38.849133+0000","last_became_active":"2024-09-21T06:46:38.836503+0000","last_became_peered":"2024-09-21T06:46:38.836503+0000","last_unstale":"2024-09-21T06:46:38.849133+0000","last_undegraded":"2024-09-21T06:46:38.849133+0000","last_fullsized":"2024-09-21T06:46:38.849133+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:18:42.432169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.861597+0000","last_change":"2024-09-21T06:46:37.827650+0000","last_active":"2024-09-21T06:46:38.861597+0000","last_peered":"2024-09-21T06:46:38.861597+0000","last_clean":"2024-09-21T06:46:38.861597+0000","last_became_active":"2024-09-21T06:46:37.827332+0000","last_became_peered":"2024-09-21T06:46:37.827332+0000","last_unstale":"2024-09-21T06:46:38.861597+0000","last_undegraded":"2024-09-21T06:46:38.861597+0000","last_fullsized":"2024-09-21T06:46:38.861597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:01.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843682+0000","last_change":"2024-09-21T06:46:38.841487+0000","last_active":"2024-09-21T06:46:38.843682+0000","last_peered":"2024-09-21T06:46:38.843682+0000","last_clean":"2024-09-21T06:46:38.843682+0000","last_became_active":"2024-09-21T06:46:38.840274+0000","last_became_peered":"2024-09-21T06:46:38.840274+0000","last_unstale":"2024-09-21T06:46:38.843682+0000","last_undegraded":"2024-09-21T06:46:38.843682+0000","last_fullsized":"2024-09-21T06:46:38.843682+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830508+0000","last_change":"2024-09-21T06:46:37.827132+0000","last_active":"2024-09-21T06:46:37.830508+0000","last_peered":"2024-09-21T06:46:37.830508+0000","last_clean":"2024-09-21T06:46:37.830508+0000","last_became_active":"2024-09-21T06:46:37.826820+0000","last_became_peered":"2024-09-21T06:46:37.826820+0000","last_unstale":"2024-09-21T06:46:37.830508+0000","last_undegraded":"2024-09-21T06:46:37.830508+0000","last_fullsized":"2024-09-21T06:46:37.830508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.814083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843545+0000","last_change":"2024-09-21T06:46:38.834710+0000","last_active":"2024-09-21T06:46:38.843545+0000","last_peered":"2024-09-21T06:46:38.843545+0000","last_clean":"2024-09-21T06:46:38.843545+0000","last_became_active":"2024-09-21T06:46:38.834411+0000","last_became_peered":"2024-09-21T06:46:38.834411+0000","last_unstale":"2024-09-21T06:46:38.843545+0000","last_undegraded":"2024-09-21T06:46:38.843545+0000","last_fullsized":"2024-09-21T06:46:38.843545+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:35.863654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.829721+0000","last_change":"2024-09-21T06:46:37.822155+0000","last_active":"2024-09-21T06:46:38.829721+0000","last_peered":"2024-09-21T06:46:38.829721+0000","last_clean":"2024-09-21T06:46:38.829721+0000","last_became_active":"2024-09-21T06:46:37.821875+0000","last_became_peered":"2024-09-21T06:46:37.821875+0000","last_unstale":"2024-09-21T06:46:38.829721+0000","last_undegraded":"2024-09-21T06:46:38.829721+0000","last_fullsized":"2024-09-21T06:46:38.829721+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:49.673120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.847439+0000","last_change":"2024-09-21T06:46:38.846296+0000","last_active":"2024-09-21T06:46:38.847439+0000","last_peered":"2024-09-21T06:46:38.847439+0000","last_clean":"2024-09-21T06:46:38.847439+0000","last_became_active":"2024-09-21T06:46:38.845939+0000","last_became_peered":"2024-09-21T06:46:38.845939+0000","last_unstale":"2024-09-21T06:46:38.847439+0000","last_undegraded":"2024-09-21T06:46:38.847439+0000","last_fullsized":"2024-09-21T06:46:38.847439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:45.245846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.830182+0000","last_change":"2024-09-21T06:46:37.822030+0000","last_active":"2024-09-21T06:46:38.830182+0000","last_peered":"2024-09-21T06:46:38.830182+0000","last_clean":"2024-09-21T06:46:38.830182+0000","last_became_active":"2024-09-21T06:46:37.821713+0000","last_became_peered":"2024-09-21T06:46:37.821713+0000","last_unstale":"2024-09-21T06:46:38.830182+0000","last_undegraded":"2024-09-21T06:46:38.830182+0000","last_fullsized":"2024-09-21T06:46:38.830182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:12.386604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.849053+0000","last_change":"2024-09-21T06:46:38.837242+0000","last_active":"2024-09-21T06:46:38.849053+0000","last_peered":"2024-09-21T06:46:38.849053+0000","last_clean":"2024-09-21T06:46:38.849053+0000","last_became_active":"2024-09-21T06:46:38.836884+0000","last_became_peered":"2024-09-21T06:46:38.836884+0000","last_unstale":"2024-09-21T06:46:38.849053+0000","last_undegraded":"2024-09-21T06:46:38.849053+0000","last_fullsized":"2024-09-21T06:46:38.849053+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:49:58.975876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.859858+0000","last_change":"2024-09-21T06:46:37.824758+0000","last_active":"2024-09-21T06:46:38.859858+0000","last_peered":"2024-09-21T06:46:38.859858+0000","last_clean":"2024-09-21T06:46:38.859858+0000","last_became_active":"2024-09-21T06:46:37.824463+0000","last_became_peered":"2024-09-21T06:46:37.824463+0000","last_unstale":"2024-09-21T06:46:38.859858+0000","last_undegraded":"2024-09-21T06:46:38.859858+0000","last_fullsized":"2024-09-21T06:46:38.859858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:55.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843228+0000","last_change":"2024-09-21T06:46:38.837576+0000","last_active":"2024-09-21T06:46:38.843228+0000","last_peered":"2024-09-21T06:46:38.843228+0000","last_clean":"2024-09-21T06:46:38.843228+0000","last_became_active":"2024-09-21T06:46:38.837272+0000","last_became_peered":"2024-09-21T06:46:38.837272+0000","last_unstale":"2024-09-21T06:46:38.843228+0000","last_undegraded":"2024-09-21T06:46:38.843228+0000","last_fullsized":"2024-09-21T06:46:38.843228+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828588+0000","last_change":"2024-09-21T06:46:37.826755+0000","last_active":"2024-09-21T06:46:37.828588+0000","last_peered":"2024-09-21T06:46:37.828588+0000","last_clean":"2024-09-21T06:46:37.828588+0000","last_became_active":"2024-09-21T06:46:37.826407+0000","last_became_peered":"2024-09-21T06:46:37.826407+0000","last_unstale":"2024-09-21T06:46:37.828588+0000","last_undegraded":"2024-09-21T06:46:37.828588+0000","last_fullsized":"2024-09-21T06:46:37.828588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:54.435622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843165+0000","last_change":"2024-09-21T06:46:38.834034+0000","last_active":"2024-09-21T06:46:38.843165+0000","last_peered":"2024-09-21T06:46:38.843165+0000","last_clean":"2024-09-21T06:46:38.843165+0000","last_became_active":"2024-09-21T06:46:38.833752+0000","last_became_peered":"2024-09-21T06:46:38.833752+0000","last_unstale":"2024-09-21T06:46:38.843165+0000","last_undegraded":"2024-09-21T06:46:38.843165+0000","last_fullsized":"2024-09-21T06:46:38.843165+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:54.472336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.824284+0000","last_change":"2024-09-21T06:46:37.819283+0000","last_active":"2024-09-21T06:46:37.824284+0000","last_peered":"2024-09-21T06:46:37.824284+0000","last_clean":"2024-09-21T06:46:37.824284+0000","last_became_active":"2024-09-21T06:46:37.816729+0000","last_became_peered":"2024-09-21T06:46:37.816729+0000","last_unstale":"2024-09-21T06:46:37.824284+0000","last_undegraded":"2024-09-21T06:46:37.824284+0000","last_fullsized":"2024-09-21T06:46:37.824284+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:16:31.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.816973+0000","last_change":"2024-09-21T06:46:37.816973+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.816973+0000","last_undegraded":"2024-09-21T06:46:37.816973+0000","last_fullsized":"2024-09-21T06:46:37.816973+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.852111+0000","last_change":"2024-09-21T06:46:37.826066+0000","last_active":"2024-09-21T06:46:38.852111+0000","last_peered":"2024-09-21T06:46:38.852111+0000","last_clean":"2024-09-21T06:46:38.852111+0000","last_became_active":"2024-09-21T06:46:37.825751+0000","last_became_peered":"2024-09-21T06:46:37.825751+0000","last_unstale":"2024-09-21T06:46:38.852111+0000","last_undegraded":"2024-09-21T06:46:38.852111+0000","last_fullsized":"2024-09-21T06:46:38.852111+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:19.603484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.857622+0000","last_change":"2024-09-21T06:46:38.856673+0000","last_active":"2024-09-21T06:46:38.857622+0000","last_peered":"2024-09-21T06:46:38.857622+0000","last_clean":"2024-09-21T06:46:38.857622+0000","last_became_active":"2024-09-21T06:46:38.856179+0000","last_became_peered":"2024-09-21T06:46:38.856179+0000","last_unstale":"2024-09-21T06:46:38.857622+0000","last_undegraded":"2024-09-21T06:46:38.857622+0000","last_fullsized":"2024-09-21T06:46:38.857622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:35.199395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829453+0000","last_change":"2024-09-21T06:46:37.824783+0000","last_active":"2024-09-21T06:46:37.829453+0000","last_peered":"2024-09-21T06:46:37.829453+0000","last_clean":"2024-09-21T06:46:37.829453+0000","last_became_active":"2024-09-21T06:46:37.824308+0000","last_became_peered":"2024-09-21T06:46:37.824308+0000","last_unstale":"2024-09-21T06:46:37.829453+0000","last_undegraded":"2024-09-21T06:46:37.829453+0000","last_fullsized":"2024-09-21T06:46:37.829453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:34.680388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.850459+0000","last_change":"2024-09-21T06:46:38.847150+0000","last_active":"2024-09-21T06:46:38.850459+0000","last_peered":"2024-09-21T06:46:38.850459+0000","last_clean":"2024-09-21T06:46:38.850459+0000","last_became_active":"2024-09-21T06:46:38.846860+0000","last_became_peered":"2024-09-21T06:46:38.846860+0000","last_unstale":"2024-09-21T06:46:38.850459+0000","last_undegraded":"2024-09-21T06:46:38.850459+0000","last_fullsized":"2024-09-21T06:46:38.850459+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:08.035131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.830955+0000","last_change":"2024-09-21T06:46:37.827714+0000","last_active":"2024-09-21T06:46:37.830955+0000","last_peered":"2024-09-21T06:46:37.830955+0000","last_clean":"2024-09-21T06:46:37.830955+0000","last_became_active":"2024-09-21T06:46:37.826848+0000","last_became_peered":"2024-09-21T06:46:37.826848+0000","last_unstale":"2024-09-21T06:46:37.830955+0000","last_undegraded":"2024-09-21T06:46:37.830955+0000","last_fullsized":"2024-09-21T06:46:37.830955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:08.486901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812441+0000","last_change":"2024-09-21T06:46:37.812441+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812441+0000","last_undegraded":"2024-09-21T06:46:37.812441+0000","last_fullsized":"2024-09-21T06:46:37.812441+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828032+0000","last_change":"2024-09-21T06:46:37.817451+0000","last_active":"2024-09-21T06:46:37.828032+0000","last_peered":"2024-09-21T06:46:37.828032+0000","last_clean":"2024-09-21T06:46:37.828032+0000","last_became_active":"2024-09-21T06:46:37.816755+0000","last_became_peered":"2024-09-21T06:46:37.816755+0000","last_unstale":"2024-09-21T06:46:37.828032+0000","last_undegraded":"2024-09-21T06:46:37.828032+0000","last_fullsized":"2024-09-21T06:46:37.828032+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:09.214508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.812272+0000","last_change":"2024-09-21T06:46:37.812272+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.812272+0000","last_undegraded":"2024-09-21T06:46:37.812272+0000","last_fullsized":"2024-09-21T06:46:37.812272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833333+0000","last_change":"2024-09-21T06:46:37.826535+0000","last_active":"2024-09-21T06:46:38.833333+0000","last_peered":"2024-09-21T06:46:38.833333+0000","last_clean":"2024-09-21T06:46:38.833333+0000","last_became_active":"2024-09-21T06:46:37.825753+0000","last_became_peered":"2024-09-21T06:46:37.825753+0000","last_unstale":"2024-09-21T06:46:38.833333+0000","last_undegraded":"2024-09-21T06:46:38.833333+0000","last_fullsized":"2024-09-21T06:46:38.833333+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843260+0000","last_change":"2024-09-21T06:46:38.838456+0000","last_active":"2024-09-21T06:46:38.843260+0000","last_peered":"2024-09-21T06:46:38.843260+0000","last_clean":"2024-09-21T06:46:38.843260+0000","last_became_active":"2024-09-21T06:46:38.838138+0000","last_became_peered":"2024-09-21T06:46:38.838138+0000","last_unstale":"2024-09-21T06:46:38.843260+0000","last_undegraded":"2024-09-21T06:46:38.843260+0000","last_fullsized":"2024-09-21T06:46:38.843260+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:02.457731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833479+0000","last_change":"2024-09-21T06:46:37.828361+0000","last_active":"2024-09-21T06:46:37.833479+0000","last_peered":"2024-09-21T06:46:37.833479+0000","last_clean":"2024-09-21T06:46:37.833479+0000","last_became_active":"2024-09-21T06:46:37.828053+0000","last_became_peered":"2024-09-21T06:46:37.828053+0000","last_unstale":"2024-09-21T06:46:37.833479+0000","last_undegraded":"2024-09-21T06:46:37.833479+0000","last_fullsized":"2024-09-21T06:46:37.833479+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:55.015218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.843192+0000","last_change":"2024-09-21T06:46:38.835519+0000","last_active":"2024-09-21T06:46:38.843192+0000","last_peered":"2024-09-21T06:46:38.843192+0000","last_clean":"2024-09-21T06:46:38.843192+0000","last_became_active":"2024-09-21T06:46:38.835226+0000","last_became_peered":"2024-09-21T06:46:38.835226+0000","last_unstale":"2024-09-21T06:46:38.843192+0000","last_undegraded":"2024-09-21T06:46:38.843192+0000","last_fullsized":"2024-09-21T06:46:38.843192+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:43:31.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.833812+0000","last_change":"2024-09-21T06:46:37.828386+0000","last_active":"2024-09-21T06:46:37.833812+0000","last_peered":"2024-09-21T06:46:37.833812+0000","last_clean":"2024-09-21T06:46:37.833812+0000","last_became_active":"2024-09-21T06:46:37.827795+0000","last_became_peered":"2024-09-21T06:46:37.827795+0000","last_unstale":"2024-09-21T06:46:37.833812+0000","last_undegraded":"2024-09-21T06:46:37.833812+0000","last_fullsized":"2024-09-21T06:46:37.833812+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:17.657704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.815592+0000","last_change":"2024-09-21T06:46:37.815592+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.815592+0000","last_undegraded":"2024-09-21T06:46:37.815592+0000","last_fullsized":"2024-09-21T06:46:37.815592+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831398+0000","last_change":"2024-09-21T06:46:37.828721+0000","last_active":"2024-09-21T06:46:38.831398+0000","last_peered":"2024-09-21T06:46:38.831398+0000","last_clean":"2024-09-21T06:46:38.831398+0000","last_became_active":"2024-09-21T06:46:37.827838+0000","last_became_peered":"2024-09-21T06:46:37.827838+0000","last_unstale":"2024-09-21T06:46:38.831398+0000","last_undegraded":"2024-09-21T06:46:38.831398+0000","last_fullsized":"2024-09-21T06:46:38.831398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:34.881390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811128+0000","last_change":"2024-09-21T06:46:37.811128+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811128+0000","last_undegraded":"2024-09-21T06:46:37.811128+0000","last_fullsized":"2024-09-21T06:46:37.811128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.824899+0000","last_change":"2024-09-21T06:46:37.828979+0000","last_active":"2024-09-21T06:46:38.824899+0000","last_peered":"2024-09-21T06:46:38.824899+0000","last_clean":"2024-09-21T06:46:38.824899+0000","last_became_active":"2024-09-21T06:46:37.827049+0000","last_became_peered":"2024-09-21T06:46:37.827049+0000","last_unstale":"2024-09-21T06:46:38.824899+0000","last_undegraded":"2024-09-21T06:46:38.824899+0000","last_fullsized":"2024-09-21T06:46:38.824899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:41.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.813704+0000","last_change":"2024-09-21T06:46:37.813704+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.813704+0000","last_undegraded":"2024-09-21T06:46:37.813704+0000","last_fullsized":"2024-09-21T06:46:37.813704+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.828898+0000","last_change":"2024-09-21T06:46:37.824970+0000","last_active":"2024-09-21T06:46:37.828898+0000","last_peered":"2024-09-21T06:46:37.828898+0000","last_clean":"2024-09-21T06:46:37.828898+0000","last_became_active":"2024-09-21T06:46:37.824677+0000","last_became_peered":"2024-09-21T06:46:37.824677+0000","last_unstale":"2024-09-21T06:46:37.828898+0000","last_undegraded":"2024-09-21T06:46:37.828898+0000","last_fullsized":"2024-09-21T06:46:37.828898+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:05.066114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.851514+0000","last_change":"2024-09-21T06:46:38.845165+0000","last_active":"2024-09-21T06:46:38.851514+0000","last_peered":"2024-09-21T06:46:38.851514+0000","last_clean":"2024-09-21T06:46:38.851514+0000","last_became_active":"2024-09-21T06:46:38.844715+0000","last_became_peered":"2024-09-21T06:46:38.844715+0000","last_unstale":"2024-09-21T06:46:38.851514+0000","last_undegraded":"2024-09-21T06:46:38.851514+0000","last_fullsized":"2024-09-21T06:46:38.851514+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:34.402844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.825098+0000","last_change":"2024-09-21T06:46:37.824613+0000","last_active":"2024-09-21T06:46:38.825098+0000","last_peered":"2024-09-21T06:46:38.825098+0000","last_clean":"2024-09-21T06:46:38.825098+0000","last_became_active":"2024-09-21T06:46:37.824302+0000","last_became_peered":"2024-09-21T06:46:37.824302+0000","last_unstale":"2024-09-21T06:46:38.825098+0000","last_undegraded":"2024-09-21T06:46:38.825098+0000","last_fullsized":"2024-09-21T06:46:38.825098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:57.477737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.810322+0000","last_change":"2024-09-21T06:46:37.810322+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.810322+0000","last_undegraded":"2024-09-21T06:46:37.810322+0000","last_fullsized":"2024-09-21T06:46:37.810322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.823443+0000","last_change":"2024-09-21T06:46:37.821964+0000","last_active":"2024-09-21T06:46:37.823443+0000","last_peered":"2024-09-21T06:46:37.823443+0000","last_clean":"2024-09-21T06:46:37.823443+0000","last_became_active":"2024-09-21T06:46:37.821664+0000","last_became_peered":"2024-09-21T06:46:37.821664+0000","last_unstale":"2024-09-21T06:46:37.823443+0000","last_undegraded":"2024-09-21T06:46:37.823443+0000","last_fullsized":"2024-09-21T06:46:37.823443+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:47.227494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.814544+0000","last_change":"2024-09-21T06:46:37.814544+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.814544+0000","last_undegraded":"2024-09-21T06:46:37.814544+0000","last_fullsized":"2024-09-21T06:46:37.814544+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-21T06:46:37.829366+0000","last_change":"2024-09-21T06:46:37.821294+0000","last_active":"2024-09-21T06:46:37.829366+0000","last_peered":"2024-09-21T06:46:37.829366+0000","last_clean":"2024-09-21T06:46:37.829366+0000","last_became_active":"2024-09-21T06:46:37.820623+0000","last_became_peered":"2024-09-21T06:46:37.820623+0000","last_unstale":"2024-09-21T06:46:37.829366+0000","last_undegraded":"2024-09-21T06:46:37.829366+0000","last_fullsized":"2024-09-21T06:46:37.829366+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:15.971706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-09-21T06:46:37.811935+0000","last_change":"2024-09-21T06:46:37.811935+0000","last_active":"2024-09-21T06:46:37.803143+0000","last_peered":"2024-09-21T06:46:37.803143+0000","last_clean":"2024-09-21T06:46:37.803143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T06:46:37.811935+0000","last_undegraded":"2024-09-21T06:46:37.811935+0000","last_fullsized":"2024-09-21T06:46:37.811935+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.831642+0000","last_change":"2024-09-21T06:46:37.829723+0000","last_active":"2024-09-21T06:46:38.831642+0000","last_peered":"2024-09-21T06:46:38.831642+0000","last_clean":"2024-09-21T06:46:38.831642+0000","last_became_active":"2024-09-21T06:46:37.829452+0000","last_became_peered":"2024-09-21T06:46:37.829452+0000","last_unstale":"2024-09-21T06:46:38.831642+0000","last_undegraded":"2024-09-21T06:46:38.831642+0000","last_fullsized":"2024-09-21T06:46:38.831642+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.342847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":166,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-21T06:46:38.833441+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:38.833441+0000","last_peered":"2024-09-21T06:46:38.833441+0000","last_clean":"2024-09-21T06:46:38.833441+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:38.833441+0000","last_undegraded":"2024-09-21T06:46:38.833441+0000","last_fullsized":"2024-09-21T06:46:38.833441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1772,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":4056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":257140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":854175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":263807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:44.797 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-21T06:46:44.796+0000 7efe7a36c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:46:47.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:46:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.422+0000 7fd3a084d640 1 -- 172.21.15.81:0/2908260966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384004d90 msgr2=0x7fd384005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.422+0000 7fd3a084d640 1 --2- 172.21.15.81:0/2908260966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd384004d90 0x7fd384005220 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd394009ed0 tx=0x7fd384005830 comp rx=0 tx=0).stop 2024-09-21T06:46:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.422+0000 7fd39ad9d640 1 -- 172.21.15.81:0/2908260966 reap_dead start 2024-09-21T06:46:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.422+0000 7fd3a084d640 1 -- 172.21.15.81:0/2908260966 shutdown_connections 2024-09-21T06:46:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.422+0000 7fd3a084d640 1 -- 172.21.15.81:0/2908260966 >> 172.21.15.81:0/2908260966 conn(0x7fd39c0d25e0 msgr2=0x7fd39c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.422+0000 7fd3a084d640 1 -- 172.21.15.81:0/2908260966 shutdown_connections 2024-09-21T06:46:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.422+0000 7fd3a084d640 1 -- 172.21.15.81:0/2908260966 wait complete. 2024-09-21T06:46:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.424+0000 7fd3a084d640 1 Processor -- start 2024-09-21T06:46:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.424+0000 7fd3a084d640 1 -- start start 2024-09-21T06:46:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd3a084d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd384004d90 0x7fd39c159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd3a084d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c14c670 0x7fd39c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd3a084d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd39c15f260 0x7fd39c0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd3a084d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c15db50 con 0x7fd39c14c670 2024-09-21T06:46:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd3a084d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c15d9d0 con 0x7fd384004d90 2024-09-21T06:46:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd3a084d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd39c072d40 con 0x7fd39c15f260 2024-09-21T06:46:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c14c670 0x7fd39c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c14c670 0x7fd39c15ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58416/0 (socket says 172.21.15.81:58416) 2024-09-21T06:46:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 -- 172.21.15.81:0/2093480038 learned_addr learned my addr 172.21.15.81:0/2093480038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd39ad9d640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd39c15f260 0x7fd39c0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd39a59c640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd384004d90 0x7fd39c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 -- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd39c15f260 msgr2=0x7fd39c0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd39c15f260 0x7fd39c0c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 -- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd384004d90 msgr2=0x7fd39c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd384004d90 0x7fd39c159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 -- 172.21.15.81:0/2093480038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c158de0 con 0x7fd39c14c670 2024-09-21T06:46:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd399d9b640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c14c670 0x7fd39c15ed20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd390001050 tx=0x7fd3900039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.426+0000 7fd38affd640 1 -- 172.21.15.81:0/2093480038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390015070 con 0x7fd39c14c670 2024-09-21T06:46:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.427+0000 7fd38affd640 1 -- 172.21.15.81:0/2093480038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd390011900 con 0x7fd39c14c670 2024-09-21T06:46:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.427+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39c15f670 con 0x7fd39c14c670 2024-09-21T06:46:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.427+0000 7fd38affd640 1 -- 172.21.15.81:0/2093480038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390011d50 con 0x7fd39c14c670 2024-09-21T06:46:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.427+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39c0c5d90 con 0x7fd39c14c670 2024-09-21T06:46:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.428+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39c0b7780 con 0x7fd39c14c670 2024-09-21T06:46:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.428+0000 7fd38affd640 1 -- 172.21.15.81:0/2093480038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd39000f430 con 0x7fd39c14c670 2024-09-21T06:46:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.429+0000 7fd38affd640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd37c078bc0 0x7fd37c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.429+0000 7fd38affd640 1 -- 172.21.15.81:0/2093480038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fd39009bc00 con 0x7fd39c14c670 2024-09-21T06:46:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.429+0000 7fd39a59c640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd37c078bc0 0x7fd37c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.430+0000 7fd39a59c640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd37c078bc0 0x7fd37c07b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0064a0 tx=0x7fd38c006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.433+0000 7fd38affd640 1 -- 172.21.15.81:0/2093480038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd3900a2080 con 0x7fd39c14c670 2024-09-21T06:46:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.607+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd39c0732a0 con 0x7fd37c078bc0 2024-09-21T06:46:47.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.612+0000 7fd38affd640 1 -- 172.21.15.81:0/2093480038 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7fd39c0732a0 con 0x7fd37c078bc0 2024-09-21T06:46:47.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:46:47.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd37c078bc0 msgr2=0x7fd37c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd37c078bc0 0x7fd37c07b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0064a0 tx=0x7fd38c006b10 comp rx=0 tx=0).stop 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c14c670 msgr2=0x7fd39c15ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c14c670 0x7fd39c15ed20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd390001050 tx=0x7fd3900039c0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 shutdown_connections 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd37c078bc0 0x7fd37c07b0d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd39c15f260 0x7fd39c0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39c14c670 0x7fd39c15ed20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 --2- 172.21.15.81:0/2093480038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd384004d90 0x7fd39c159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 >> 172.21.15.81:0/2093480038 conn(0x7fd39c0d25e0 msgr2=0x7fd39c0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 shutdown_connections 2024-09-21T06:46:47.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.615+0000 7fd3a084d640 1 -- 172.21.15.81:0/2093480038 wait complete. 2024-09-21T06:46:47.629 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-21T06:46:46.674406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222388,"kb_used_data":6120,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752332,"statfs":{"total":773094113280,"available":772866387968,"internally_reserved":0,"allocated":6266880,"data_stored":3406884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002293"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845839+0000","last_change":"2024-09-21T06:46:38.848662+0000","last_active":"2024-09-21T06:46:39.845839+0000","last_peered":"2024-09-21T06:46:39.845839+0000","last_clean":"2024-09-21T06:46:39.845839+0000","last_became_active":"2024-09-21T06:46:38.848349+0000","last_became_peered":"2024-09-21T06:46:38.848349+0000","last_unstale":"2024-09-21T06:46:39.845839+0000","last_undegraded":"2024-09-21T06:46:39.845839+0000","last_fullsized":"2024-09-21T06:46:39.845839+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:41:37.597090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.843348+0000","last_change":"2024-09-21T06:46:38.856886+0000","last_active":"2024-09-21T06:46:39.843348+0000","last_peered":"2024-09-21T06:46:39.843348+0000","last_clean":"2024-09-21T06:46:39.843348+0000","last_became_active":"2024-09-21T06:46:38.856509+0000","last_became_peered":"2024-09-21T06:46:38.856509+0000","last_unstale":"2024-09-21T06:46:39.843348+0000","last_undegraded":"2024-09-21T06:46:39.843348+0000","last_fullsized":"2024-09-21T06:46:39.843348+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:27.459424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847934+0000","last_change":"2024-09-21T06:46:38.836247+0000","last_active":"2024-09-21T06:46:39.847934+0000","last_peered":"2024-09-21T06:46:39.847934+0000","last_clean":"2024-09-21T06:46:39.847934+0000","last_became_active":"2024-09-21T06:46:38.835897+0000","last_became_peered":"2024-09-21T06:46:38.835897+0000","last_unstale":"2024-09-21T06:46:39.847934+0000","last_undegraded":"2024-09-21T06:46:39.847934+0000","last_fullsized":"2024-09-21T06:46:39.847934+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:18.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098295+0000","last_change":"2024-09-21T06:46:38.844482+0000","last_active":"2024-09-21T06:46:40.098295+0000","last_peered":"2024-09-21T06:46:40.098295+0000","last_clean":"2024-09-21T06:46:40.098295+0000","last_became_active":"2024-09-21T06:46:38.844161+0000","last_became_peered":"2024-09-21T06:46:38.844161+0000","last_unstale":"2024-09-21T06:46:40.098295+0000","last_undegraded":"2024-09-21T06:46:40.098295+0000","last_fullsized":"2024-09-21T06:46:40.098295+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:34.165141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845261+0000","last_change":"2024-09-21T06:46:38.851281+0000","last_active":"2024-09-21T06:46:39.845261+0000","last_peered":"2024-09-21T06:46:39.845261+0000","last_clean":"2024-09-21T06:46:39.845261+0000","last_became_active":"2024-09-21T06:46:38.850848+0000","last_became_peered":"2024-09-21T06:46:38.850848+0000","last_unstale":"2024-09-21T06:46:39.845261+0000","last_undegraded":"2024-09-21T06:46:39.845261+0000","last_fullsized":"2024-09-21T06:46:39.845261+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:50.155582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845154+0000","last_change":"2024-09-21T06:46:38.852814+0000","last_active":"2024-09-21T06:46:39.845154+0000","last_peered":"2024-09-21T06:46:39.845154+0000","last_clean":"2024-09-21T06:46:39.845154+0000","last_became_active":"2024-09-21T06:46:38.851992+0000","last_became_peered":"2024-09-21T06:46:38.851992+0000","last_unstale":"2024-09-21T06:46:39.845154+0000","last_undegraded":"2024-09-21T06:46:39.845154+0000","last_fullsized":"2024-09-21T06:46:39.845154+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:57.302342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098003+0000","last_change":"2024-09-21T06:46:38.837455+0000","last_active":"2024-09-21T06:46:40.098003+0000","last_peered":"2024-09-21T06:46:40.098003+0000","last_clean":"2024-09-21T06:46:40.098003+0000","last_became_active":"2024-09-21T06:46:38.837170+0000","last_became_peered":"2024-09-21T06:46:38.837170+0000","last_unstale":"2024-09-21T06:46:40.098003+0000","last_undegraded":"2024-09-21T06:46:40.098003+0000","last_fullsized":"2024-09-21T06:46:40.098003+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:30.440179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841091+0000","last_change":"2024-09-21T06:46:38.840324+0000","last_active":"2024-09-21T06:46:39.841091+0000","last_peered":"2024-09-21T06:46:39.841091+0000","last_clean":"2024-09-21T06:46:39.841091+0000","last_became_active":"2024-09-21T06:46:38.839855+0000","last_became_peered":"2024-09-21T06:46:38.839855+0000","last_unstale":"2024-09-21T06:46:39.841091+0000","last_undegraded":"2024-09-21T06:46:39.841091+0000","last_fullsized":"2024-09-21T06:46:39.841091+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:39.299303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.836138+0000","last_change":"2024-09-21T06:46:38.856546+0000","last_active":"2024-09-21T06:46:39.836138+0000","last_peered":"2024-09-21T06:46:39.836138+0000","last_clean":"2024-09-21T06:46:39.836138+0000","last_became_active":"2024-09-21T06:46:38.856240+0000","last_became_peered":"2024-09-21T06:46:38.856240+0000","last_unstale":"2024-09-21T06:46:39.836138+0000","last_undegraded":"2024-09-21T06:46:39.836138+0000","last_fullsized":"2024-09-21T06:46:39.836138+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:58.924893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845528+0000","last_change":"2024-09-21T06:46:38.855511+0000","last_active":"2024-09-21T06:46:39.845528+0000","last_peered":"2024-09-21T06:46:39.845528+0000","last_clean":"2024-09-21T06:46:39.845528+0000","last_became_active":"2024-09-21T06:46:38.855165+0000","last_became_peered":"2024-09-21T06:46:38.855165+0000","last_unstale":"2024-09-21T06:46:39.845528+0000","last_undegraded":"2024-09-21T06:46:39.845528+0000","last_fullsized":"2024-09-21T06:46:39.845528+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:04.078402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098181+0000","last_change":"2024-09-21T06:46:38.852827+0000","last_active":"2024-09-21T06:46:40.098181+0000","last_peered":"2024-09-21T06:46:40.098181+0000","last_clean":"2024-09-21T06:46:40.098181+0000","last_became_active":"2024-09-21T06:46:38.852481+0000","last_became_peered":"2024-09-21T06:46:38.852481+0000","last_unstale":"2024-09-21T06:46:40.098181+0000","last_undegraded":"2024-09-21T06:46:40.098181+0000","last_fullsized":"2024-09-21T06:46:40.098181+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:05.219202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.835915+0000","last_change":"2024-09-21T06:46:38.840765+0000","last_active":"2024-09-21T06:46:39.835915+0000","last_peered":"2024-09-21T06:46:39.835915+0000","last_clean":"2024-09-21T06:46:39.835915+0000","last_became_active":"2024-09-21T06:46:38.840430+0000","last_became_peered":"2024-09-21T06:46:38.840430+0000","last_unstale":"2024-09-21T06:46:39.835915+0000","last_undegraded":"2024-09-21T06:46:39.835915+0000","last_fullsized":"2024-09-21T06:46:39.835915+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:51.596939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097788+0000","last_change":"2024-09-21T06:46:38.844070+0000","last_active":"2024-09-21T06:46:40.097788+0000","last_peered":"2024-09-21T06:46:40.097788+0000","last_clean":"2024-09-21T06:46:40.097788+0000","last_became_active":"2024-09-21T06:46:38.843603+0000","last_became_peered":"2024-09-21T06:46:38.843603+0000","last_unstale":"2024-09-21T06:46:40.097788+0000","last_undegraded":"2024-09-21T06:46:40.097788+0000","last_fullsized":"2024-09-21T06:46:40.097788+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:00.767353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847659+0000","last_change":"2024-09-21T06:46:38.832845+0000","last_active":"2024-09-21T06:46:39.847659+0000","last_peered":"2024-09-21T06:46:39.847659+0000","last_clean":"2024-09-21T06:46:39.847659+0000","last_became_active":"2024-09-21T06:46:38.832523+0000","last_became_peered":"2024-09-21T06:46:38.832523+0000","last_unstale":"2024-09-21T06:46:39.847659+0000","last_undegraded":"2024-09-21T06:46:39.847659+0000","last_fullsized":"2024-09-21T06:46:39.847659+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:37:46.918012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098206+0000","last_change":"2024-09-21T06:46:38.845822+0000","last_active":"2024-09-21T06:46:40.098206+0000","last_peered":"2024-09-21T06:46:40.098206+0000","last_clean":"2024-09-21T06:46:40.098206+0000","last_became_active":"2024-09-21T06:46:38.845446+0000","last_became_peered":"2024-09-21T06:46:38.845446+0000","last_unstale":"2024-09-21T06:46:40.098206+0000","last_undegraded":"2024-09-21T06:46:40.098206+0000","last_fullsized":"2024-09-21T06:46:40.098206+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:14.371045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845175+0000","last_change":"2024-09-21T06:46:38.850258+0000","last_active":"2024-09-21T06:46:39.845175+0000","last_peered":"2024-09-21T06:46:39.845175+0000","last_clean":"2024-09-21T06:46:39.845175+0000","last_became_active":"2024-09-21T06:46:38.849860+0000","last_became_peered":"2024-09-21T06:46:38.849860+0000","last_unstale":"2024-09-21T06:46:39.845175+0000","last_undegraded":"2024-09-21T06:46:39.845175+0000","last_fullsized":"2024-09-21T06:46:39.845175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:34.025965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845862+0000","last_change":"2024-09-21T06:46:38.853362+0000","last_active":"2024-09-21T06:46:39.845862+0000","last_peered":"2024-09-21T06:46:39.845862+0000","last_clean":"2024-09-21T06:46:39.845862+0000","last_became_active":"2024-09-21T06:46:38.852470+0000","last_became_peered":"2024-09-21T06:46:38.852470+0000","last_unstale":"2024-09-21T06:46:39.845862+0000","last_undegraded":"2024-09-21T06:46:39.845862+0000","last_fullsized":"2024-09-21T06:46:39.845862+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:18:42.508590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847983+0000","last_change":"2024-09-21T06:46:38.841494+0000","last_active":"2024-09-21T06:46:39.847983+0000","last_peered":"2024-09-21T06:46:39.847983+0000","last_clean":"2024-09-21T06:46:39.847983+0000","last_became_active":"2024-09-21T06:46:38.841161+0000","last_became_peered":"2024-09-21T06:46:38.841161+0000","last_unstale":"2024-09-21T06:46:39.847983+0000","last_undegraded":"2024-09-21T06:46:39.847983+0000","last_fullsized":"2024-09-21T06:46:39.847983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:24.003257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.843328+0000","last_change":"2024-09-21T06:46:38.851960+0000","last_active":"2024-09-21T06:46:39.843328+0000","last_peered":"2024-09-21T06:46:39.843328+0000","last_clean":"2024-09-21T06:46:39.843328+0000","last_became_active":"2024-09-21T06:46:38.849450+0000","last_became_peered":"2024-09-21T06:46:38.849450+0000","last_unstale":"2024-09-21T06:46:39.843328+0000","last_undegraded":"2024-09-21T06:46:39.843328+0000","last_fullsized":"2024-09-21T06:46:39.843328+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:40.804826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098254+0000","last_change":"2024-09-21T06:46:38.847209+0000","last_active":"2024-09-21T06:46:40.098254+0000","last_peered":"2024-09-21T06:46:40.098254+0000","last_clean":"2024-09-21T06:46:40.098254+0000","last_became_active":"2024-09-21T06:46:38.846794+0000","last_became_peered":"2024-09-21T06:46:38.846794+0000","last_unstale":"2024-09-21T06:46:40.098254+0000","last_undegraded":"2024-09-21T06:46:40.098254+0000","last_fullsized":"2024-09-21T06:46:40.098254+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:49.730580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098001+0000","last_change":"2024-09-21T06:46:38.844395+0000","last_active":"2024-09-21T06:46:40.098001+0000","last_peered":"2024-09-21T06:46:40.098001+0000","last_clean":"2024-09-21T06:46:40.098001+0000","last_became_active":"2024-09-21T06:46:38.844030+0000","last_became_peered":"2024-09-21T06:46:38.844030+0000","last_unstale":"2024-09-21T06:46:40.098001+0000","last_undegraded":"2024-09-21T06:46:40.098001+0000","last_fullsized":"2024-09-21T06:46:40.098001+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:56.610692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098181+0000","last_change":"2024-09-21T06:46:38.835173+0000","last_active":"2024-09-21T06:46:40.098181+0000","last_peered":"2024-09-21T06:46:40.098181+0000","last_clean":"2024-09-21T06:46:40.098181+0000","last_became_active":"2024-09-21T06:46:38.834850+0000","last_became_peered":"2024-09-21T06:46:38.834850+0000","last_unstale":"2024-09-21T06:46:40.098181+0000","last_undegraded":"2024-09-21T06:46:40.098181+0000","last_fullsized":"2024-09-21T06:46:40.098181+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:02.536455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098010+0000","last_change":"2024-09-21T06:46:38.838558+0000","last_active":"2024-09-21T06:46:40.098010+0000","last_peered":"2024-09-21T06:46:40.098010+0000","last_clean":"2024-09-21T06:46:40.098010+0000","last_became_active":"2024-09-21T06:46:38.838256+0000","last_became_peered":"2024-09-21T06:46:38.838256+0000","last_unstale":"2024-09-21T06:46:40.098010+0000","last_undegraded":"2024-09-21T06:46:40.098010+0000","last_fullsized":"2024-09-21T06:46:40.098010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:55.341064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.835777+0000","last_change":"2024-09-21T06:46:38.856520+0000","last_active":"2024-09-21T06:46:39.835777+0000","last_peered":"2024-09-21T06:46:39.835777+0000","last_clean":"2024-09-21T06:46:39.835777+0000","last_became_active":"2024-09-21T06:46:38.856171+0000","last_became_peered":"2024-09-21T06:46:38.856171+0000","last_unstale":"2024-09-21T06:46:39.835777+0000","last_undegraded":"2024-09-21T06:46:39.835777+0000","last_fullsized":"2024-09-21T06:46:39.835777+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:52.667770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.843234+0000","last_change":"2024-09-21T06:46:38.856820+0000","last_active":"2024-09-21T06:46:39.843234+0000","last_peered":"2024-09-21T06:46:39.843234+0000","last_clean":"2024-09-21T06:46:39.843234+0000","last_became_active":"2024-09-21T06:46:38.856491+0000","last_became_peered":"2024-09-21T06:46:38.856491+0000","last_unstale":"2024-09-21T06:46:39.843234+0000","last_undegraded":"2024-09-21T06:46:39.843234+0000","last_fullsized":"2024-09-21T06:46:39.843234+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:52.667770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097908+0000","last_change":"2024-09-21T06:46:38.836327+0000","last_active":"2024-09-21T06:46:40.097908+0000","last_peered":"2024-09-21T06:46:40.097908+0000","last_clean":"2024-09-21T06:46:40.097908+0000","last_became_active":"2024-09-21T06:46:38.836032+0000","last_became_peered":"2024-09-21T06:46:38.836032+0000","last_unstale":"2024-09-21T06:46:40.097908+0000","last_undegraded":"2024-09-21T06:46:40.097908+0000","last_fullsized":"2024-09-21T06:46:40.097908+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:18.427706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.843528+0000","last_change":"2024-09-21T06:46:38.847375+0000","last_active":"2024-09-21T06:46:39.843528+0000","last_peered":"2024-09-21T06:46:39.843528+0000","last_clean":"2024-09-21T06:46:39.843528+0000","last_became_active":"2024-09-21T06:46:38.847011+0000","last_became_peered":"2024-09-21T06:46:38.847011+0000","last_unstale":"2024-09-21T06:46:39.843528+0000","last_undegraded":"2024-09-21T06:46:39.843528+0000","last_fullsized":"2024-09-21T06:46:39.843528+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:51.596939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841403+0000","last_change":"2024-09-21T06:46:38.838737+0000","last_active":"2024-09-21T06:46:39.841403+0000","last_peered":"2024-09-21T06:46:39.841403+0000","last_clean":"2024-09-21T06:46:39.841403+0000","last_became_active":"2024-09-21T06:46:38.838414+0000","last_became_peered":"2024-09-21T06:46:38.838414+0000","last_unstale":"2024-09-21T06:46:39.841403+0000","last_undegraded":"2024-09-21T06:46:39.841403+0000","last_fullsized":"2024-09-21T06:46:39.841403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:25.700279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841561+0000","last_change":"2024-09-21T06:46:38.843232+0000","last_active":"2024-09-21T06:46:39.841561+0000","last_peered":"2024-09-21T06:46:39.841561+0000","last_clean":"2024-09-21T06:46:39.841561+0000","last_became_active":"2024-09-21T06:46:38.842685+0000","last_became_peered":"2024-09-21T06:46:38.842685+0000","last_unstale":"2024-09-21T06:46:39.841561+0000","last_undegraded":"2024-09-21T06:46:39.841561+0000","last_fullsized":"2024-09-21T06:46:39.841561+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:09.088011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097515+0000","last_change":"2024-09-21T06:46:38.839817+0000","last_active":"2024-09-21T06:46:40.097515+0000","last_peered":"2024-09-21T06:46:40.097515+0000","last_clean":"2024-09-21T06:46:40.097515+0000","last_became_active":"2024-09-21T06:46:38.839497+0000","last_became_peered":"2024-09-21T06:46:38.839497+0000","last_unstale":"2024-09-21T06:46:40.097515+0000","last_undegraded":"2024-09-21T06:46:40.097515+0000","last_fullsized":"2024-09-21T06:46:40.097515+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:28:18.908671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.842504+0000","last_change":"2024-09-21T06:46:38.844790+0000","last_active":"2024-09-21T06:46:39.842504+0000","last_peered":"2024-09-21T06:46:39.842504+0000","last_clean":"2024-09-21T06:46:39.842504+0000","last_became_active":"2024-09-21T06:46:38.844479+0000","last_became_peered":"2024-09-21T06:46:38.844479+0000","last_unstale":"2024-09-21T06:46:39.842504+0000","last_undegraded":"2024-09-21T06:46:39.842504+0000","last_fullsized":"2024-09-21T06:46:39.842504+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:44.819668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097898+0000","last_change":"2024-09-21T06:46:38.834655+0000","last_active":"2024-09-21T06:46:40.097898+0000","last_peered":"2024-09-21T06:46:40.097898+0000","last_clean":"2024-09-21T06:46:40.097898+0000","last_became_active":"2024-09-21T06:46:38.834361+0000","last_became_peered":"2024-09-21T06:46:38.834361+0000","last_unstale":"2024-09-21T06:46:40.097898+0000","last_undegraded":"2024-09-21T06:46:40.097898+0000","last_fullsized":"2024-09-21T06:46:40.097898+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:31.797030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845604+0000","last_change":"2024-09-21T06:46:38.846427+0000","last_active":"2024-09-21T06:46:39.845604+0000","last_peered":"2024-09-21T06:46:39.845604+0000","last_clean":"2024-09-21T06:46:39.845604+0000","last_became_active":"2024-09-21T06:46:38.845924+0000","last_became_peered":"2024-09-21T06:46:38.845924+0000","last_unstale":"2024-09-21T06:46:39.845604+0000","last_undegraded":"2024-09-21T06:46:39.845604+0000","last_fullsized":"2024-09-21T06:46:39.845604+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:42.574553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"52'4","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098158+0000","last_change":"2024-09-21T06:46:37.822060+0000","last_active":"2024-09-21T06:46:40.098158+0000","last_peered":"2024-09-21T06:46:40.098158+0000","last_clean":"2024-09-21T06:46:40.098158+0000","last_became_active":"2024-09-21T06:46:37.821749+0000","last_became_peered":"2024-09-21T06:46:37.821749+0000","last_unstale":"2024-09-21T06:46:40.098158+0000","last_undegraded":"2024-09-21T06:46:40.098158+0000","last_fullsized":"2024-09-21T06:46:40.098158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:42.851842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.846058+0000","last_change":"2024-09-21T06:46:38.851757+0000","last_active":"2024-09-21T06:46:39.846058+0000","last_peered":"2024-09-21T06:46:39.846058+0000","last_clean":"2024-09-21T06:46:39.846058+0000","last_became_active":"2024-09-21T06:46:38.851436+0000","last_became_peered":"2024-09-21T06:46:38.851436+0000","last_unstale":"2024-09-21T06:46:39.846058+0000","last_undegraded":"2024-09-21T06:46:39.846058+0000","last_fullsized":"2024-09-21T06:46:39.846058+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:04:41.634010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"52'1","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.843468+0000","last_change":"2024-09-21T06:46:37.825639+0000","last_active":"2024-09-21T06:46:39.843468+0000","last_peered":"2024-09-21T06:46:39.843468+0000","last_clean":"2024-09-21T06:46:39.843468+0000","last_became_active":"2024-09-21T06:46:37.825329+0000","last_became_peered":"2024-09-21T06:46:37.825329+0000","last_unstale":"2024-09-21T06:46:39.843468+0000","last_undegraded":"2024-09-21T06:46:39.843468+0000","last_fullsized":"2024-09-21T06:46:39.843468+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:34.237466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841668+0000","last_change":"2024-09-21T06:46:38.851149+0000","last_active":"2024-09-21T06:46:39.841668+0000","last_peered":"2024-09-21T06:46:39.841668+0000","last_clean":"2024-09-21T06:46:39.841668+0000","last_became_active":"2024-09-21T06:46:38.850653+0000","last_became_peered":"2024-09-21T06:46:38.850653+0000","last_unstale":"2024-09-21T06:46:39.841668+0000","last_undegraded":"2024-09-21T06:46:39.841668+0000","last_fullsized":"2024-09-21T06:46:39.841668+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:55.576561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"52'2","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845625+0000","last_change":"2024-09-21T06:46:37.827885+0000","last_active":"2024-09-21T06:46:39.845625+0000","last_peered":"2024-09-21T06:46:39.845625+0000","last_clean":"2024-09-21T06:46:39.845625+0000","last_became_active":"2024-09-21T06:46:37.827560+0000","last_became_peered":"2024-09-21T06:46:37.827560+0000","last_unstale":"2024-09-21T06:46:39.845625+0000","last_undegraded":"2024-09-21T06:46:39.845625+0000","last_fullsized":"2024-09-21T06:46:39.845625+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:29.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845436+0000","last_change":"2024-09-21T06:46:38.856224+0000","last_active":"2024-09-21T06:46:39.845436+0000","last_peered":"2024-09-21T06:46:39.845436+0000","last_clean":"2024-09-21T06:46:39.845436+0000","last_became_active":"2024-09-21T06:46:38.855633+0000","last_became_peered":"2024-09-21T06:46:38.855633+0000","last_unstale":"2024-09-21T06:46:39.845436+0000","last_undegraded":"2024-09-21T06:46:39.845436+0000","last_fullsized":"2024-09-21T06:46:39.845436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:38:09.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"52'2","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098424+0000","last_change":"2024-09-21T06:46:37.827573+0000","last_active":"2024-09-21T06:46:40.098424+0000","last_peered":"2024-09-21T06:46:40.098424+0000","last_clean":"2024-09-21T06:46:40.098424+0000","last_became_active":"2024-09-21T06:46:37.827205+0000","last_became_peered":"2024-09-21T06:46:37.827205+0000","last_unstale":"2024-09-21T06:46:40.098424+0000","last_undegraded":"2024-09-21T06:46:40.098424+0000","last_fullsized":"2024-09-21T06:46:40.098424+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:44.653930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841224+0000","last_change":"2024-09-21T06:46:38.832848+0000","last_active":"2024-09-21T06:46:39.841224+0000","last_peered":"2024-09-21T06:46:39.841224+0000","last_clean":"2024-09-21T06:46:39.841224+0000","last_became_active":"2024-09-21T06:46:38.832523+0000","last_became_peered":"2024-09-21T06:46:38.832523+0000","last_unstale":"2024-09-21T06:46:39.841224+0000","last_undegraded":"2024-09-21T06:46:39.841224+0000","last_fullsized":"2024-09-21T06:46:39.841224+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:42:34.472070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"52'1","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847697+0000","last_change":"2024-09-21T06:46:37.829136+0000","last_active":"2024-09-21T06:46:39.847697+0000","last_peered":"2024-09-21T06:46:39.847697+0000","last_clean":"2024-09-21T06:46:39.847697+0000","last_became_active":"2024-09-21T06:46:37.828745+0000","last_became_peered":"2024-09-21T06:46:37.828745+0000","last_unstale":"2024-09-21T06:46:39.847697+0000","last_undegraded":"2024-09-21T06:46:39.847697+0000","last_fullsized":"2024-09-21T06:46:39.847697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:32.045906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098275+0000","last_change":"2024-09-21T06:46:38.838647+0000","last_active":"2024-09-21T06:46:40.098275+0000","last_peered":"2024-09-21T06:46:40.098275+0000","last_clean":"2024-09-21T06:46:40.098275+0000","last_became_active":"2024-09-21T06:46:38.838298+0000","last_became_peered":"2024-09-21T06:46:38.838298+0000","last_unstale":"2024-09-21T06:46:40.098275+0000","last_undegraded":"2024-09-21T06:46:40.098275+0000","last_fullsized":"2024-09-21T06:46:40.098275+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:17.171146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"52'1","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845464+0000","last_change":"2024-09-21T06:46:37.826987+0000","last_active":"2024-09-21T06:46:39.845464+0000","last_peered":"2024-09-21T06:46:39.845464+0000","last_clean":"2024-09-21T06:46:39.845464+0000","last_became_active":"2024-09-21T06:46:37.826675+0000","last_became_peered":"2024-09-21T06:46:37.826675+0000","last_unstale":"2024-09-21T06:46:39.845464+0000","last_undegraded":"2024-09-21T06:46:39.845464+0000","last_fullsized":"2024-09-21T06:46:39.845464+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:07.692889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847608+0000","last_change":"2024-09-21T06:46:38.843367+0000","last_active":"2024-09-21T06:46:39.847608+0000","last_peered":"2024-09-21T06:46:39.847608+0000","last_clean":"2024-09-21T06:46:39.847608+0000","last_became_active":"2024-09-21T06:46:38.842758+0000","last_became_peered":"2024-09-21T06:46:38.842758+0000","last_unstale":"2024-09-21T06:46:39.847608+0000","last_undegraded":"2024-09-21T06:46:39.847608+0000","last_fullsized":"2024-09-21T06:46:39.847608+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:32.211076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.835833+0000","last_change":"2024-09-21T06:46:37.822573+0000","last_active":"2024-09-21T06:46:39.835833+0000","last_peered":"2024-09-21T06:46:39.835833+0000","last_clean":"2024-09-21T06:46:39.835833+0000","last_became_active":"2024-09-21T06:46:37.822248+0000","last_became_peered":"2024-09-21T06:46:37.822248+0000","last_unstale":"2024-09-21T06:46:39.835833+0000","last_undegraded":"2024-09-21T06:46:39.835833+0000","last_fullsized":"2024-09-21T06:46:39.835833+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:47.124858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845100+0000","last_change":"2024-09-21T06:46:38.850973+0000","last_active":"2024-09-21T06:46:39.845100+0000","last_peered":"2024-09-21T06:46:39.845100+0000","last_clean":"2024-09-21T06:46:39.845100+0000","last_became_active":"2024-09-21T06:46:38.850655+0000","last_became_peered":"2024-09-21T06:46:38.850655+0000","last_unstale":"2024-09-21T06:46:39.845100+0000","last_undegraded":"2024-09-21T06:46:39.845100+0000","last_fullsized":"2024-09-21T06:46:39.845100+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:05.638517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097466+0000","last_change":"2024-09-21T06:46:37.821564+0000","last_active":"2024-09-21T06:46:40.097466+0000","last_peered":"2024-09-21T06:46:40.097466+0000","last_clean":"2024-09-21T06:46:40.097466+0000","last_became_active":"2024-09-21T06:46:37.821236+0000","last_became_peered":"2024-09-21T06:46:37.821236+0000","last_unstale":"2024-09-21T06:46:40.097466+0000","last_undegraded":"2024-09-21T06:46:40.097466+0000","last_fullsized":"2024-09-21T06:46:40.097466+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:32:48.720460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097917+0000","last_change":"2024-09-21T06:46:38.835282+0000","last_active":"2024-09-21T06:46:40.097917+0000","last_peered":"2024-09-21T06:46:40.097917+0000","last_clean":"2024-09-21T06:46:40.097917+0000","last_became_active":"2024-09-21T06:46:38.834952+0000","last_became_peered":"2024-09-21T06:46:38.834952+0000","last_unstale":"2024-09-21T06:46:40.097917+0000","last_undegraded":"2024-09-21T06:46:40.097917+0000","last_fullsized":"2024-09-21T06:46:40.097917+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:03.295528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.835963+0000","last_change":"2024-09-21T06:46:37.825931+0000","last_active":"2024-09-21T06:46:39.835963+0000","last_peered":"2024-09-21T06:46:39.835963+0000","last_clean":"2024-09-21T06:46:39.835963+0000","last_became_active":"2024-09-21T06:46:37.825590+0000","last_became_peered":"2024-09-21T06:46:37.825590+0000","last_unstale":"2024-09-21T06:46:39.835963+0000","last_undegraded":"2024-09-21T06:46:39.835963+0000","last_fullsized":"2024-09-21T06:46:39.835963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:26.397972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847983+0000","last_change":"2024-09-21T06:46:38.833931+0000","last_active":"2024-09-21T06:46:39.847983+0000","last_peered":"2024-09-21T06:46:39.847983+0000","last_clean":"2024-09-21T06:46:39.847983+0000","last_became_active":"2024-09-21T06:46:38.833613+0000","last_became_peered":"2024-09-21T06:46:38.833613+0000","last_unstale":"2024-09-21T06:46:39.847983+0000","last_undegraded":"2024-09-21T06:46:39.847983+0000","last_fullsized":"2024-09-21T06:46:39.847983+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:58.924893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841469+0000","last_change":"2024-09-21T06:46:37.819621+0000","last_active":"2024-09-21T06:46:39.841469+0000","last_peered":"2024-09-21T06:46:39.841469+0000","last_clean":"2024-09-21T06:46:39.841469+0000","last_became_active":"2024-09-21T06:46:37.817183+0000","last_became_peered":"2024-09-21T06:46:37.817183+0000","last_unstale":"2024-09-21T06:46:39.841469+0000","last_undegraded":"2024-09-21T06:46:39.841469+0000","last_fullsized":"2024-09-21T06:46:39.841469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:51.662185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841948+0000","last_change":"2024-09-21T06:46:38.844765+0000","last_active":"2024-09-21T06:46:39.841948+0000","last_peered":"2024-09-21T06:46:39.841948+0000","last_clean":"2024-09-21T06:46:39.841948+0000","last_became_active":"2024-09-21T06:46:38.844443+0000","last_became_peered":"2024-09-21T06:46:38.844443+0000","last_unstale":"2024-09-21T06:46:39.841948+0000","last_undegraded":"2024-09-21T06:46:39.841948+0000","last_fullsized":"2024-09-21T06:46:39.841948+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:06.123979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"52'3","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097973+0000","last_change":"2024-09-21T06:46:37.827697+0000","last_active":"2024-09-21T06:46:40.097973+0000","last_peered":"2024-09-21T06:46:40.097973+0000","last_clean":"2024-09-21T06:46:40.097973+0000","last_became_active":"2024-09-21T06:46:37.827400+0000","last_became_peered":"2024-09-21T06:46:37.827400+0000","last_unstale":"2024-09-21T06:46:40.097973+0000","last_undegraded":"2024-09-21T06:46:40.097973+0000","last_fullsized":"2024-09-21T06:46:40.097973+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:15.767155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097816+0000","last_change":"2024-09-21T06:46:38.836804+0000","last_active":"2024-09-21T06:46:40.097816+0000","last_peered":"2024-09-21T06:46:40.097816+0000","last_clean":"2024-09-21T06:46:40.097816+0000","last_became_active":"2024-09-21T06:46:38.836503+0000","last_became_peered":"2024-09-21T06:46:38.836503+0000","last_unstale":"2024-09-21T06:46:40.097816+0000","last_undegraded":"2024-09-21T06:46:40.097816+0000","last_fullsized":"2024-09-21T06:46:40.097816+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:51.512347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"52'6","reported_seq":21,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097798+0000","last_change":"2024-09-21T06:46:37.827650+0000","last_active":"2024-09-21T06:46:40.097798+0000","last_peered":"2024-09-21T06:46:40.097798+0000","last_clean":"2024-09-21T06:46:40.097798+0000","last_became_active":"2024-09-21T06:46:37.827332+0000","last_became_peered":"2024-09-21T06:46:37.827332+0000","last_unstale":"2024-09-21T06:46:40.097798+0000","last_undegraded":"2024-09-21T06:46:40.097798+0000","last_fullsized":"2024-09-21T06:46:40.097798+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:01.452146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.835853+0000","last_change":"2024-09-21T06:46:38.841487+0000","last_active":"2024-09-21T06:46:39.835853+0000","last_peered":"2024-09-21T06:46:39.835853+0000","last_clean":"2024-09-21T06:46:39.835853+0000","last_became_active":"2024-09-21T06:46:38.840274+0000","last_became_peered":"2024-09-21T06:46:38.840274+0000","last_unstale":"2024-09-21T06:46:39.835853+0000","last_undegraded":"2024-09-21T06:46:39.835853+0000","last_fullsized":"2024-09-21T06:46:39.835853+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:40.804826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"52'2","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841707+0000","last_change":"2024-09-21T06:46:37.827132+0000","last_active":"2024-09-21T06:46:39.841707+0000","last_peered":"2024-09-21T06:46:39.841707+0000","last_clean":"2024-09-21T06:46:39.841707+0000","last_became_active":"2024-09-21T06:46:37.826820+0000","last_became_peered":"2024-09-21T06:46:37.826820+0000","last_unstale":"2024-09-21T06:46:39.841707+0000","last_undegraded":"2024-09-21T06:46:39.841707+0000","last_fullsized":"2024-09-21T06:46:39.841707+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:26.453839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847725+0000","last_change":"2024-09-21T06:46:38.834710+0000","last_active":"2024-09-21T06:46:39.847725+0000","last_peered":"2024-09-21T06:46:39.847725+0000","last_clean":"2024-09-21T06:46:39.847725+0000","last_became_active":"2024-09-21T06:46:38.834411+0000","last_became_peered":"2024-09-21T06:46:38.834411+0000","last_unstale":"2024-09-21T06:46:39.847725+0000","last_undegraded":"2024-09-21T06:46:39.847725+0000","last_fullsized":"2024-09-21T06:46:39.847725+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:30:38.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097683+0000","last_change":"2024-09-21T06:46:37.822155+0000","last_active":"2024-09-21T06:46:40.097683+0000","last_peered":"2024-09-21T06:46:40.097683+0000","last_clean":"2024-09-21T06:46:40.097683+0000","last_became_active":"2024-09-21T06:46:37.821875+0000","last_became_peered":"2024-09-21T06:46:37.821875+0000","last_unstale":"2024-09-21T06:46:40.097683+0000","last_undegraded":"2024-09-21T06:46:40.097683+0000","last_fullsized":"2024-09-21T06:46:40.097683+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:49.673120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.835870+0000","last_change":"2024-09-21T06:46:38.846296+0000","last_active":"2024-09-21T06:46:39.835870+0000","last_peered":"2024-09-21T06:46:39.835870+0000","last_clean":"2024-09-21T06:46:39.835870+0000","last_became_active":"2024-09-21T06:46:38.845939+0000","last_became_peered":"2024-09-21T06:46:38.845939+0000","last_unstale":"2024-09-21T06:46:39.835870+0000","last_undegraded":"2024-09-21T06:46:39.835870+0000","last_fullsized":"2024-09-21T06:46:39.835870+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:27.459424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098175+0000","last_change":"2024-09-21T06:46:37.822030+0000","last_active":"2024-09-21T06:46:40.098175+0000","last_peered":"2024-09-21T06:46:40.098175+0000","last_clean":"2024-09-21T06:46:40.098175+0000","last_became_active":"2024-09-21T06:46:37.821713+0000","last_became_peered":"2024-09-21T06:46:37.821713+0000","last_unstale":"2024-09-21T06:46:40.098175+0000","last_undegraded":"2024-09-21T06:46:40.098175+0000","last_fullsized":"2024-09-21T06:46:40.098175+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:12.386604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098206+0000","last_change":"2024-09-21T06:46:38.837242+0000","last_active":"2024-09-21T06:46:40.098206+0000","last_peered":"2024-09-21T06:46:40.098206+0000","last_clean":"2024-09-21T06:46:40.098206+0000","last_became_active":"2024-09-21T06:46:38.836884+0000","last_became_peered":"2024-09-21T06:46:38.836884+0000","last_unstale":"2024-09-21T06:46:40.098206+0000","last_undegraded":"2024-09-21T06:46:40.098206+0000","last_fullsized":"2024-09-21T06:46:40.098206+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:41.470991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"52'8","reported_seq":23,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097538+0000","last_change":"2024-09-21T06:46:37.824758+0000","last_active":"2024-09-21T06:46:40.097538+0000","last_peered":"2024-09-21T06:46:40.097538+0000","last_clean":"2024-09-21T06:46:40.097538+0000","last_became_active":"2024-09-21T06:46:37.824463+0000","last_became_peered":"2024-09-21T06:46:37.824463+0000","last_unstale":"2024-09-21T06:46:40.097538+0000","last_undegraded":"2024-09-21T06:46:40.097538+0000","last_fullsized":"2024-09-21T06:46:40.097538+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:39:55.461537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847988+0000","last_change":"2024-09-21T06:46:38.837576+0000","last_active":"2024-09-21T06:46:39.847988+0000","last_peered":"2024-09-21T06:46:39.847988+0000","last_clean":"2024-09-21T06:46:39.847988+0000","last_became_active":"2024-09-21T06:46:38.837272+0000","last_became_peered":"2024-09-21T06:46:38.837272+0000","last_unstale":"2024-09-21T06:46:39.847988+0000","last_undegraded":"2024-09-21T06:46:39.847988+0000","last_fullsized":"2024-09-21T06:46:39.847988+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:56.261429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"52'1","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.843178+0000","last_change":"2024-09-21T06:46:37.826755+0000","last_active":"2024-09-21T06:46:39.843178+0000","last_peered":"2024-09-21T06:46:39.843178+0000","last_clean":"2024-09-21T06:46:39.843178+0000","last_became_active":"2024-09-21T06:46:37.826407+0000","last_became_peered":"2024-09-21T06:46:37.826407+0000","last_unstale":"2024-09-21T06:46:39.843178+0000","last_undegraded":"2024-09-21T06:46:39.843178+0000","last_fullsized":"2024-09-21T06:46:39.843178+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:28.375629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.848075+0000","last_change":"2024-09-21T06:46:38.834034+0000","last_active":"2024-09-21T06:46:39.848075+0000","last_peered":"2024-09-21T06:46:39.848075+0000","last_clean":"2024-09-21T06:46:39.848075+0000","last_became_active":"2024-09-21T06:46:38.833752+0000","last_became_peered":"2024-09-21T06:46:38.833752+0000","last_unstale":"2024-09-21T06:46:39.848075+0000","last_undegraded":"2024-09-21T06:46:39.848075+0000","last_fullsized":"2024-09-21T06:46:39.848075+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:18.427706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"52'2","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841601+0000","last_change":"2024-09-21T06:46:37.819283+0000","last_active":"2024-09-21T06:46:39.841601+0000","last_peered":"2024-09-21T06:46:39.841601+0000","last_clean":"2024-09-21T06:46:39.841601+0000","last_became_active":"2024-09-21T06:46:37.816729+0000","last_became_peered":"2024-09-21T06:46:37.816729+0000","last_unstale":"2024-09-21T06:46:39.841601+0000","last_undegraded":"2024-09-21T06:46:39.841601+0000","last_fullsized":"2024-09-21T06:46:39.841601+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:39.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.842785+0000","last_change":"2024-09-21T06:46:38.849965+0000","last_active":"2024-09-21T06:46:39.842785+0000","last_peered":"2024-09-21T06:46:39.842785+0000","last_clean":"2024-09-21T06:46:39.842785+0000","last_became_active":"2024-09-21T06:46:38.849637+0000","last_became_peered":"2024-09-21T06:46:38.849637+0000","last_unstale":"2024-09-21T06:46:39.842785+0000","last_undegraded":"2024-09-21T06:46:39.842785+0000","last_fullsized":"2024-09-21T06:46:39.842785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:12.306047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"52'1","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.848012+0000","last_change":"2024-09-21T06:46:37.826066+0000","last_active":"2024-09-21T06:46:39.848012+0000","last_peered":"2024-09-21T06:46:39.848012+0000","last_clean":"2024-09-21T06:46:39.848012+0000","last_became_active":"2024-09-21T06:46:37.825751+0000","last_became_peered":"2024-09-21T06:46:37.825751+0000","last_unstale":"2024-09-21T06:46:39.848012+0000","last_undegraded":"2024-09-21T06:46:39.848012+0000","last_fullsized":"2024-09-21T06:46:39.848012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:19.603484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.097907+0000","last_change":"2024-09-21T06:46:38.856673+0000","last_active":"2024-09-21T06:46:40.097907+0000","last_peered":"2024-09-21T06:46:40.097907+0000","last_clean":"2024-09-21T06:46:40.097907+0000","last_became_active":"2024-09-21T06:46:38.856179+0000","last_became_peered":"2024-09-21T06:46:38.856179+0000","last_unstale":"2024-09-21T06:46:40.097907+0000","last_undegraded":"2024-09-21T06:46:40.097907+0000","last_fullsized":"2024-09-21T06:46:40.097907+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:57.946511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.842004+0000","last_change":"2024-09-21T06:46:37.824783+0000","last_active":"2024-09-21T06:46:39.842004+0000","last_peered":"2024-09-21T06:46:39.842004+0000","last_clean":"2024-09-21T06:46:39.842004+0000","last_became_active":"2024-09-21T06:46:37.824308+0000","last_became_peered":"2024-09-21T06:46:37.824308+0000","last_unstale":"2024-09-21T06:46:39.842004+0000","last_undegraded":"2024-09-21T06:46:39.842004+0000","last_fullsized":"2024-09-21T06:46:39.842004+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:39.627421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.836169+0000","last_change":"2024-09-21T06:46:38.847150+0000","last_active":"2024-09-21T06:46:39.836169+0000","last_peered":"2024-09-21T06:46:39.836169+0000","last_clean":"2024-09-21T06:46:39.836169+0000","last_became_active":"2024-09-21T06:46:38.846860+0000","last_became_peered":"2024-09-21T06:46:38.846860+0000","last_unstale":"2024-09-21T06:46:39.836169+0000","last_undegraded":"2024-09-21T06:46:39.836169+0000","last_fullsized":"2024-09-21T06:46:39.836169+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:28.350404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"52'2","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098083+0000","last_change":"2024-09-21T06:46:37.827714+0000","last_active":"2024-09-21T06:46:40.098083+0000","last_peered":"2024-09-21T06:46:40.098083+0000","last_clean":"2024-09-21T06:46:40.098083+0000","last_became_active":"2024-09-21T06:46:37.826848+0000","last_became_peered":"2024-09-21T06:46:37.826848+0000","last_unstale":"2024-09-21T06:46:40.098083+0000","last_undegraded":"2024-09-21T06:46:40.098083+0000","last_fullsized":"2024-09-21T06:46:40.098083+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:41:30.788139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841453+0000","last_change":"2024-09-21T06:46:38.841932+0000","last_active":"2024-09-21T06:46:39.841453+0000","last_peered":"2024-09-21T06:46:39.841453+0000","last_clean":"2024-09-21T06:46:39.841453+0000","last_became_active":"2024-09-21T06:46:38.838902+0000","last_became_peered":"2024-09-21T06:46:38.838902+0000","last_unstale":"2024-09-21T06:46:39.841453+0000","last_undegraded":"2024-09-21T06:46:39.841453+0000","last_fullsized":"2024-09-21T06:46:39.841453+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:06:28.905808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841283+0000","last_change":"2024-09-21T06:46:37.817451+0000","last_active":"2024-09-21T06:46:39.841283+0000","last_peered":"2024-09-21T06:46:39.841283+0000","last_clean":"2024-09-21T06:46:39.841283+0000","last_became_active":"2024-09-21T06:46:37.816755+0000","last_became_peered":"2024-09-21T06:46:37.816755+0000","last_unstale":"2024-09-21T06:46:39.841283+0000","last_undegraded":"2024-09-21T06:46:39.841283+0000","last_fullsized":"2024-09-21T06:46:39.841283+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:16:11.300462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841084+0000","last_change":"2024-09-21T06:46:38.844213+0000","last_active":"2024-09-21T06:46:39.841084+0000","last_peered":"2024-09-21T06:46:39.841084+0000","last_clean":"2024-09-21T06:46:39.841084+0000","last_became_active":"2024-09-21T06:46:38.842618+0000","last_became_peered":"2024-09-21T06:46:38.842618+0000","last_unstale":"2024-09-21T06:46:39.841084+0000","last_undegraded":"2024-09-21T06:46:39.841084+0000","last_fullsized":"2024-09-21T06:46:39.841084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:31.028797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.835971+0000","last_change":"2024-09-21T06:46:37.826535+0000","last_active":"2024-09-21T06:46:39.835971+0000","last_peered":"2024-09-21T06:46:39.835971+0000","last_clean":"2024-09-21T06:46:39.835971+0000","last_became_active":"2024-09-21T06:46:37.825753+0000","last_became_peered":"2024-09-21T06:46:37.825753+0000","last_unstale":"2024-09-21T06:46:39.835971+0000","last_undegraded":"2024-09-21T06:46:39.835971+0000","last_fullsized":"2024-09-21T06:46:39.835971+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.466751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.848183+0000","last_change":"2024-09-21T06:46:38.838456+0000","last_active":"2024-09-21T06:46:39.848183+0000","last_peered":"2024-09-21T06:46:39.848183+0000","last_clean":"2024-09-21T06:46:39.848183+0000","last_became_active":"2024-09-21T06:46:38.838138+0000","last_became_peered":"2024-09-21T06:46:38.838138+0000","last_unstale":"2024-09-21T06:46:39.848183+0000","last_undegraded":"2024-09-21T06:46:39.848183+0000","last_fullsized":"2024-09-21T06:46:39.848183+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:56.610692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"52'2","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.843428+0000","last_change":"2024-09-21T06:46:37.828361+0000","last_active":"2024-09-21T06:46:39.843428+0000","last_peered":"2024-09-21T06:46:39.843428+0000","last_clean":"2024-09-21T06:46:39.843428+0000","last_became_active":"2024-09-21T06:46:37.828053+0000","last_became_peered":"2024-09-21T06:46:37.828053+0000","last_unstale":"2024-09-21T06:46:39.843428+0000","last_undegraded":"2024-09-21T06:46:39.843428+0000","last_fullsized":"2024-09-21T06:46:39.843428+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:31.047801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.848120+0000","last_change":"2024-09-21T06:46:38.835519+0000","last_active":"2024-09-21T06:46:39.848120+0000","last_peered":"2024-09-21T06:46:39.848120+0000","last_clean":"2024-09-21T06:46:39.848120+0000","last_became_active":"2024-09-21T06:46:38.835226+0000","last_became_peered":"2024-09-21T06:46:38.835226+0000","last_unstale":"2024-09-21T06:46:39.848120+0000","last_undegraded":"2024-09-21T06:46:39.848120+0000","last_fullsized":"2024-09-21T06:46:39.848120+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:03.295528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"53'1","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845715+0000","last_change":"2024-09-21T06:46:37.828386+0000","last_active":"2024-09-21T06:46:39.845715+0000","last_peered":"2024-09-21T06:46:39.845715+0000","last_clean":"2024-09-21T06:46:39.845715+0000","last_became_active":"2024-09-21T06:46:37.827795+0000","last_became_peered":"2024-09-21T06:46:37.827795+0000","last_unstale":"2024-09-21T06:46:39.845715+0000","last_undegraded":"2024-09-21T06:46:39.845715+0000","last_fullsized":"2024-09-21T06:46:39.845715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:03.699278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.842861+0000","last_change":"2024-09-21T06:46:38.849164+0000","last_active":"2024-09-21T06:46:39.842861+0000","last_peered":"2024-09-21T06:46:39.842861+0000","last_clean":"2024-09-21T06:46:39.842861+0000","last_became_active":"2024-09-21T06:46:38.848864+0000","last_became_peered":"2024-09-21T06:46:38.848864+0000","last_unstale":"2024-09-21T06:46:39.842861+0000","last_undegraded":"2024-09-21T06:46:39.842861+0000","last_fullsized":"2024-09-21T06:46:39.842861+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:40.633006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.836198+0000","last_change":"2024-09-21T06:46:37.828721+0000","last_active":"2024-09-21T06:46:39.836198+0000","last_peered":"2024-09-21T06:46:39.836198+0000","last_clean":"2024-09-21T06:46:39.836198+0000","last_became_active":"2024-09-21T06:46:37.827838+0000","last_became_peered":"2024-09-21T06:46:37.827838+0000","last_unstale":"2024-09-21T06:46:39.836198+0000","last_undegraded":"2024-09-21T06:46:39.836198+0000","last_fullsized":"2024-09-21T06:46:39.836198+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:34.881390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.842142+0000","last_change":"2024-09-21T06:46:38.837655+0000","last_active":"2024-09-21T06:46:39.842142+0000","last_peered":"2024-09-21T06:46:39.842142+0000","last_clean":"2024-09-21T06:46:39.842142+0000","last_became_active":"2024-09-21T06:46:38.837309+0000","last_became_peered":"2024-09-21T06:46:38.837309+0000","last_unstale":"2024-09-21T06:46:39.842142+0000","last_undegraded":"2024-09-21T06:46:39.842142+0000","last_fullsized":"2024-09-21T06:46:39.842142+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:59:56.086566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847771+0000","last_change":"2024-09-21T06:46:37.828979+0000","last_active":"2024-09-21T06:46:39.847771+0000","last_peered":"2024-09-21T06:46:39.847771+0000","last_clean":"2024-09-21T06:46:39.847771+0000","last_became_active":"2024-09-21T06:46:37.827049+0000","last_became_peered":"2024-09-21T06:46:37.827049+0000","last_unstale":"2024-09-21T06:46:39.847771+0000","last_undegraded":"2024-09-21T06:46:39.847771+0000","last_fullsized":"2024-09-21T06:46:39.847771+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:41.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845264+0000","last_change":"2024-09-21T06:46:38.853960+0000","last_active":"2024-09-21T06:46:39.845264+0000","last_peered":"2024-09-21T06:46:39.845264+0000","last_clean":"2024-09-21T06:46:39.845264+0000","last_became_active":"2024-09-21T06:46:38.851773+0000","last_became_peered":"2024-09-21T06:46:38.851773+0000","last_unstale":"2024-09-21T06:46:39.845264+0000","last_undegraded":"2024-09-21T06:46:39.845264+0000","last_fullsized":"2024-09-21T06:46:39.845264+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:53:02.999946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.842662+0000","last_change":"2024-09-21T06:46:37.824970+0000","last_active":"2024-09-21T06:46:39.842662+0000","last_peered":"2024-09-21T06:46:39.842662+0000","last_clean":"2024-09-21T06:46:39.842662+0000","last_became_active":"2024-09-21T06:46:37.824677+0000","last_became_peered":"2024-09-21T06:46:37.824677+0000","last_unstale":"2024-09-21T06:46:39.842662+0000","last_undegraded":"2024-09-21T06:46:39.842662+0000","last_fullsized":"2024-09-21T06:46:39.842662+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:14.217556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098237+0000","last_change":"2024-09-21T06:46:38.845165+0000","last_active":"2024-09-21T06:46:40.098237+0000","last_peered":"2024-09-21T06:46:40.098237+0000","last_clean":"2024-09-21T06:46:40.098237+0000","last_became_active":"2024-09-21T06:46:38.844715+0000","last_became_peered":"2024-09-21T06:46:38.844715+0000","last_unstale":"2024-09-21T06:46:40.098237+0000","last_undegraded":"2024-09-21T06:46:40.098237+0000","last_fullsized":"2024-09-21T06:46:40.098237+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:03.807917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.847644+0000","last_change":"2024-09-21T06:46:37.824613+0000","last_active":"2024-09-21T06:46:39.847644+0000","last_peered":"2024-09-21T06:46:39.847644+0000","last_clean":"2024-09-21T06:46:39.847644+0000","last_became_active":"2024-09-21T06:46:37.824302+0000","last_became_peered":"2024-09-21T06:46:37.824302+0000","last_unstale":"2024-09-21T06:46:39.847644+0000","last_undegraded":"2024-09-21T06:46:39.847644+0000","last_fullsized":"2024-09-21T06:46:39.847644+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:57.477737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841057+0000","last_change":"2024-09-21T06:46:38.836525+0000","last_active":"2024-09-21T06:46:39.841057+0000","last_peered":"2024-09-21T06:46:39.841057+0000","last_clean":"2024-09-21T06:46:39.841057+0000","last_became_active":"2024-09-21T06:46:38.836216+0000","last_became_peered":"2024-09-21T06:46:38.836216+0000","last_unstale":"2024-09-21T06:46:39.841057+0000","last_undegraded":"2024-09-21T06:46:39.841057+0000","last_fullsized":"2024-09-21T06:46:39.841057+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:04.926312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.845107+0000","last_change":"2024-09-21T06:46:37.821964+0000","last_active":"2024-09-21T06:46:39.845107+0000","last_peered":"2024-09-21T06:46:39.845107+0000","last_clean":"2024-09-21T06:46:39.845107+0000","last_became_active":"2024-09-21T06:46:37.821664+0000","last_became_peered":"2024-09-21T06:46:37.821664+0000","last_unstale":"2024-09-21T06:46:39.845107+0000","last_undegraded":"2024-09-21T06:46:39.845107+0000","last_fullsized":"2024-09-21T06:46:39.845107+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:53.650121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.842720+0000","last_change":"2024-09-21T06:46:38.848596+0000","last_active":"2024-09-21T06:46:39.842720+0000","last_peered":"2024-09-21T06:46:39.842720+0000","last_clean":"2024-09-21T06:46:39.842720+0000","last_became_active":"2024-09-21T06:46:38.848295+0000","last_became_peered":"2024-09-21T06:46:38.848295+0000","last_unstale":"2024-09-21T06:46:39.842720+0000","last_undegraded":"2024-09-21T06:46:39.842720+0000","last_fullsized":"2024-09-21T06:46:39.842720+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:29.130793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841258+0000","last_change":"2024-09-21T06:46:37.821294+0000","last_active":"2024-09-21T06:46:39.841258+0000","last_peered":"2024-09-21T06:46:39.841258+0000","last_clean":"2024-09-21T06:46:39.841258+0000","last_became_active":"2024-09-21T06:46:37.820623+0000","last_became_peered":"2024-09-21T06:46:37.820623+0000","last_unstale":"2024-09-21T06:46:39.841258+0000","last_undegraded":"2024-09-21T06:46:39.841258+0000","last_fullsized":"2024-09-21T06:46:39.841258+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:28.125208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.841439+0000","last_change":"2024-09-21T06:46:38.838221+0000","last_active":"2024-09-21T06:46:39.841439+0000","last_peered":"2024-09-21T06:46:39.841439+0000","last_clean":"2024-09-21T06:46:39.841439+0000","last_became_active":"2024-09-21T06:46:38.837921+0000","last_became_peered":"2024-09-21T06:46:38.837921+0000","last_unstale":"2024-09-21T06:46:39.841439+0000","last_undegraded":"2024-09-21T06:46:39.841439+0000","last_fullsized":"2024-09-21T06:46:39.841439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:37.803143+0000","last_clean_scrub_stamp":"2024-09-21T06:46:37.803143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:46.123801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:40.098378+0000","last_change":"2024-09-21T06:46:37.829723+0000","last_active":"2024-09-21T06:46:40.098378+0000","last_peered":"2024-09-21T06:46:40.098378+0000","last_clean":"2024-09-21T06:46:40.098378+0000","last_became_active":"2024-09-21T06:46:37.829452+0000","last_became_peered":"2024-09-21T06:46:37.829452+0000","last_unstale":"2024-09-21T06:46:40.098378+0000","last_undegraded":"2024-09-21T06:46:40.098378+0000","last_fullsized":"2024-09-21T06:46:40.098378+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:46:36.797559+0000","last_clean_scrub_stamp":"2024-09-21T06:46:36.797559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:46.342847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":168,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T06:46:39.836033+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:39.836033+0000","last_peered":"2024-09-21T06:46:39.836033+0000","last_clean":"2024-09-21T06:46:39.836033+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:39.836033+0000","last_undegraded":"2024-09-21T06:46:39.836033+0000","last_fullsized":"2024-09-21T06:46:39.836033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":630784,"data_stored":277756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":647168,"data_stored":279438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1224704,"data_stored":868616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":638976,"data_stored":279278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":634880,"data_stored":277758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":630784,"data_stored":277688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1224704,"data_stored":868068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":634880,"data_stored":278282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:46:47.632 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:46:47.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T06:46:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 -- 172.21.15.81:0/2918303629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884806f000 msgr2=0x7f8848166370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 --2- 172.21.15.81:0/2918303629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884806f000 0x7f8848166370 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f884815d0c0 tx=0x7f884002a420 comp rx=0 tx=0).stop 2024-09-21T06:46:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 -- 172.21.15.81:0/2918303629 shutdown_connections 2024-09-21T06:46:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 --2- 172.21.15.81:0/2918303629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884806f000 0x7f8848166370 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 --2- 172.21.15.81:0/2918303629 >> v2:172.21.15.89:3300/0 conn(0x7f88480d15b0 0x7f884806eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 -- 172.21.15.81:0/2918303629 >> 172.21.15.81:0/2918303629 conn(0x7f88480740a0 msgr2=0x7f88480b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 -- 172.21.15.81:0/2918303629 shutdown_connections 2024-09-21T06:46:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.786+0000 7f884f2b4640 1 -- 172.21.15.81:0/2918303629 wait complete. 2024-09-21T06:46:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.788+0000 7f884f2b4640 1 Processor -- start 2024-09-21T06:46:47.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.788+0000 7f884f2b4640 1 -- start start 2024-09-21T06:46:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884f2b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884806f000 0x7f88480b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884f2b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88480d15b0 0x7f88480b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884f2b4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88481539d0 0x7f88481f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884f2b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88481668b0 con 0x7f88480d15b0 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884f2b4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f88480b0b60 con 0x7f884806f000 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884f2b4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8848166a30 con 0x7f88481539d0 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88480d15b0 0x7f88480b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88480d15b0 0x7f88480b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58428/0 (socket says 172.21.15.81:58428) 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 -- 172.21.15.81:0/3359185109 learned_addr learned my addr 172.21.15.81:0/3359185109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884d050640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884806f000 0x7f88480b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884d851640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88481539d0 0x7f88481f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 -- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88481539d0 msgr2=0x7f88481f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88481539d0 0x7f88481f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 -- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884806f000 msgr2=0x7f88480b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884806f000 0x7f88480b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 -- 172.21.15.81:0/3359185109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88481f43e0 con 0x7f88480d15b0 2024-09-21T06:46:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884d050640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884806f000 0x7f88480b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.789+0000 7f884c84f640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88480d15b0 0x7f88480b33e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f884400d750 tx=0x7f884400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.790+0000 7f8839ffb640 1 -- 172.21.15.81:0/3359185109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844017070 con 0x7f88480d15b0 2024-09-21T06:46:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.790+0000 7f8839ffb640 1 -- 172.21.15.81:0/3359185109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8844009b20 con 0x7f88480d15b0 2024-09-21T06:46:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.790+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88481f3990 con 0x7f88480d15b0 2024-09-21T06:46:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.790+0000 7f8839ffb640 1 -- 172.21.15.81:0/3359185109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844010460 con 0x7f88480d15b0 2024-09-21T06:46:47.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.790+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88481f3f50 con 0x7f88480d15b0 2024-09-21T06:46:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.791+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88481f3700 con 0x7f88480d15b0 2024-09-21T06:46:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.792+0000 7f8839ffb640 1 -- 172.21.15.81:0/3359185109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f884401a070 con 0x7f88480d15b0 2024-09-21T06:46:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.792+0000 7f8839ffb640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f882c078b90 0x7f882c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.792+0000 7f8839ffb640 1 -- 172.21.15.81:0/3359185109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f884409afc0 con 0x7f88480d15b0 2024-09-21T06:46:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.792+0000 7f884d050640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f882c078b90 0x7f882c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:47.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.793+0000 7f884d050640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f882c078b90 0x7f882c07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f883c009fc0 tx=0x7f883c009550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:47.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:47.797+0000 7f8839ffb640 1 -- 172.21.15.81:0/3359185109 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8844062c30 con 0x7f88480d15b0 2024-09-21T06:46:48.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.044+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f88480ced70 con 0x7f88480d15b0 2024-09-21T06:46:48.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.047+0000 7f8839ffb640 1 -- 172.21.15.81:0/3359185109 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v37) ==== 190+0+147 (secure 0 0 0) 0x7f8844067660 con 0x7f88480d15b0 2024-09-21T06:46:48.049 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:48.049 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-21T06:46:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:48.050 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T06:46:48.050 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:48.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f882c078b90 msgr2=0x7f882c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f882c078b90 0x7f882c07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f883c009fc0 tx=0x7f883c009550 comp rx=0 tx=0).stop 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88480d15b0 msgr2=0x7f88480b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88480d15b0 0x7f88480b33e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f884400d750 tx=0x7f884400dc10 comp rx=0 tx=0).stop 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 shutdown_connections 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f882c078b90 0x7f882c07b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88481539d0 0x7f88481f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88480d15b0 0x7f88480b33e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 --2- 172.21.15.81:0/3359185109 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f884806f000 0x7f88480b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 >> 172.21.15.81:0/3359185109 conn(0x7f88480740a0 msgr2=0x7f88481529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.049+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 shutdown_connections 2024-09-21T06:46:48.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.050+0000 7f884f2b4640 1 -- 172.21.15.81:0/3359185109 wait complete. 2024-09-21T06:46:48.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.173+0000 7fc392512640 1 -- 172.21.15.81:0/366464020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0ae180 msgr2=0x7fc38c0b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.173+0000 7fc392512640 1 --2- 172.21.15.81:0/366464020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0ae180 0x7fc38c0b3600 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc380009830 tx=0x7fc38002a530 comp rx=0 tx=0).stop 2024-09-21T06:46:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.173+0000 7fc392512640 1 -- 172.21.15.81:0/366464020 shutdown_connections 2024-09-21T06:46:48.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.173+0000 7fc392512640 1 --2- 172.21.15.81:0/366464020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c0ae180 0x7fc38c0b3600 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.173+0000 7fc392512640 1 -- 172.21.15.81:0/366464020 >> 172.21.15.81:0/366464020 conn(0x7fc38c0b2030 msgr2=0x7fc38c0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.173+0000 7fc392512640 1 -- 172.21.15.81:0/366464020 shutdown_connections 2024-09-21T06:46:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.173+0000 7fc392512640 1 -- 172.21.15.81:0/366464020 wait complete. 2024-09-21T06:46:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.174+0000 7fc392512640 1 Processor -- start 2024-09-21T06:46:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.175+0000 7fc392512640 1 -- start start 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc392512640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c06f630 0x7fc38c15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc392512640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c0b4c60 0x7fc38c15d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc392512640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c15da80 0x7fc38c1f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc392512640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c06d780 con 0x7fc38c06f630 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc392512640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c158cc0 con 0x7fc38c0b4c60 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc392512640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fc38c06d900 con 0x7fc38c15da80 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c06f630 0x7fc38c15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c06f630 0x7fc38c15ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49106/0 (socket says 172.21.15.81:49106) 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 -- 172.21.15.81:0/797479155 learned_addr learned my addr 172.21.15.81:0/797479155 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38b7fe640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c0b4c60 0x7fc38c15d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc390aaf640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c15da80 0x7fc38c1f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 -- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c15da80 msgr2=0x7fc38c1f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c15da80 0x7fc38c1f6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 -- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c0b4c60 msgr2=0x7fc38c15d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c0b4c60 0x7fc38c15d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38bfff640 1 -- 172.21.15.81:0/797479155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c0ce190 con 0x7fc38c06f630 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.176+0000 7fc38b7fe640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c0b4c60 0x7fc38c15d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.177+0000 7fc38bfff640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c06f630 0x7fc38c15ea70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c3a0 tx=0x7fc37c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.177+0000 7fc388ff9640 1 -- 172.21.15.81:0/797479155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c017070 con 0x7fc38c06f630 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.177+0000 7fc388ff9640 1 -- 172.21.15.81:0/797479155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc37c0053c0 con 0x7fc38c06f630 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.177+0000 7fc388ff9640 1 -- 172.21.15.81:0/797479155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c003850 con 0x7fc38c06f630 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.177+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c0ce470 con 0x7fc38c06f630 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.177+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38c0cea30 con 0x7fc38c06f630 2024-09-21T06:46:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.178+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38c070850 con 0x7fc38c06f630 2024-09-21T06:46:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.178+0000 7fc388ff9640 1 -- 172.21.15.81:0/797479155 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc37c01a070 con 0x7fc38c06f630 2024-09-21T06:46:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.179+0000 7fc388ff9640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc378078b90 0x7fc37807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.179+0000 7fc388ff9640 1 -- 172.21.15.81:0/797479155 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fc37c09a200 con 0x7fc38c06f630 2024-09-21T06:46:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.179+0000 7fc38b7fe640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc378078b90 0x7fc37807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.180+0000 7fc38b7fe640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc378078b90 0x7fc37807b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc380034000 tx=0x7fc380004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.183+0000 7fc388ff9640 1 -- 172.21.15.81:0/797479155 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc38c070850 con 0x7fc38c06f630 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.396+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc38c0b1a60 con 0x7fc38c06f630 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.397+0000 7fc388ff9640 1 -- 172.21.15.81:0/797479155 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5220 (secure 0 0 0) 0x7fc38c0b1a60 con 0x7fc38c06f630 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T06:46:41:839050+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2835319060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2835319060},{"type":"v1","addr":"172.21.15.89:6836","nonce":2835319060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4230376453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4230376453},{"type":"v1","addr":"172.21.15.89:6837","nonce":4230376453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/325230929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":325230929},{"type":"v1","addr":"172.21.15.81:6834","nonce":325230929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:38.173502+0000","modified":"2024-09-21T06:46:41.202759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5430":{"gid":5430,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1408396045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1408396045},{"type":"v1","addr":"172.21.15.81:6835","nonce":1408396045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5430,"qdb_cluster":[5430]},"id":3}]} 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc378078b90 msgr2=0x7fc37807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc378078b90 0x7fc37807b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc380034000 tx=0x7fc380004730 comp rx=0 tx=0).stop 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c06f630 msgr2=0x7fc38c15ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c06f630 0x7fc38c15ea70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c3a0 tx=0x7fc37c00c860 comp rx=0 tx=0).stop 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 shutdown_connections 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc378078b90 0x7fc37807b0a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc38c15da80 0x7fc38c1f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc38c0b4c60 0x7fc38c15d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 --2- 172.21.15.81:0/797479155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc38c06f630 0x7fc38c15ea70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 >> 172.21.15.81:0/797479155 conn(0x7fc38c0b2030 msgr2=0x7fc38c072fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 shutdown_connections 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.399+0000 7fc392512640 1 -- 172.21.15.81:0/797479155 wait complete. 2024-09-21T06:46:48.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T06:46:38.173502+0000', 'modified': '2024-09-21T06:46:41.202759+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5430': {'gid': 5430, 'name': 'c', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/1408396045', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 1408396045}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1408396045}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5430, 'qdb_cluster': [5430]} 2024-09-21T06:46:48.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T06:46:48.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T06:46:48.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.928+0000 7fcf97a4d640 1 -- 172.21.15.81:0/935103951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9015c4c0 msgr2=0x7fcf9015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.928+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/935103951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9015c4c0 0x7fcf9015c8d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009830 tx=0x7fcf8402a510 comp rx=0 tx=0).stop 2024-09-21T06:46:48.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.928+0000 7fcf97a4d640 1 -- 172.21.15.81:0/935103951 shutdown_connections 2024-09-21T06:46:48.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.928+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/935103951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9015c4c0 0x7fcf9015c8d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.928+0000 7fcf97a4d640 1 -- 172.21.15.81:0/935103951 >> 172.21.15.81:0/935103951 conn(0x7fcf900740a0 msgr2=0x7fcf900b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.928+0000 7fcf97a4d640 1 -- 172.21.15.81:0/935103951 shutdown_connections 2024-09-21T06:46:48.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.928+0000 7fcf97a4d640 1 -- 172.21.15.81:0/935103951 wait complete. 2024-09-21T06:46:48.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.930+0000 7fcf97a4d640 1 Processor -- start 2024-09-21T06:46:48.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.930+0000 7fcf97a4d640 1 -- start start 2024-09-21T06:46:48.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf97a4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006f510 0x7fcf90166310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf97a4d640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf9015c4c0 0x7fcf90149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf97a4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf901633c0 0x7fcf9006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf97a4d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9015d0f0 con 0x7fcf9006f510 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf97a4d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9015cf70 con 0x7fcf901633c0 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf97a4d640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fcf90166f00 con 0x7fcf9015c4c0 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf957e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006f510 0x7fcf90166310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf957e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006f510 0x7fcf90166310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49116/0 (socket says 172.21.15.81:49116) 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.931+0000 7fcf957e9640 1 -- 172.21.15.81:0/1438798846 learned_addr learned my addr 172.21.15.81:0/1438798846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf9015c4c0 0x7fcf90149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf95fea640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf901633c0 0x7fcf9006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf957e9640 1 -- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf9015c4c0 msgr2=0x7fcf90149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf957e9640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf9015c4c0 0x7fcf90149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf957e9640 1 -- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf901633c0 msgr2=0x7fcf9006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf957e9640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf901633c0 0x7fcf9006cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf957e9640 1 -- 172.21.15.81:0/1438798846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9014a160 con 0x7fcf9006f510 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf957e9640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006f510 0x7fcf90166310 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b3c0 tx=0x7fcf8000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf8dffb640 1 -- 172.21.15.81:0/1438798846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80015020 con 0x7fcf9006f510 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf8dffb640 1 -- 172.21.15.81:0/1438798846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf80011920 con 0x7fcf9006f510 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf901fa1e0 con 0x7fcf9006f510 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf8dffb640 1 -- 172.21.15.81:0/1438798846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80011d90 con 0x7fcf9006f510 2024-09-21T06:46:48.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.932+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf901f9700 con 0x7fcf9006f510 2024-09-21T06:46:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.934+0000 7fcf8dffb640 1 -- 172.21.15.81:0/1438798846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf80018020 con 0x7fcf9006f510 2024-09-21T06:46:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.935+0000 7fcf8dffb640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcf7c078b90 0x7fcf7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.935+0000 7fcf8dffb640 1 -- 172.21.15.81:0/1438798846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fcf8009ab60 con 0x7fcf9006f510 2024-09-21T06:46:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.935+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcf7c078b90 0x7fcf7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.936+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcf7c078b90 0x7fcf7c07b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcf84034000 tx=0x7fcf84004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.936+0000 7fcf9e9c5740 1 Processor -- start 2024-09-21T06:46:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.936+0000 7fcf9e9c5740 1 -- start start 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c083f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c084133e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c0833e820 con 0x559c08024270 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559c0832dc50 con 0x559c07ffb3b0 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x559c08331a60 con 0x559c08003590 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49118/0 (socket says 172.21.15.81:49118) 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 -- 172.21.15.81:0/3046866966 learned_addr learned my addr 172.21.15.81:0/3046866966 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf95fea640 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c084133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c083f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 -- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 msgr2=0x559c084133e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c084133e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 -- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 msgr2=0x559c083f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c083f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.937+0000 7fcf957e9640 1 -- 172.21.15.81:0/3046866966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0808f850 con 0x559c08024270 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.938+0000 7fcf957e9640 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083f5fa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b390 tx=0x7fcf80062220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23caf81b35a230d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.938+0000 7fcf76ffd640 1 -- 172.21.15.81:0/3046866966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf800671f0 con 0x559c08024270 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.938+0000 7fcf76ffd640 1 -- 172.21.15.81:0/3046866966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf8006c130 con 0x559c08024270 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.938+0000 7fcf76ffd640 1 -- 172.21.15.81:0/3046866966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80061bd0 con 0x559c08024270 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.938+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/3046866966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 msgr2=0x559c083f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.938+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083f5fa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b390 tx=0x7fcf80062220 comp rx=0 tx=0).stop 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/3046866966 shutdown_connections 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c084133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c083f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/3046866966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083f5fa0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/3046866966 >> 172.21.15.81:0/3046866966 conn(0x559c080183c0 msgr2=0x559c083cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/3046866966 shutdown_connections 2024-09-21T06:46:48.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/3046866966 wait complete. 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.939+0000 7fcf9e9c5740 1 -- start start 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.940+0000 7fcf9e9c5740 1 Processor -- start 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c07ffb3b0 0x559c08424080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c0840ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c08413140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c0809e620 con 0x559c08024270 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559c082d35f0 con 0x559c08003590 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x559c083f6a20 con 0x559c07ffb3b0 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf9e9c5740 10 client.0 _ll_register_callbacks cb 0x559c082d70a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c08413140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c08413140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49122/0 (socket says 172.21.15.81:49122) 2024-09-21T06:46:48.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 -- 172.21.15.81:0/564825534 learned_addr learned my addr 172.21.15.81:0/564825534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c0840ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf957e9640 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c07ffb3b0 0x559c08424080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 -- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c07ffb3b0 msgr2=0x559c08424080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c07ffb3b0 0x559c08424080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 -- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 msgr2=0x559c0840ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c0840ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.941+0000 7fcf95fea640 1 -- 172.21.15.81:0/564825534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c081066b0 con 0x559c08024270 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf95fea640 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c08413140 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf880119d0 tx=0x7fcf88011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cb6160379e99a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf6ffff640 1 -- 172.21.15.81:0/564825534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88019070 con 0x559c08024270 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf6ffff640 1 -- 172.21.15.81:0/564825534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fcf8800fae0 con 0x559c08024270 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf8006c130 con 0x559c08024270 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf6ffff640 1 -- 172.21.15.81:0/564825534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf88024050 con 0x559c08024270 2024-09-21T06:46:48.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 10 client.5592 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x559c08420830 con 0x559c08024270 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf6ffff640 1 -- 172.21.15.81:0/564825534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf8006c130 con 0x559c08024270 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf6ffff640 1 -- 172.21.15.81:0/564825534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fcf88027020 con 0x559c08024270 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 10 client.5592 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 10 client.5592 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 20 client.5592 populate_metadata read hostname 'smithi081' 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c07fe2e40 0x559c08414420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 4 client.5592 mds_command: new command op to 5430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 --> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c08340770 con 0x559c07fe2e40 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.942+0000 7fcf957e9640 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c07fe2e40 0x559c08414420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.943+0000 7fcf6ffff640 10 client.5592 ms_handle_connect on v2:172.21.15.81:6833/1408396045 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.943+0000 7fcf957e9640 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c07fe2e40 0x559c08414420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acceb6503b0e6192 server_cookie=c46c12ee94f0de69 in_seq=0 out_seq=0 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.943+0000 7fcf6ffff640 1 -- 172.21.15.81:0/564825534 <== mds.0 v2:172.21.15.81:6833/1408396045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c08340770 con 0x559c07fe2e40 2024-09-21T06:46:48.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.943+0000 7fcf6ffff640 10 client.5592 handle_command_reply: tid=0 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.943+0000 7fcf9e9c5740 1 client.5592 shutdown 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 msgr2=0x559c08413140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c08413140 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf880119d0 tx=0x7fcf88011e90 comp rx=0 tx=0).stop 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 shutdown_connections 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c07fe2e40 0x559c08414420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c08413140 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c0840ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf6ffff640 0 client.5592 ms_handle_reset on v2:172.21.15.81:6833/1408396045 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/564825534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c07ffb3b0 0x559c08424080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 >> 172.21.15.81:0/564825534 conn(0x559c080183c0 msgr2=0x559c083cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 shutdown_connections 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/564825534 wait complete. 2024-09-21T06:46:48.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.944+0000 7fcf9e9c5740 20 client.5592 trim_cache size 0 max 16384 2024-09-21T06:46:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.962+0000 7fcf9e9c5740 1 Processor -- start 2024-09-21T06:46:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.962+0000 7fcf9e9c5740 1 -- start start 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.963+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c084343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.963+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c083cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.963+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.963+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcf90201790 con 0x559c08024270 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.963+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fcf90164590 con 0x559c07ffb3b0 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.963+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fcf901f6850 con 0x559c08003590 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083e58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49126/0 (socket says 172.21.15.81:49126) 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 -- 172.21.15.81:0/146930324 learned_addr learned my addr 172.21.15.81:0/146930324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c083cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 -- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 msgr2=0x559c083cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf957e9640 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c084343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c083cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 -- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 msgr2=0x559c084343a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c084343a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 -- 172.21.15.81:0/146930324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c08413020 con 0x559c08024270 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c083cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf957e9640 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c084343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf95fea640 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083e58e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf88011360 tx=0x7fcf8800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a5adb789cb8296 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf767fc640 1 -- 172.21.15.81:0/146930324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8802d070 con 0x559c08024270 2024-09-21T06:46:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf767fc640 1 -- 172.21.15.81:0/146930324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf8800fbd0 con 0x559c08024270 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.964+0000 7fcf767fc640 1 -- 172.21.15.81:0/146930324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88019070 con 0x559c08024270 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/146930324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 msgr2=0x559c083e58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083e58e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf88011360 tx=0x7fcf8800f5a0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/146930324 shutdown_connections 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08003590 0x559c083cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08024270 0x559c083e58e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/146930324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c07ffb3b0 0x559c084343a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/146930324 >> 172.21.15.81:0/146930324 conn(0x559c080183c0 msgr2=0x559c083c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/146930324 shutdown_connections 2024-09-21T06:46:48.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.965+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/146930324 wait complete. 2024-09-21T06:46:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.966+0000 7fcf9e9c5740 1 -- start start 2024-09-21T06:46:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.966+0000 7fcf9e9c5740 1 Processor -- start 2024-09-21T06:46:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c07ffb3b0 0x559c08432b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c08472660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf9e9c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08024270 0x559c0840a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c0840b4b0 con 0x559c07ffb3b0 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x559c08409fd0 con 0x559c08003590 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf9e9c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x559c08409360 con 0x559c08024270 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf9e9c5740 10 client.0 _ll_register_callbacks cb 0x7fcf88001d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf957e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c07ffb3b0 0x559c08432b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf957e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c07ffb3b0 0x559c08432b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49134/0 (socket says 172.21.15.81:49134) 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.967+0000 7fcf957e9640 1 -- 172.21.15.81:0/60589136 learned_addr learned my addr 172.21.15.81:0/60589136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf95fea640 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08024270 0x559c0840a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c08472660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf957e9640 1 -- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08024270 msgr2=0x559c0840a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf957e9640 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08024270 0x559c0840a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf957e9640 1 -- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 msgr2=0x559c08472660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf957e9640 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c08472660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf957e9640 1 -- 172.21.15.81:0/60589136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c08487100 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf957e9640 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c07ffb3b0 0x559c08432b20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcf80098f50 tx=0x7fcf8005e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6490728dfc617672 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf6ffff640 1 -- 172.21.15.81:0/60589136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80081060 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf6ffff640 1 -- 172.21.15.81:0/60589136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fcf80061b70 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf8800fbd0 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf6ffff640 1 -- 172.21.15.81:0/60589136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf8006c130 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf9e9c5740 10 client.5598 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x559c08471e50 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf6ffff640 1 -- 172.21.15.81:0/60589136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf8800fbd0 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf6ffff640 1 -- 172.21.15.81:0/60589136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fcf8005e060 con 0x559c07ffb3b0 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf9e9c5740 10 client.5598 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:48.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf9e9c5740 10 client.5598 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.968+0000 7fcf9e9c5740 20 client.5598 populate_metadata read hostname 'smithi081' 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c08407b90 0x559c08407fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf9e9c5740 4 client.5598 mds_command: new command op to 5430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 --> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] -- command(tid 0: {"prefix": "status"}) -- 0x559c0833c220 con 0x559c08407b90 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c08407b90 0x559c08407fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf6ffff640 10 client.5598 ms_handle_connect on v2:172.21.15.81:6833/1408396045 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf94fe8640 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c08407b90 0x559c08407fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd65ec57a76acd07 server_cookie=4cd3145e38715292 in_seq=0 out_seq=0 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf6ffff640 1 -- 172.21.15.81:0/60589136 <== mds.0 v2:172.21.15.81:6833/1408396045 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x559c0833c220 con 0x559c08407b90 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf6ffff640 10 client.5598 handle_command_reply: tid=0 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf9e9c5740 1 client.5598 shutdown 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c07ffb3b0 msgr2=0x559c08432b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.969+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c07ffb3b0 0x559c08432b20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcf80098f50 tx=0x7fcf8005e640 comp rx=0 tx=0).stop 2024-09-21T06:46:48.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 shutdown_connections 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:6833/1408396045,v1:172.21.15.81:6835/1408396045] conn(0x559c08407b90 0x559c08407fa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x559c08024270 0x559c0840a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf6ffff640 0 client.5598 ms_handle_reset on v2:172.21.15.81:6833/1408396045 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x559c08003590 0x559c08472660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 --2- 172.21.15.81:0/60589136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c07ffb3b0 0x559c08432b20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 >> 172.21.15.81:0/60589136 conn(0x559c080183c0 msgr2=0x559c083cc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 shutdown_connections 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 1 -- 172.21.15.81:0/60589136 wait complete. 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf9e9c5740 20 client.5598 trim_cache size 0 max 16384 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:46:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "5acf265c-1f37-45bc-9438-eb9ad71b6190", 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5430, 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.141160624999999, 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 53, 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 53, 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 14.830115657 2024-09-21T06:46:48.978 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:46:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcf7c078b90 msgr2=0x7fcf7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcf7c078b90 0x7fcf7c07b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcf84034000 tx=0x7fcf84004730 comp rx=0 tx=0).stop 2024-09-21T06:46:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006f510 msgr2=0x7fcf90166310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006f510 0x7fcf90166310 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000b3c0 tx=0x7fcf8000b880 comp rx=0 tx=0).stop 2024-09-21T06:46:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 shutdown_connections 2024-09-21T06:46:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fcf7c078b90 0x7fcf7c07b0a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcf9015c4c0 0x7fcf90149c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf901633c0 0x7fcf9006cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 --2- 172.21.15.81:0/1438798846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf9006f510 0x7fcf90166310 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 >> 172.21.15.81:0/1438798846 conn(0x7fcf900740a0 msgr2=0x7fcf901556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 shutdown_connections 2024-09-21T06:46:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:48.970+0000 7fcf97a4d640 1 -- 172.21.15.81:0/1438798846 wait complete. 2024-09-21T06:46:48.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:46:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.094+0000 7fd6115e6640 1 -- 172.21.15.81:0/856830504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5f8003c10 msgr2=0x7fd5f8004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.094+0000 7fd6115e6640 1 --2- 172.21.15.81:0/856830504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5f8003c10 0x7fd5f8004060 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc005fd0 tx=0x7fd5f8005830 comp rx=0 tx=0).stop 2024-09-21T06:46:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.094+0000 7fd60b7fe640 1 -- 172.21.15.81:0/856830504 reap_dead start 2024-09-21T06:46:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.095+0000 7fd6115e6640 1 -- 172.21.15.81:0/856830504 shutdown_connections 2024-09-21T06:46:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.095+0000 7fd6115e6640 1 -- 172.21.15.81:0/856830504 >> 172.21.15.81:0/856830504 conn(0x7fd60c0cd370 msgr2=0x7fd60c0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.095+0000 7fd6115e6640 1 -- 172.21.15.81:0/856830504 shutdown_connections 2024-09-21T06:46:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.095+0000 7fd6115e6640 1 -- 172.21.15.81:0/856830504 wait complete. 2024-09-21T06:46:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.096+0000 7fd6115e6640 1 Processor -- start 2024-09-21T06:46:49.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.097+0000 7fd6115e6640 1 -- start start 2024-09-21T06:46:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd6115e6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5f8003c10 0x7fd60c1f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd6115e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c154530 0x7fd60c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd6115e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd60c15ad00 0x7fd60c138240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd6115e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c152990 con 0x7fd60c15ad00 2024-09-21T06:46:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd6115e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c152810 con 0x7fd60c154530 2024-09-21T06:46:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd6115e6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0afe00 con 0x7fd5f8003c10 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd60c15ad00 0x7fd60c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd60c15ad00 0x7fd60c138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49148/0 (socket says 172.21.15.81:49148) 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 -- 172.21.15.81:0/565703245 learned_addr learned my addr 172.21.15.81:0/565703245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60affd640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5f8003c10 0x7fd60c1f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60a7fc640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c154530 0x7fd60c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 -- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5f8003c10 msgr2=0x7fd60c1f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5f8003c10 0x7fd60c1f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 -- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c154530 msgr2=0x7fd60c15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c154530 0x7fd60c15a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 -- 172.21.15.81:0/565703245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c1f8720 con 0x7fd60c15ad00 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.098+0000 7fd60b7fe640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd60c15ad00 0x7fd60c138240 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ce190 tx=0x7fd6040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.099+0000 7fd6037fe640 1 -- 172.21.15.81:0/565703245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604011840 con 0x7fd60c15ad00 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.099+0000 7fd6037fe640 1 -- 172.21.15.81:0/565703245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd604018070 con 0x7fd60c15ad00 2024-09-21T06:46:49.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.099+0000 7fd6037fe640 1 -- 172.21.15.81:0/565703245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604011ca0 con 0x7fd60c15ad00 2024-09-21T06:46:49.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.099+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c1f8a00 con 0x7fd60c15ad00 2024-09-21T06:46:49.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.099+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1f8fc0 con 0x7fd60c15ad00 2024-09-21T06:46:49.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.100+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c15f510 con 0x7fd60c15ad00 2024-09-21T06:46:49.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.100+0000 7fd6037fe640 1 -- 172.21.15.81:0/565703245 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd60401d460 con 0x7fd60c15ad00 2024-09-21T06:46:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.101+0000 7fd6037fe640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd5ec078bc0 0x7fd5ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.101+0000 7fd6037fe640 1 -- 172.21.15.81:0/565703245 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fd60409b5d0 con 0x7fd60c15ad00 2024-09-21T06:46:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.101+0000 7fd60affd640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd5ec078bc0 0x7fd5ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.102+0000 7fd60affd640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd5ec078bc0 0x7fd5ec07b0d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc035000 tx=0x7fd5fc02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.106+0000 7fd6037fe640 1 -- 172.21.15.81:0/565703245 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd604063910 con 0x7fd60c15ad00 2024-09-21T06:46:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.323+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd60c069ef0 con 0x7fd60c15ad00 2024-09-21T06:46:49.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.323+0000 7fd6037fe640 1 -- 172.21.15.81:0/565703245 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fd604063210 con 0x7fd60c15ad00 2024-09-21T06:46:49.326 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:46:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd5ec078bc0 msgr2=0x7fd5ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd5ec078bc0 0x7fd5ec07b0d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc035000 tx=0x7fd5fc02d040 comp rx=0 tx=0).stop 2024-09-21T06:46:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd60c15ad00 msgr2=0x7fd60c138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd60c15ad00 0x7fd60c138240 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0ce190 tx=0x7fd6040039c0 comp rx=0 tx=0).stop 2024-09-21T06:46:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 shutdown_connections 2024-09-21T06:46:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd5ec078bc0 0x7fd5ec07b0d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:49.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd60c15ad00 0x7fd60c138240 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd60c154530 0x7fd60c15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 --2- 172.21.15.81:0/565703245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5f8003c10 0x7fd60c1f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 >> 172.21.15.81:0/565703245 conn(0x7fd60c0cd370 msgr2=0x7fd60c0b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 shutdown_connections 2024-09-21T06:46:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49.326+0000 7fd6115e6640 1 -- 172.21.15.81:0/565703245 wait complete. 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:46:49.339 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:46:49.340 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:49.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:49.340 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:49.356 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42661sec preferred_lft 42661sec 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5807:98ff:feed:57f8/64 scope link 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:49.357 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1029:45ff:fefa:d01b/64 scope link 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ea:d1:bd:3b:72:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e8d1:bdff:fe3b:7274/64 scope link 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:49.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:49.358 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:46:49.419 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:46:49.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:49.421 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:46:49.478 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:46:49.478 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:46:49.478 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:46:49.478 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:46:49.478 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:46:49.479 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:46:49.479 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:46:49.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:46:49.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:46:49.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:46:49.479 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:46:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:46:49.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:49.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:49.603 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:46:49.619 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:46:49.619 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:46:49.619 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:49.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:49.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:46:49.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:49.685 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:49.740 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:49.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:49.740 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:49.796 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:46:49.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:49.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:49.889 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:49.890 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:49.898 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:49.898 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:49.898 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:46:49.898 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:46:49.898 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:46:49.899 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:46:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:46:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:46:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:46:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:46:49.901 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:46:49.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:49.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:49.926 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:46:50.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:46:50.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:50.027 INFO:teuthology.orchestra.run.smithi081.stdout:client5051 2024-09-21T06:46:50.027 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:50.027 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:50.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:50.043 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2024-09-21T06:46:50.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 -- 172.21.15.81:0/1000236189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415eda0 msgr2=0x7ff8440b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 --2- 172.21.15.81:0/1000236189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415eda0 0x7ff8440b96c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff84408d040 tx=0x7ff83802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 -- 172.21.15.81:0/1000236189 shutdown_connections 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 --2- 172.21.15.81:0/1000236189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415eda0 0x7ff8440b96c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 --2- 172.21.15.81:0/1000236189 >> v2:172.21.15.89:3300/0 conn(0x7ff84415c450 0x7ff8440d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 -- 172.21.15.81:0/1000236189 >> 172.21.15.81:0/1000236189 conn(0x7ff8440b7330 msgr2=0x7ff8440b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 -- 172.21.15.81:0/1000236189 shutdown_connections 2024-09-21T06:46:50.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.260+0000 7ff8488d5640 1 -- 172.21.15.81:0/1000236189 wait complete. 2024-09-21T06:46:50.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.262+0000 7ff8488d5640 1 Processor -- start 2024-09-21T06:46:50.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.262+0000 7ff8488d5640 1 -- start start 2024-09-21T06:46:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff8488d5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8440b9c00 0x7ff8440c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff8488d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415c450 0x7ff8440b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff8488d5640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff84415eda0 0x7ff84406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff8488d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b35c0 con 0x7ff84415c450 2024-09-21T06:46:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff8488d5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b3440 con 0x7ff8440b9c00 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff8488d5640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff8440b3740 con 0x7ff84415eda0 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415c450 0x7ff8440b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415c450 0x7ff8440b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49170/0 (socket says 172.21.15.81:49170) 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 -- 172.21.15.81:0/605596057 learned_addr learned my addr 172.21.15.81:0/605596057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff84259c640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8440b9c00 0x7ff8440c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff842d9d640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff84415eda0 0x7ff84406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 -- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff84415eda0 msgr2=0x7ff84406d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff84415eda0 0x7ff84406d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 -- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8440b9c00 msgr2=0x7ff8440c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8440b9c00 0x7ff8440c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 -- 172.21.15.81:0/605596057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8440c7f90 con 0x7ff84415c450 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff841d9b640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415c450 0x7ff8440b6080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff838034040 tx=0x7ff8380039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff832ffd640 1 -- 172.21.15.81:0/605596057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83803e030 con 0x7ff84415c450 2024-09-21T06:46:50.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff832ffd640 1 -- 172.21.15.81:0/605596057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8380047a0 con 0x7ff84415c450 2024-09-21T06:46:50.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8440c8270 con 0x7ff84415c450 2024-09-21T06:46:50.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.264+0000 7ff832ffd640 1 -- 172.21.15.81:0/605596057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838035040 con 0x7ff84415c450 2024-09-21T06:46:50.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.265+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8440b5b60 con 0x7ff84415c450 2024-09-21T06:46:50.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.265+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84408d110 con 0x7ff84415c450 2024-09-21T06:46:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.266+0000 7ff832ffd640 1 -- 172.21.15.81:0/605596057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff838041030 con 0x7ff84415c450 2024-09-21T06:46:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.267+0000 7ff832ffd640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff824078b90 0x7ff82407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.267+0000 7ff832ffd640 1 -- 172.21.15.81:0/605596057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7ff8380bb820 con 0x7ff84415c450 2024-09-21T06:46:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.267+0000 7ff84259c640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff824078b90 0x7ff82407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.268+0000 7ff84259c640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff824078b90 0x7ff82407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8340058c0 tx=0x7ff834005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.271+0000 7ff832ffd640 1 -- 172.21.15.81:0/605596057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff84408d110 con 0x7ff84415c450 2024-09-21T06:46:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.515+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) -- 0x7ff8440b5670 con 0x7ff84415c450 2024-09-21T06:46:50.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.518+0000 7ff832ffd640 1 -- 172.21.15.81:0/605596057 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v38) ==== 183+0+140 (secure 0 0 0) 0x7ff838083ad0 con 0x7ff84415c450 2024-09-21T06:46:50.520 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-21T06:46:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:50.520 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow r pool=cephfs_data" 2024-09-21T06:46:50.521 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff824078b90 msgr2=0x7ff82407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff824078b90 0x7ff82407b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff8340058c0 tx=0x7ff834005850 comp rx=0 tx=0).stop 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415c450 msgr2=0x7ff8440b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415c450 0x7ff8440b6080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff838034040 tx=0x7ff8380039e0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 shutdown_connections 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff824078b90 0x7ff82407b0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff84415eda0 0x7ff84406d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff84415c450 0x7ff8440b6080 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 --2- 172.21.15.81:0/605596057 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8440b9c00 0x7ff8440c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 >> 172.21.15.81:0/605596057 conn(0x7ff8440b7330 msgr2=0x7ff8440cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 shutdown_connections 2024-09-21T06:46:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.520+0000 7ff8488d5640 1 -- 172.21.15.81:0/605596057 wait complete. 2024-09-21T06:46:50.534 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:50.534 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:50.550 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:50.550 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:50.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 -- 172.21.15.81:0/901158376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c0ad8b0 msgr2=0x7ff09c06ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 --2- 172.21.15.81:0/901158376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c06ec90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff090005fd0 tx=0x7ff09002a540 comp rx=0 tx=0).stop 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 -- 172.21.15.81:0/901158376 shutdown_connections 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 --2- 172.21.15.81:0/901158376 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff09c15c640 0x7ff09c15ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 --2- 172.21.15.81:0/901158376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c06ec90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 -- 172.21.15.81:0/901158376 >> 172.21.15.81:0/901158376 conn(0x7ff09c0b2030 msgr2=0x7ff09c0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 -- 172.21.15.81:0/901158376 shutdown_connections 2024-09-21T06:46:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.756+0000 7ff0a36be640 1 -- 172.21.15.81:0/901158376 wait complete. 2024-09-21T06:46:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.758+0000 7ff0a36be640 1 Processor -- start 2024-09-21T06:46:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.758+0000 7ff0a36be640 1 -- start start 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.759+0000 7ff0a36be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09c0b4b70 0x7ff09c0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.759+0000 7ff0a36be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c15c640 0x7ff09c1f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a36be640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff09c1f96a0 0x7ff09c150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a36be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c0b36c0 con 0x7ff09c15c640 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a36be640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c0b3540 con 0x7ff09c0b4b70 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a36be640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c0b3840 con 0x7ff09c1f96a0 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c15c640 0x7ff09c1f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c15c640 0x7ff09c1f9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49176/0 (socket says 172.21.15.81:49176) 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 -- 172.21.15.81:0/2133773116 learned_addr learned my addr 172.21.15.81:0/2133773116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a1c5b640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff09c1f96a0 0x7ff09c150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a145a640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09c0b4b70 0x7ff09c0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 -- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff09c1f96a0 msgr2=0x7ff09c150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff09c1f96a0 0x7ff09c150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 -- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09c0b4b70 msgr2=0x7ff09c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09c0b4b70 0x7ff09c0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 -- 172.21.15.81:0/2133773116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0748c0 con 0x7ff09c15c640 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a0c59640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c15c640 0x7ff09c1f9160 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff090034040 tx=0x7ff090003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff099ffb640 1 -- 172.21.15.81:0/2133773116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09003e030 con 0x7ff09c15c640 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff099ffb640 1 -- 172.21.15.81:0/2133773116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff090003e00 con 0x7ff09c15c640 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c09d230 con 0x7ff09c15c640 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.760+0000 7ff099ffb640 1 -- 172.21.15.81:0/2133773116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090035040 con 0x7ff09c15c640 2024-09-21T06:46:50.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.761+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c072d60 con 0x7ff09c15c640 2024-09-21T06:46:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.762+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c06f230 con 0x7ff09c15c640 2024-09-21T06:46:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.762+0000 7ff099ffb640 1 -- 172.21.15.81:0/2133773116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff090041030 con 0x7ff09c15c640 2024-09-21T06:46:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.763+0000 7ff099ffb640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff088078bc0 0x7ff08807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.763+0000 7ff099ffb640 1 -- 172.21.15.81:0/2133773116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7ff0900bb680 con 0x7ff09c15c640 2024-09-21T06:46:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.763+0000 7ff0a145a640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff088078bc0 0x7ff08807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.764+0000 7ff0a145a640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff088078bc0 0x7ff08807b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff08c001ce0 tx=0x7ff08c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.767+0000 7ff099ffb640 1 -- 172.21.15.81:0/2133773116 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff09c06f230 con 0x7ff09c15c640 2024-09-21T06:46:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.956+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff09c09cfc0 con 0x7ff09c15c640 2024-09-21T06:46:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.956+0000 7ff099ffb640 1 -- 172.21.15.81:0/2133773116 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7ff0900839c0 con 0x7ff09c15c640 2024-09-21T06:46:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:46:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff088078bc0 msgr2=0x7ff08807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff088078bc0 0x7ff08807b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff08c001ce0 tx=0x7ff08c009040 comp rx=0 tx=0).stop 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c15c640 msgr2=0x7ff09c1f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c15c640 0x7ff09c1f9160 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff090034040 tx=0x7ff090003910 comp rx=0 tx=0).stop 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 shutdown_connections 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff088078bc0 0x7ff08807b0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff09c1f96a0 0x7ff09c150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff09c15c640 0x7ff09c1f9160 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 --2- 172.21.15.81:0/2133773116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff09c0b4b70 0x7ff09c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 >> 172.21.15.81:0/2133773116 conn(0x7ff09c0b2030 msgr2=0x7ff09c0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 shutdown_connections 2024-09-21T06:46:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:50.958+0000 7ff0a36be640 1 -- 172.21.15.81:0/2133773116 wait complete. 2024-09-21T06:46:50.971 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:46:50.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:50.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:51.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:46:51.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:51.002 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:46:51.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:46:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 -- 172.21.15.81:0/4060866891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75400b9c00 msgr2=0x7f75400d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 --2- 172.21.15.81:0/4060866891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75400b9c00 0x7f75400d41a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f754008d040 tx=0x7f753802a560 comp rx=0 tx=0).stop 2024-09-21T06:46:51.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 -- 172.21.15.81:0/4060866891 shutdown_connections 2024-09-21T06:46:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 --2- 172.21.15.81:0/4060866891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75400b9c00 0x7f75400d41a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 --2- 172.21.15.81:0/4060866891 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754015eda0 0x7f75400b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 --2- 172.21.15.81:0/4060866891 >> v2:172.21.15.89:3300/0 conn(0x7f754015c450 0x7f75400d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 -- 172.21.15.81:0/4060866891 >> 172.21.15.81:0/4060866891 conn(0x7f75400b7330 msgr2=0x7f75400b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 -- 172.21.15.81:0/4060866891 shutdown_connections 2024-09-21T06:46:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.208+0000 7f7545319640 1 -- 172.21.15.81:0/4060866891 wait complete. 2024-09-21T06:46:51.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.210+0000 7f7545319640 1 Processor -- start 2024-09-21T06:46:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.210+0000 7f7545319640 1 -- start start 2024-09-21T06:46:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f7545319640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75400b9c00 0x7f75400b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f7545319640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754015c450 0x7f75400b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f7545319640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f754015eda0 0x7f75400b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f7545319640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75400b3230 con 0x7f754015eda0 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f7545319640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f75400d4b00 con 0x7f75400b9c00 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f7545319640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f75400b33b0 con 0x7f754015c450 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f754015eda0 0x7f75400b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f754015eda0 0x7f75400b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49194/0 (socket says 172.21.15.81:49194) 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 -- 172.21.15.81:0/496322225 learned_addr learned my addr 172.21.15.81:0/496322225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753e7fc640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754015c450 0x7f75400b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753effd640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75400b9c00 0x7f75400b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 -- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754015c450 msgr2=0x7f75400b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754015c450 0x7f75400b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 -- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75400b9c00 msgr2=0x7f75400b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75400b9c00 0x7f75400b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753f7fe640 1 -- 172.21.15.81:0/496322225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754009e3d0 con 0x7f754015eda0 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753e7fc640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754015c450 0x7f75400b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.211+0000 7f753effd640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75400b9c00 0x7f75400b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.212+0000 7f753f7fe640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f754015eda0 0x7f75400b59e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7538034040 tx=0x7f7538003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.212+0000 7f75277fe640 1 -- 172.21.15.81:0/496322225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753803e030 con 0x7f754015eda0 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.212+0000 7f75277fe640 1 -- 172.21.15.81:0/496322225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7538003e50 con 0x7f754015eda0 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.212+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754009fb30 con 0x7f754015eda0 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.212+0000 7f75277fe640 1 -- 172.21.15.81:0/496322225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538035040 con 0x7f754015eda0 2024-09-21T06:46:51.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.212+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75400a00f0 con 0x7f754015eda0 2024-09-21T06:46:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.213+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754008d110 con 0x7f754015eda0 2024-09-21T06:46:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.213+0000 7f75277fe640 1 -- 172.21.15.81:0/496322225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7538041030 con 0x7f754015eda0 2024-09-21T06:46:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.214+0000 7f75277fe640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f752c078b90 0x7f752c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.214+0000 7f75277fe640 1 -- 172.21.15.81:0/496322225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f75380bb760 con 0x7f754015eda0 2024-09-21T06:46:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.214+0000 7f753effd640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f752c078b90 0x7f752c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.215+0000 7f753effd640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f752c078b90 0x7f752c07b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f754008c9c0 tx=0x7f7530009570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.218+0000 7f75277fe640 1 -- 172.21.15.81:0/496322225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f754008d110 con 0x7f754015eda0 2024-09-21T06:46:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.435+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f75400b3950 con 0x7f754015eda0 2024-09-21T06:46:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.435+0000 7f75277fe640 1 -- 172.21.15.81:0/496322225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f7538083a10 con 0x7f754015eda0 2024-09-21T06:46:51.437 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:46:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f752c078b90 msgr2=0x7f752c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f752c078b90 0x7f752c07b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f754008c9c0 tx=0x7f7530009570 comp rx=0 tx=0).stop 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f754015eda0 msgr2=0x7f75400b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f754015eda0 0x7f75400b59e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7538034040 tx=0x7f7538003960 comp rx=0 tx=0).stop 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 shutdown_connections 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f752c078b90 0x7f752c07b0a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754015c450 0x7f75400b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f754015eda0 0x7f75400b59e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 --2- 172.21.15.81:0/496322225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75400b9c00 0x7f75400b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 >> 172.21.15.81:0/496322225 conn(0x7f75400b7330 msgr2=0x7f7540160d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 shutdown_connections 2024-09-21T06:46:51.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51.437+0000 7f7545319640 1 -- 172.21.15.81:0/496322225 wait complete. 2024-09-21T06:46:51.450 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:46:51.451 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:51.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:51.451 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:46:51.467 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:46:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:46:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:46:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:46:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:51.467 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42659sec preferred_lft 42659sec 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:51.468 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5807:98ff:feed:57f8/64 scope link 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1029:45ff:fefa:d01b/64 scope link 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ea:d1:bd:3b:72:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e8d1:bdff:fe3b:7274/64 scope link 2024-09-21T06:46:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:51.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:51.470 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:51.532 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:46:51.587 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:46:51.588 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:46:51.588 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:46:51.588 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:46:51.588 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:46:51.588 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:46:51.588 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:46:51.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:46:51.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:46:51.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:46:51.589 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:46:51.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:46:51.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:51.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:51.713 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:46:51.728 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:46:51.728 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:46:51.728 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:51.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:51.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:46:51.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:51.794 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:51.849 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:51.850 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:51.850 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:51.905 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:46:51.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:51.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:51.999 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:51.999 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:52.007 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:52.007 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:52.007 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:46:52.007 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:46:52.007 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:46:52.008 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:46:52.008 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:46:52.008 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:46:52.008 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:46:52.008 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:46:52.010 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:46:52.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:52.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:52.035 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:46:52.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:46:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:52.130 INFO:teuthology.orchestra.run.smithi081.stdout:client5066 2024-09-21T06:46:52.130 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:52.130 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:52.146 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-21T06:46:52.146 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-21T06:46:52.146 DEBUG:teuthology.orchestra.run.smithi081:> import errno 2024-09-21T06:46:52.146 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T06:46:52.146 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> ret = os.read(fd, 1024) 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> else: 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> os.write(fd, b'"'"'content'"'"') 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> if e.errno != errno.EPERM: 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> raise 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> else: 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("client does not check permission of data pool") 2024-09-21T06:46:52.147 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-21T06:46:52.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:52.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2024-09-21T06:46:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 -- 172.21.15.81:0/2088670078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 msgr2=0x7f85440d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 --2- 172.21.15.81:0/2088670078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f85440d3220 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f85440ceac0 tx=0x7f853402a4d0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 -- 172.21.15.81:0/2088670078 shutdown_connections 2024-09-21T06:46:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 --2- 172.21.15.81:0/2088670078 >> v2:172.21.15.89:3300/0 conn(0x7f85440d41a0 0x7f85440d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 --2- 172.21.15.81:0/2088670078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f85440d3220 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 -- 172.21.15.81:0/2088670078 >> 172.21.15.81:0/2088670078 conn(0x7f85440b7330 msgr2=0x7f85440b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 -- 172.21.15.81:0/2088670078 shutdown_connections 2024-09-21T06:46:52.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.419+0000 7f8549519640 1 -- 172.21.15.81:0/2088670078 wait complete. 2024-09-21T06:46:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.421+0000 7f8549519640 1 Processor -- start 2024-09-21T06:46:52.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.421+0000 7f8549519640 1 -- start start 2024-09-21T06:46:52.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f8549519640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85440d41a0 0x7f854414c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f8549519640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f854406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f8549519640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f854415eda0 0x7f85441f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f8549519640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f85440b35c0 con 0x7f854415c450 2024-09-21T06:46:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f8549519640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f85440b3440 con 0x7f85440d41a0 2024-09-21T06:46:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f8549519640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f85440b3740 con 0x7f854415eda0 2024-09-21T06:46:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f854406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f854406d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49202/0 (socket says 172.21.15.81:49202) 2024-09-21T06:46:52.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 -- 172.21.15.81:0/3726108635 learned_addr learned my addr 172.21.15.81:0/3726108635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f8542ffd640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85440d41a0 0x7f854414c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85437fe640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f854415eda0 0x7f85441f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 -- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f854415eda0 msgr2=0x7f85441f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f854415eda0 0x7f85441f9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 -- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85440d41a0 msgr2=0x7f854414c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85440d41a0 0x7f854414c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.422+0000 7f85427fc640 1 -- 172.21.15.81:0/3726108635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85441f6ca0 con 0x7f854415c450 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.423+0000 7f85427fc640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f854406d7a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f853800b3f0 tx=0x7f853800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.423+0000 7f852b7fe640 1 -- 172.21.15.81:0/3726108635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538015020 con 0x7f854415c450 2024-09-21T06:46:52.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.423+0000 7f852b7fe640 1 -- 172.21.15.81:0/3726108635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8538011920 con 0x7f854415c450 2024-09-21T06:46:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.423+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854414cf30 con 0x7f854415c450 2024-09-21T06:46:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.423+0000 7f852b7fe640 1 -- 172.21.15.81:0/3726108635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538011d70 con 0x7f854415c450 2024-09-21T06:46:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.423+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854406e700 con 0x7f854415c450 2024-09-21T06:46:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.424+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854408d110 con 0x7f854415c450 2024-09-21T06:46:52.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.425+0000 7f852b7fe640 1 -- 172.21.15.81:0/3726108635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8538018020 con 0x7f854415c450 2024-09-21T06:46:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.425+0000 7f852b7fe640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8530078b90 0x7f853007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.425+0000 7f852b7fe640 1 -- 172.21.15.81:0/3726108635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f853809ab10 con 0x7f854415c450 2024-09-21T06:46:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.425+0000 7f8542ffd640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8530078b90 0x7f853007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.426+0000 7f8542ffd640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8530078b90 0x7f853007b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8534033000 tx=0x7f8534004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:52.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.430+0000 7f852b7fe640 1 -- 172.21.15.81:0/3726108635 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f854408d110 con 0x7f854415c450 2024-09-21T06:46:52.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.673+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) -- 0x7f85440d45b0 con 0x7f854415c450 2024-09-21T06:46:52.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.676+0000 7f852b7fe640 1 -- 172.21.15.81:0/3726108635 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v39) ==== 183+0+140 (secure 0 0 0) 0x7f853801f030 con 0x7f854415c450 2024-09-21T06:46:52.678 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:52.678 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:52.678 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-21T06:46:52.678 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:52.679 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow w pool=cephfs_data" 2024-09-21T06:46:52.679 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8530078b90 msgr2=0x7f853007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8530078b90 0x7f853007b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8534033000 tx=0x7f8534004730 comp rx=0 tx=0).stop 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 msgr2=0x7f854406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f854406d7a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f853800b3f0 tx=0x7f853800b8b0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 shutdown_connections 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8530078b90 0x7f853007b0a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f854415eda0 0x7f85441f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854415c450 0x7f854406d7a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 --2- 172.21.15.81:0/3726108635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85440d41a0 0x7f854414c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 >> 172.21.15.81:0/3726108635 conn(0x7f85440b7330 msgr2=0x7f854415c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:52.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 shutdown_connections 2024-09-21T06:46:52.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.678+0000 7f8549519640 1 -- 172.21.15.81:0/3726108635 wait complete. 2024-09-21T06:46:52.692 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:52.692 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:52.708 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:52.708 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:52.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 -- 172.21.15.81:0/1859157500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca415c640 msgr2=0x7f0ca415ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 --2- 172.21.15.81:0/1859157500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca415c640 0x7f0ca415ca50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4072810 tx=0x7f0c9c02a820 comp rx=0 tx=0).stop 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 -- 172.21.15.81:0/1859157500 shutdown_connections 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 --2- 172.21.15.81:0/1859157500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca415c640 0x7f0ca415ca50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 --2- 172.21.15.81:0/1859157500 >> v2:172.21.15.89:3300/0 conn(0x7f0ca40b4b70 0x7f0ca406ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 -- 172.21.15.81:0/1859157500 >> 172.21.15.81:0/1859157500 conn(0x7f0ca40b2030 msgr2=0x7f0ca40b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 -- 172.21.15.81:0/1859157500 shutdown_connections 2024-09-21T06:46:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.916+0000 7f0cac358640 1 -- 172.21.15.81:0/1859157500 wait complete. 2024-09-21T06:46:52.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.918+0000 7f0cac358640 1 Processor -- start 2024-09-21T06:46:52.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.918+0000 7f0cac358640 1 -- start start 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0cac358640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca40ad1a0 0x7f0ca4144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0cac358640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ca40b4b70 0x7f0ca4159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0cac358640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ca415c640 0x7f0ca409d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0cac358640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca40b3640 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0cac358640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca40b34c0 con 0x7f0ca415c640 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0cac358640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca40b37c0 con 0x7f0ca40b4b70 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa8f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ca415c640 0x7f0ca409d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0ca98f3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ca40b4b70 0x7f0ca4159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa8f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ca415c640 0x7f0ca409d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:36884/0 (socket says 172.21.15.81:36884) 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0ca98f3640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ca40b4b70 0x7f0ca4159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:39568/0 (socket says 172.21.15.81:39568) 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa8f5640 1 -- 172.21.15.81:0/92786689 learned_addr learned my addr 172.21.15.81:0/92786689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa0f4640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca40ad1a0 0x7f0ca4144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa0f4640 1 -- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ca40b4b70 msgr2=0x7f0ca4159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa0f4640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ca40b4b70 0x7f0ca4159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa0f4640 1 -- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ca415c640 msgr2=0x7f0ca409d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa0f4640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ca415c640 0x7f0ca409d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa0f4640 1 -- 172.21.15.81:0/92786689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca415a550 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0caa0f4640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca40ad1a0 0x7f0ca4144570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c920 tx=0x7f0ca000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0c9affd640 1 -- 172.21.15.81:0/92786689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0007bb0 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0c9affd640 1 -- 172.21.15.81:0/92786689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ca0007e40 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.920+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca415a830 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.921+0000 7f0c9affd640 1 -- 172.21.15.81:0/92786689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0005280 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.921+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca415adf0 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.921+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca406f230 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.922+0000 7f0c9affd640 1 -- 172.21.15.81:0/92786689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ca0005420 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.923+0000 7f0c9affd640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0c88078b90 0x7f0c8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:52.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.923+0000 7f0c9affd640 1 -- 172.21.15.81:0/92786689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f0ca009b1a0 con 0x7f0ca40ad1a0 2024-09-21T06:46:52.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.923+0000 7f0ca98f3640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0c88078b90 0x7f0c8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:52.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.924+0000 7f0ca98f3640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0c88078b90 0x7f0c8807b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000f60 tx=0x7f0c94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:52.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:52.927+0000 7f0c9affd640 1 -- 172.21.15.81:0/92786689 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0ca406f230 con 0x7f0ca40ad1a0 2024-09-21T06:46:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.119+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ca40b3cf0 con 0x7f0ca40ad1a0 2024-09-21T06:46:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.119+0000 7f0c9affd640 1 -- 172.21.15.81:0/92786689 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7f0ca0014030 con 0x7f0ca40ad1a0 2024-09-21T06:46:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:46:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0c88078b90 msgr2=0x7f0c8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0c88078b90 0x7f0c8807b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c94000f60 tx=0x7f0c94009040 comp rx=0 tx=0).stop 2024-09-21T06:46:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca40ad1a0 msgr2=0x7f0ca4144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca40ad1a0 0x7f0ca4144570 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c920 tx=0x7f0ca000cde0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 shutdown_connections 2024-09-21T06:46:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0c88078b90 0x7f0c8807b0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ca40b4b70 0x7f0ca4159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ca415c640 0x7f0ca409d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 --2- 172.21.15.81:0/92786689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca40ad1a0 0x7f0ca4144570 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 >> 172.21.15.81:0/92786689 conn(0x7f0ca40b2030 msgr2=0x7f0ca4154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 shutdown_connections 2024-09-21T06:46:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.122+0000 7f0cac358640 1 -- 172.21.15.81:0/92786689 wait complete. 2024-09-21T06:46:53.135 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:46:53.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:53.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:53.162 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:46:53.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:53.163 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:46:53.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 -- 172.21.15.81:0/4111975942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806f400 msgr2=0x7fbd180af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/4111975942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806f400 0x7fbd180af1c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbd18072da0 tx=0x7fbd1002a560 comp rx=0 tx=0).stop 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 -- 172.21.15.81:0/4111975942 shutdown_connections 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/4111975942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806f400 0x7fbd180af1c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/4111975942 >> v2:172.21.15.89:3300/0 conn(0x7fbd1806e6a0 0x7fbd1806eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 -- 172.21.15.81:0/4111975942 >> 172.21.15.81:0/4111975942 conn(0x7fbd180740a0 msgr2=0x7fbd180b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 -- 172.21.15.81:0/4111975942 shutdown_connections 2024-09-21T06:46:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.368+0000 7fbd1eba9640 1 -- 172.21.15.81:0/4111975942 wait complete. 2024-09-21T06:46:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.370+0000 7fbd1eba9640 1 Processor -- start 2024-09-21T06:46:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.370+0000 7fbd1eba9640 1 -- start start 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.371+0000 7fbd1eba9640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd1806e6a0 0x7fbd181e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.371+0000 7fbd1eba9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806eff0 0x7fbd1814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.371+0000 7fbd1eba9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd1806f400 0x7fbd1814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.371+0000 7fbd1eba9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd180af700 con 0x7fbd1806eff0 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.371+0000 7fbd1eba9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1809ac40 con 0x7fbd1806f400 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.371+0000 7fbd1eba9640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fbd180af880 con 0x7fbd1806e6a0 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806eff0 0x7fbd1814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806eff0 0x7fbd1814e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49252/0 (socket says 172.21.15.81:49252) 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 -- 172.21.15.81:0/3153134539 learned_addr learned my addr 172.21.15.81:0/3153134539 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd1d146640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd1806f400 0x7fbd1814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd1c945640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd1806e6a0 0x7fbd181e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 -- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd1806e6a0 msgr2=0x7fbd181e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd1806e6a0 0x7fbd181e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 -- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd1806f400 msgr2=0x7fbd1814f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd1806f400 0x7fbd1814f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 -- 172.21.15.81:0/3153134539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd181f6150 con 0x7fbd1806eff0 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd17fff640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806eff0 0x7fbd1814e650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c7a0 tx=0x7fbd0c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd157fa640 1 -- 172.21.15.81:0/3153134539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c017070 con 0x7fbd1806eff0 2024-09-21T06:46:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd157fa640 1 -- 172.21.15.81:0/3153134539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd0c005070 con 0x7fbd1806eff0 2024-09-21T06:46:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd181f6430 con 0x7fbd1806eff0 2024-09-21T06:46:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd157fa640 1 -- 172.21.15.81:0/3153134539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0054a0 con 0x7fbd1806eff0 2024-09-21T06:46:53.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.372+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd181f69f0 con 0x7fbd1806eff0 2024-09-21T06:46:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.373+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd181f5ec0 con 0x7fbd1806eff0 2024-09-21T06:46:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.374+0000 7fbd157fa640 1 -- 172.21.15.81:0/3153134539 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd0c01a070 con 0x7fbd1806eff0 2024-09-21T06:46:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.375+0000 7fbd157fa640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbd04078b90 0x7fbd0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.375+0000 7fbd157fa640 1 -- 172.21.15.81:0/3153134539 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7fbd0c09a440 con 0x7fbd1806eff0 2024-09-21T06:46:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.375+0000 7fbd1c945640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbd04078b90 0x7fbd0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.375+0000 7fbd1c945640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbd04078b90 0x7fbd0407b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800bb50 tx=0x7fbd0800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:53.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.379+0000 7fbd157fa640 1 -- 172.21.15.81:0/3153134539 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbd0c062130 con 0x7fbd1806eff0 2024-09-21T06:46:53.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.592+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbd181f2800 con 0x7fbd1806eff0 2024-09-21T06:46:53.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.592+0000 7fbd157fa640 1 -- 172.21.15.81:0/3153134539 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fbd0c066b60 con 0x7fbd1806eff0 2024-09-21T06:46:53.595 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbd04078b90 msgr2=0x7fbd0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbd04078b90 0x7fbd0407b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800bb50 tx=0x7fbd0800b2e0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806eff0 msgr2=0x7fbd1814e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806eff0 0x7fbd1814e650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c7a0 tx=0x7fbd0c00cc60 comp rx=0 tx=0).stop 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 shutdown_connections 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fbd04078b90 0x7fbd0407b0a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd1806f400 0x7fbd1814f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd1806eff0 0x7fbd1814e650 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 --2- 172.21.15.81:0/3153134539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd1806e6a0 0x7fbd181e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 >> 172.21.15.81:0/3153134539 conn(0x7fbd180740a0 msgr2=0x7fbd181593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 shutdown_connections 2024-09-21T06:46:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53.595+0000 7fbd1eba9640 1 -- 172.21.15.81:0/3153134539 wait complete. 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:46:53.608 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:53.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:53.609 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-21T06:46:53.624 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:46:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:46:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:46:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T06:46:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42657sec preferred_lft 42657sec 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::5807:98ff:feed:57f8/64 scope link 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 12:29:45:fa:d0:1b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:46:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::1029:45ff:fefa:d01b/64 scope link 2024-09-21T06:46:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:53.627 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T06:46:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ea:d1:bd:3b:72:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:46:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e8d1:bdff:fe3b:7274/64 scope link 2024-09-21T06:46:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:46:53.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:53.627 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:46:53.688 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-21T06:46:53.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:53.690 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-21T06:46:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-21T06:46:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:46:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T06:46:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T06:46:53.746 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:46:53.746 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:46:53.746 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-21T06:46:53.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T06:46:53.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T06:46:53.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T06:46:53.747 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-21T06:46:53.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:46:53.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:53.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:53.873 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:46:53.888 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:46:53.888 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:46:53.888 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:53.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:53.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-21T06:46:53.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:53.955 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:54.010 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:46:54.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:46:54.011 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:54.066 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T06:46:54.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:54.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:54.160 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:54.161 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:54.168 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T06:46:54.168 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T06:46:54.169 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2024-09-21T06:46:54.169 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@5acf265c-1f37-45bc-9438-eb9ad71b6190.cephfs=/ 2024-09-21T06:46:54.169 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2024-09-21T06:46:54.169 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:46:54.169 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:46:54.169 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:46:54.169 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:46:54.170 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:46:54.171 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:46:54.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:54.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:54.195 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:46:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:46:54.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:54.292 INFO:teuthology.orchestra.run.smithi081.stdout:client5652 2024-09-21T06:46:54.293 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:54.293 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> import errno 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> if True: 2024-09-21T06:46:54.309 DEBUG:teuthology.orchestra.run.smithi081:> ret = os.read(fd, 1024) 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> else: 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> os.write(fd, b'"'"'content'"'"') 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> except OSError as e: 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> if e.errno != errno.EPERM: 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> raise 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> else: 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("client does not check permission of data pool") 2024-09-21T06:46:54.310 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-21T06:46:54.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:46:54.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2024-09-21T06:46:54.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 -- 172.21.15.81:0/2061224456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c0d1150 msgr2=0x7eff7c0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 --2- 172.21.15.81:0/2061224456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c0d1150 0x7eff7c0d1560 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7eff7c073920 tx=0x7eff6402a560 comp rx=0 tx=0).stop 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 -- 172.21.15.81:0/2061224456 shutdown_connections 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 --2- 172.21.15.81:0/2061224456 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff7c0cdb90 0x7eff7c0cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 --2- 172.21.15.81:0/2061224456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c0d1150 0x7eff7c0d1560 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 --2- 172.21.15.81:0/2061224456 >> v2:172.21.15.89:3300/0 conn(0x7eff7c15b6a0 0x7eff7c071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 -- 172.21.15.81:0/2061224456 >> 172.21.15.81:0/2061224456 conn(0x7eff7c09aa30 msgr2=0x7eff7c0b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 -- 172.21.15.81:0/2061224456 shutdown_connections 2024-09-21T06:46:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.584+0000 7eff819b0640 1 -- 172.21.15.81:0/2061224456 wait complete. 2024-09-21T06:46:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.586+0000 7eff819b0640 1 Processor -- start 2024-09-21T06:46:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.586+0000 7eff819b0640 1 -- start start 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff819b0640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff7c0cdb90 0x7eff7c15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff819b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff7c0d1150 0x7eff7c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff819b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c15b6a0 0x7eff7c0b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff819b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c15fcf0 con 0x7eff7c15b6a0 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff819b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c0d2120 con 0x7eff7c0d1150 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff819b0640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7eff7c0ce4e0 con 0x7eff7c0cdb90 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff7b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c15b6a0 0x7eff7c0b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff7b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c15b6a0 0x7eff7c0b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49284/0 (socket says 172.21.15.81:49284) 2024-09-21T06:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff7b7fe640 1 -- 172.21.15.81:0/4134649322 learned_addr learned my addr 172.21.15.81:0/4134649322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff7a7fc640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff7c0d1150 0x7eff7c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.587+0000 7eff7affd640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff7c0cdb90 0x7eff7c15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff7b7fe640 1 -- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff7c0cdb90 msgr2=0x7eff7c15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff7b7fe640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff7c0cdb90 0x7eff7c15cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff7b7fe640 1 -- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff7c0d1150 msgr2=0x7eff7c154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff7b7fe640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff7c0d1150 0x7eff7c154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff7b7fe640 1 -- 172.21.15.81:0/4134649322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c0cb550 con 0x7eff7c15b6a0 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff7b7fe640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c15b6a0 0x7eff7c0b2370 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7eff740099d0 tx=0x7eff74009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff73fff640 1 -- 172.21.15.81:0/4134649322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7400bc30 con 0x7eff7c15b6a0 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff73fff640 1 -- 172.21.15.81:0/4134649322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff7400bdd0 con 0x7eff7c15b6a0 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c1f3680 con 0x7eff7c15b6a0 2024-09-21T06:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff73fff640 1 -- 172.21.15.81:0/4134649322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74005280 con 0x7eff7c15b6a0 2024-09-21T06:46:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.588+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7c0c90c0 con 0x7eff7c15b6a0 2024-09-21T06:46:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.589+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7c0d1560 con 0x7eff7c15b6a0 2024-09-21T06:46:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.590+0000 7eff73fff640 1 -- 172.21.15.81:0/4134649322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff74005420 con 0x7eff7c15b6a0 2024-09-21T06:46:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.590+0000 7eff73fff640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7eff5c078bc0 0x7eff5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.590+0000 7eff73fff640 1 -- 172.21.15.81:0/4134649322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7eff7409b080 con 0x7eff7c15b6a0 2024-09-21T06:46:54.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.591+0000 7eff7affd640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7eff5c078bc0 0x7eff5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.591+0000 7eff7affd640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7eff5c078bc0 0x7eff5c07b0d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff6c005fd0 tx=0x7eff6c00f850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:54.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.595+0000 7eff73fff640 1 -- 172.21.15.81:0/4134649322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7eff74062ce0 con 0x7eff7c15b6a0 2024-09-21T06:46:54.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.840+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) -- 0x7eff7c0d0930 con 0x7eff7c15b6a0 2024-09-21T06:46:54.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.843+0000 7eff73fff640 1 -- 172.21.15.81:0/4134649322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v40) ==== 184+0+141 (secure 0 0 0) 0x7eff74067710 con 0x7eff7c15b6a0 2024-09-21T06:46:54.845 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-21T06:46:54.846 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0a+5m2PtOCBAAia/HjdbFDXGh8WZH53BoGg== 2024-09-21T06:46:54.846 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-21T06:46:54.846 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-21T06:46:54.846 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw pool=cephfs_data" 2024-09-21T06:46:54.846 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-21T06:46:54.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7eff5c078bc0 msgr2=0x7eff5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7eff5c078bc0 0x7eff5c07b0d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7eff6c005fd0 tx=0x7eff6c00f850 comp rx=0 tx=0).stop 2024-09-21T06:46:54.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c15b6a0 msgr2=0x7eff7c0b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c15b6a0 0x7eff7c0b2370 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7eff740099d0 tx=0x7eff74009e90 comp rx=0 tx=0).stop 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 shutdown_connections 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7eff5c078bc0 0x7eff5c07b0d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff7c15b6a0 0x7eff7c0b2370 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff7c0d1150 0x7eff7c154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 --2- 172.21.15.81:0/4134649322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff7c0cdb90 0x7eff7c15cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 >> 172.21.15.81:0/4134649322 conn(0x7eff7c09aa30 msgr2=0x7eff7c0b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 shutdown_connections 2024-09-21T06:46:54.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:54.846+0000 7eff819b0640 1 -- 172.21.15.81:0/4134649322 wait complete. 2024-09-21T06:46:54.859 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T06:46:54.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:46:54.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T06:46:54.938 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T06:46:54.938 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:54.938 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:54.938 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:54.954 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:54.954 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:55.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T06:46:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.162+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/672751151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40d3220 msgr2=0x7f0bb40b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.162+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/672751151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40d3220 0x7f0bb40b96c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009830 tx=0x7f0ba402a510 comp rx=0 tx=0).stop 2024-09-21T06:46:55.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.162+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/672751151 shutdown_connections 2024-09-21T06:46:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.162+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/672751151 >> v2:172.21.15.89:3300/0 conn(0x7f0bb40b9c00 0x7f0bb40d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.162+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/672751151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40d3220 0x7f0bb40b96c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.162+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/672751151 >> 172.21.15.81:0/672751151 conn(0x7f0bb40b7330 msgr2=0x7f0bb40b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.163+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/672751151 shutdown_connections 2024-09-21T06:46:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.163+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/672751151 wait complete. 2024-09-21T06:46:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.164+0000 7f0bbb7c6640 1 Processor -- start 2024-09-21T06:46:55.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.164+0000 7f0bbb7c6640 1 -- start start 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bbb7c6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40b9c00 0x7f0bb4155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bbb7c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb40d3220 0x7f0bb40b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bbb7c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb415c450 0x7f0bb41f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bbb7c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb40b35c0 con 0x7f0bb415c450 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bbb7c6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb40b3440 con 0x7f0bb40d3220 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bbb7c6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb40b3740 con 0x7f0bb40b9c00 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb415c450 0x7f0bb41f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb415c450 0x7f0bb41f8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49292/0 (socket says 172.21.15.81:49292) 2024-09-21T06:46:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 -- 172.21.15.81:0/924293799 learned_addr learned my addr 172.21.15.81:0/924293799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9562640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40b9c00 0x7f0bb4155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb8d61640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb40d3220 0x7f0bb40b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 -- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40b9c00 msgr2=0x7f0bb4155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40b9c00 0x7f0bb4155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 -- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb40d3220 msgr2=0x7f0bb40b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb40d3220 0x7f0bb40b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 -- 172.21.15.81:0/924293799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb4156050 con 0x7f0bb415c450 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bb9d63640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb415c450 0x7f0bb41f8d20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00ef00 tx=0x7f0bac00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0ba9ffb640 1 -- 172.21.15.81:0/924293799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac003970 con 0x7f0bb415c450 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb40ca070 con 0x7f0bb415c450 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0ba9ffb640 1 -- 172.21.15.81:0/924293799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bac003c00 con 0x7f0bb415c450 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.166+0000 7f0ba9ffb640 1 -- 172.21.15.81:0/924293799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac004020 con 0x7f0bb415c450 2024-09-21T06:46:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.167+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb40ca630 con 0x7f0bb415c450 2024-09-21T06:46:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.168+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb408d110 con 0x7f0bb415c450 2024-09-21T06:46:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.168+0000 7f0ba9ffb640 1 -- 172.21.15.81:0/924293799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bac01d020 con 0x7f0bb415c450 2024-09-21T06:46:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.169+0000 7f0ba9ffb640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b98078b90 0x7f0b9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.169+0000 7f0ba9ffb640 1 -- 172.21.15.81:0/924293799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f0bac09b430 con 0x7f0bb415c450 2024-09-21T06:46:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.169+0000 7f0bb9562640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b98078b90 0x7f0b9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.169+0000 7f0bb9562640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b98078b90 0x7f0b9807b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0007fd0 tx=0x7f0bb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.173+0000 7f0ba9ffb640 1 -- 172.21.15.81:0/924293799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0bb408d110 con 0x7f0bb415c450 2024-09-21T06:46:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.362+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0bb40d41a0 con 0x7f0bb415c450 2024-09-21T06:46:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.362+0000 7f0ba9ffb640 1 -- 172.21.15.81:0/924293799 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7f0bac0630a0 con 0x7f0bb415c450 2024-09-21T06:46:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-21T06:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b98078b90 msgr2=0x7f0b9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b98078b90 0x7f0b9807b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0007fd0 tx=0x7f0bb0009040 comp rx=0 tx=0).stop 2024-09-21T06:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb415c450 msgr2=0x7f0bb41f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb415c450 0x7f0bb41f8d20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00ef00 tx=0x7f0bac00c740 comp rx=0 tx=0).stop 2024-09-21T06:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 shutdown_connections 2024-09-21T06:46:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0b98078b90 0x7f0b9807b0a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb415c450 0x7f0bb41f8d20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bb40d3220 0x7f0bb40b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 --2- 172.21.15.81:0/924293799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bb40b9c00 0x7f0bb4155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 >> 172.21.15.81:0/924293799 conn(0x7f0bb40b7330 msgr2=0x7f0bb415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 shutdown_connections 2024-09-21T06:46:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.365+0000 7f0bbb7c6640 1 -- 172.21.15.81:0/924293799 wait complete. 2024-09-21T06:46:55.378 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:46:55.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:55.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:55.406 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:46:55.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:55.407 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:46:55.463 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:55.463 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:46:55.463 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:55.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:46:55.483 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:55.483 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:46:55.483 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:55.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=10698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:46:55.518 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T06:46:55.518 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:46:55.519 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:55.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:46:55.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:55.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.668+0000 7f8686a9b640 1 -- 172.21.15.81:0/1468260996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 msgr2=0x7f86800d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.668+0000 7f8686a9b640 1 --2- 172.21.15.81:0/1468260996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800d3220 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f86800b93b0 tx=0x7f867002a480 comp rx=0 tx=0).stop 2024-09-21T06:46:55.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.668+0000 7f8686a9b640 1 -- 172.21.15.81:0/1468260996 shutdown_connections 2024-09-21T06:46:55.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.668+0000 7f8686a9b640 1 --2- 172.21.15.81:0/1468260996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800d3220 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.668+0000 7f8686a9b640 1 -- 172.21.15.81:0/1468260996 >> 172.21.15.81:0/1468260996 conn(0x7f86800b7330 msgr2=0x7f86800b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:55.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.668+0000 7f8686a9b640 1 -- 172.21.15.81:0/1468260996 shutdown_connections 2024-09-21T06:46:55.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.668+0000 7f8686a9b640 1 -- 172.21.15.81:0/1468260996 wait complete. 2024-09-21T06:46:55.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.670+0000 7f8686a9b640 1 Processor -- start 2024-09-21T06:46:55.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.670+0000 7f8686a9b640 1 -- start start 2024-09-21T06:46:55.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f8686a9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86800d41a0 0x7f868006cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f8686a9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f8686a9b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f868015eda0 0x7f8680159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f8686a9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86800b36b0 con 0x7f868015c450 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f8686a9b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f86800b3530 con 0x7f86800d41a0 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f8686a9b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f86800b3830 con 0x7f868015eda0 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f867ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f867ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49304/0 (socket says 172.21.15.81:49304) 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.671+0000 7f867ffff640 1 -- 172.21.15.81:0/3039437681 learned_addr learned my addr 172.21.15.81:0/3039437681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f8684837640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86800d41a0 0x7f868006cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f8685038640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f868015eda0 0x7f8680159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867ffff640 1 -- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f868015eda0 msgr2=0x7f8680159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867ffff640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f868015eda0 0x7f8680159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867ffff640 1 -- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86800d41a0 msgr2=0x7f868006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867ffff640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86800d41a0 0x7f868006cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867ffff640 1 -- 172.21.15.81:0/3039437681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868015a3b0 con 0x7f868015c450 2024-09-21T06:46:55.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867ffff640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800b5be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f867400c6c0 tx=0x7f867400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:55.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867d7fa640 1 -- 172.21.15.81:0/3039437681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8674003b70 con 0x7f868015c450 2024-09-21T06:46:55.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867d7fa640 1 -- 172.21.15.81:0/3039437681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8674003d10 con 0x7f868015c450 2024-09-21T06:46:55.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f867d7fa640 1 -- 172.21.15.81:0/3039437681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86740052d0 con 0x7f868015c450 2024-09-21T06:46:55.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868006d580 con 0x7f868015c450 2024-09-21T06:46:55.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.672+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868006db40 con 0x7f868015c450 2024-09-21T06:46:55.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.673+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868008d110 con 0x7f868015c450 2024-09-21T06:46:55.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.674+0000 7f867d7fa640 1 -- 172.21.15.81:0/3039437681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8674005470 con 0x7f868015c450 2024-09-21T06:46:55.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.675+0000 7f867d7fa640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f866c078b90 0x7f866c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:55.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.675+0000 7f867d7fa640 1 -- 172.21.15.81:0/3039437681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f867409ab60 con 0x7f868015c450 2024-09-21T06:46:55.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.675+0000 7f8684837640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f866c078b90 0x7f866c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:55.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.675+0000 7f8684837640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f866c078b90 0x7f866c07b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8670034000 tx=0x7f8670004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:55.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.679+0000 7f867d7fa640 1 -- 172.21.15.81:0/3039437681 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f868008d110 con 0x7f868015c450 2024-09-21T06:46:55.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.893+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f868006d310 con 0x7f868015c450 2024-09-21T06:46:55.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.894+0000 7f867d7fa640 1 -- 172.21.15.81:0/3039437681 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5220 (secure 0 0 0) 0x7f86740627c0 con 0x7f868015c450 2024-09-21T06:46:55.896 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:55.896 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T06:46:41:839050+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2835319060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2835319060},{"type":"v1","addr":"172.21.15.89:6836","nonce":2835319060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4230376453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4230376453},{"type":"v1","addr":"172.21.15.89:6837","nonce":4230376453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/325230929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":325230929},{"type":"v1","addr":"172.21.15.81:6834","nonce":325230929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:38.173502+0000","modified":"2024-09-21T06:46:41.202759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5430":{"gid":5430,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1408396045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1408396045},{"type":"v1","addr":"172.21.15.81:6835","nonce":1408396045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5430,"qdb_cluster":[5430]},"id":3}]} 2024-09-21T06:46:55.896 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T06:46:55.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f866c078b90 msgr2=0x7f866c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f866c078b90 0x7f866c07b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8670034000 tx=0x7f8670004730 comp rx=0 tx=0).stop 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 msgr2=0x7f86800b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800b5be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f867400c6c0 tx=0x7f867400cb80 comp rx=0 tx=0).stop 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 shutdown_connections 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f866c078b90 0x7f866c07b0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f868015eda0 0x7f8680159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868015c450 0x7f86800b5be0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 --2- 172.21.15.81:0/3039437681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86800d41a0 0x7f868006cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 >> 172.21.15.81:0/3039437681 conn(0x7f86800b7330 msgr2=0x7f86800cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 shutdown_connections 2024-09-21T06:46:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:55.896+0000 7f8686a9b640 1 -- 172.21.15.81:0/3039437681 wait complete. 2024-09-21T06:46:55.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.021+0000 7f44ccc07640 1 -- 172.21.15.81:0/2414924566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 msgr2=0x7f44b4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.021+0000 7f44ccc07640 1 --2- 172.21.15.81:0/2414924566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 0x7f44b4003ea0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f44b80016c0 tx=0x7f44b4005830 comp rx=0 tx=0).stop 2024-09-21T06:46:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.021+0000 7f44c6d9d640 1 -- 172.21.15.81:0/2414924566 reap_dead start 2024-09-21T06:46:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.021+0000 7f44ccc07640 1 -- 172.21.15.81:0/2414924566 shutdown_connections 2024-09-21T06:46:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.021+0000 7f44ccc07640 1 -- 172.21.15.81:0/2414924566 >> 172.21.15.81:0/2414924566 conn(0x7f44c80cd370 msgr2=0x7f44c80cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.021+0000 7f44ccc07640 1 -- 172.21.15.81:0/2414924566 shutdown_connections 2024-09-21T06:46:56.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.021+0000 7f44ccc07640 1 -- 172.21.15.81:0/2414924566 wait complete. 2024-09-21T06:46:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.023+0000 7f44ccc07640 1 Processor -- start 2024-09-21T06:46:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.023+0000 7f44ccc07640 1 -- start start 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44ccc07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 0x7f44c815dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44ccc07640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44c814ec80 0x7f44c81f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44ccc07640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c81500d0 0x7f44c806cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44ccc07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44c815f690 con 0x7f44b4003a30 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44ccc07640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f44c815f510 con 0x7f44c81500d0 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44ccc07640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f44c815f810 con 0x7f44c814ec80 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 0x7f44c815dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 0x7f44c815dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49322/0 (socket says 172.21.15.81:49322) 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 -- 172.21.15.81:0/1078712857 learned_addr learned my addr 172.21.15.81:0/1078712857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 -- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44c814ec80 msgr2=0x7f44c81f5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44c814ec80 0x7f44c81f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 -- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c81500d0 msgr2=0x7f44c806cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c81500d0 0x7f44c806cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 -- 172.21.15.81:0/1078712857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c815cd80 con 0x7f44b4003a30 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.024+0000 7f44c659c640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 0x7f44c815dc20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f44b802a930 tx=0x7f44b8006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.025+0000 7f44beffd640 1 -- 172.21.15.81:0/1078712857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8041070 con 0x7f44b4003a30 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.025+0000 7f44beffd640 1 -- 172.21.15.81:0/1078712857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44b8003af0 con 0x7f44b4003a30 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.025+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c815d060 con 0x7f44b4003a30 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.025+0000 7f44beffd640 1 -- 172.21.15.81:0/1078712857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8038070 con 0x7f44b4003a30 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.025+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c814f4b0 con 0x7f44b4003a30 2024-09-21T06:46:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.026+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c8152810 con 0x7f44b4003a30 2024-09-21T06:46:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.027+0000 7f44beffd640 1 -- 172.21.15.81:0/1078712857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44b8030070 con 0x7f44b4003a30 2024-09-21T06:46:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.027+0000 7f44beffd640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f44a8078bc0 0x7f44a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.027+0000 7f44beffd640 1 -- 172.21.15.81:0/1078712857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6101+0+0 (secure 0 0 0) 0x7f44b80ba7b0 con 0x7f44b4003a30 2024-09-21T06:46:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.027+0000 7f44bffff640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f44a8078bc0 0x7f44a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.028+0000 7f44bffff640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f44a8078bc0 0x7f44a807b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f44c814eb10 tx=0x7f44b0009390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.031+0000 7f44beffd640 1 -- 172.21.15.81:0/1078712857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f44b804a080 con 0x7f44b4003a30 2024-09-21T06:46:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.244+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44c806fec0 con 0x7f44b4003a30 2024-09-21T06:46:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.245+0000 7f44beffd640 1 -- 172.21.15.81:0/1078712857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5220 (secure 0 0 0) 0x7f44b8006500 con 0x7f44b4003a30 2024-09-21T06:46:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:56.248 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T06:46:41:839050+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2835319060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2835319060},{"type":"v1","addr":"172.21.15.89:6836","nonce":2835319060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4230376453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4230376453},{"type":"v1","addr":"172.21.15.89:6837","nonce":4230376453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/325230929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":325230929},{"type":"v1","addr":"172.21.15.81:6834","nonce":325230929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:38.173502+0000","modified":"2024-09-21T06:46:41.202759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5430":{"gid":5430,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1408396045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1408396045},{"type":"v1","addr":"172.21.15.81:6835","nonce":1408396045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5430,"qdb_cluster":[5430]},"id":3}]} 2024-09-21T06:46:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T06:46:56.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f44a8078bc0 msgr2=0x7f44a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f44a8078bc0 0x7f44a807b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f44c814eb10 tx=0x7f44b0009390 comp rx=0 tx=0).stop 2024-09-21T06:46:56.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 msgr2=0x7f44c815dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 0x7f44c815dc20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f44b802a930 tx=0x7f44b8006310 comp rx=0 tx=0).stop 2024-09-21T06:46:56.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 shutdown_connections 2024-09-21T06:46:56.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f44a8078bc0 0x7f44a807b0d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44c814ec80 0x7f44c81f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44c81500d0 0x7f44c806cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 --2- 172.21.15.81:0/1078712857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44b4003a30 0x7f44c815dc20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 >> 172.21.15.81:0/1078712857 conn(0x7f44c80cd370 msgr2=0x7f44c80b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 shutdown_connections 2024-09-21T06:46:56.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.248+0000 7f44ccc07640 1 -- 172.21.15.81:0/1078712857 wait complete. 2024-09-21T06:46:56.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:56.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 -- 172.21.15.81:0/2028401556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c0b20d0 msgr2=0x7f8f5c15d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 --2- 172.21.15.81:0/2028401556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c0b20d0 0x7f8f5c15d2c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8f54005fd0 tx=0x7f8f5402aa50 comp rx=0 tx=0).stop 2024-09-21T06:46:56.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 -- 172.21.15.81:0/2028401556 shutdown_connections 2024-09-21T06:46:56.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 --2- 172.21.15.81:0/2028401556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c0b20d0 0x7f8f5c15d2c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 --2- 172.21.15.81:0/2028401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c1601c0 0x7f8f5c0b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 --2- 172.21.15.81:0/2028401556 >> v2:172.21.15.89:3300/0 conn(0x7f8f5c0d19a0 0x7f8f5c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 -- 172.21.15.81:0/2028401556 >> 172.21.15.81:0/2028401556 conn(0x7f8f5c0d25e0 msgr2=0x7f8f5c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 -- 172.21.15.81:0/2028401556 shutdown_connections 2024-09-21T06:46:56.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.371+0000 7f8f60d52640 1 -- 172.21.15.81:0/2028401556 wait complete. 2024-09-21T06:46:56.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.373+0000 7f8f60d52640 1 Processor -- start 2024-09-21T06:46:56.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.373+0000 7f8f60d52640 1 -- start start 2024-09-21T06:46:56.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f60d52640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0b20d0 0x7f8f5c14ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f60d52640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0d19a0 0x7f8f5c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f60d52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c1601c0 0x7f8f5c14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f60d52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c072d40 con 0x7f8f5c1601c0 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f60d52640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c15db20 con 0x7f8f5c0b20d0 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f60d52640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c072ec0 con 0x7f8f5c0d19a0 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f5ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c1601c0 0x7f8f5c14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f5ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c1601c0 0x7f8f5c14b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49328/0 (socket says 172.21.15.81:49328) 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f5ad9d640 1 -- 172.21.15.81:0/3664108578 learned_addr learned my addr 172.21.15.81:0/3664108578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f5a59c640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0b20d0 0x7f8f5c14ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.374+0000 7f8f51d9b640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0d19a0 0x7f8f5c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f5ad9d640 1 -- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0d19a0 msgr2=0x7f8f5c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f5ad9d640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0d19a0 0x7f8f5c14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f5ad9d640 1 -- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0b20d0 msgr2=0x7f8f5c14ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f5ad9d640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0b20d0 0x7f8f5c14ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f5ad9d640 1 -- 172.21.15.81:0/3664108578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c0c7410 con 0x7f8f5c1601c0 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f5ad9d640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c1601c0 0x7f8f5c14b8d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8f5402b010 tx=0x7f8f54003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f537fe640 1 -- 172.21.15.81:0/3664108578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54033050 con 0x7f8f5c1601c0 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f537fe640 1 -- 172.21.15.81:0/3664108578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f54004350 con 0x7f8f5c1601c0 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5c14a370 con 0x7f8f5c1601c0 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f537fe640 1 -- 172.21.15.81:0/3664108578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f540047a0 con 0x7f8f5c1601c0 2024-09-21T06:46:56.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.375+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f5c14bed0 con 0x7f8f5c1601c0 2024-09-21T06:46:56.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.376+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5c0733e0 con 0x7f8f5c1601c0 2024-09-21T06:46:56.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.377+0000 7f8f537fe640 1 -- 172.21.15.81:0/3664108578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f54036070 con 0x7f8f5c1601c0 2024-09-21T06:46:56.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.377+0000 7f8f537fe640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8f3c078bc0 0x7f8f3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.377+0000 7f8f537fe640 1 -- 172.21.15.81:0/3664108578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6159+0+0 (secure 0 0 0) 0x7f8f540bbfa0 con 0x7f8f5c1601c0 2024-09-21T06:46:56.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.377+0000 7f8f5a59c640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8f3c078bc0 0x7f8f3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.378+0000 7f8f5a59c640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8f3c078bc0 0x7f8f3c07b0d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00aa10 tx=0x7f8f4c005ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.382+0000 7f8f537fe640 1 -- 172.21.15.81:0/3664108578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8f54083c70 con 0x7f8f5c1601c0 2024-09-21T06:46:56.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.558+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f5c0d2a90 con 0x7f8f5c1601c0 2024-09-21T06:46:56.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.560+0000 7f8f537fe640 1 -- 172.21.15.81:0/3664108578 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+17058 (secure 0 0 0) 0x7f8f540886a0 con 0x7f8f5c1601c0 2024-09-21T06:46:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:56.562 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:56.062654+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:35.820919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:37.143302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.30","mappings":[{"from":6,"to":1}]},{"pgid":"9.37","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8f3c078bc0 msgr2=0x7f8f3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8f3c078bc0 0x7f8f3c07b0d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00aa10 tx=0x7f8f4c005ef0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c1601c0 msgr2=0x7f8f5c14b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c1601c0 0x7f8f5c14b8d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8f5402b010 tx=0x7f8f54003f10 comp rx=0 tx=0).stop 2024-09-21T06:46:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 shutdown_connections 2024-09-21T06:46:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8f3c078bc0 0x7f8f3c07b0d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f5c0d19a0 0x7f8f5c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c1601c0 0x7f8f5c14b8d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 --2- 172.21.15.81:0/3664108578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f5c0b20d0 0x7f8f5c14ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 >> 172.21.15.81:0/3664108578 conn(0x7f8f5c0d25e0 msgr2=0x7f8f5c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 shutdown_connections 2024-09-21T06:46:56.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.562+0000 7f8f60d52640 1 -- 172.21.15.81:0/3664108578 wait complete. 2024-09-21T06:46:56.575 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:46:56.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.686+0000 7f0dddf33640 1 -- 172.21.15.81:0/47944392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc0005350 msgr2=0x7f0dc000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.686+0000 7f0dddf33640 1 --2- 172.21.15.81:0/47944392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc0005350 0x7f0dc000b9c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0001d90 tx=0x7f0dc0005830 comp rx=0 tx=0).stop 2024-09-21T06:46:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.686+0000 7f0dddf33640 1 -- 172.21.15.81:0/47944392 shutdown_connections 2024-09-21T06:46:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.686+0000 7f0dddf33640 1 --2- 172.21.15.81:0/47944392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc0005350 0x7f0dc000b9c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.686+0000 7f0dddf33640 1 -- 172.21.15.81:0/47944392 >> 172.21.15.81:0/47944392 conn(0x7f0dd80d25e0 msgr2=0x7f0dd80d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.686+0000 7f0dddf33640 1 -- 172.21.15.81:0/47944392 shutdown_connections 2024-09-21T06:46:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.686+0000 7f0dddf33640 1 -- 172.21.15.81:0/47944392 wait complete. 2024-09-21T06:46:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.688+0000 7f0dddf33640 1 Processor -- start 2024-09-21T06:46:56.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.688+0000 7f0dddf33640 1 -- start start 2024-09-21T06:46:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.689+0000 7f0dddf33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc0005350 0x7f0dd80ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.689+0000 7f0dddf33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd80c5a90 0x7f0dd814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.689+0000 7f0dddf33640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dd80c5ea0 0x7f0dd80c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.689+0000 7f0dddf33640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd815d6d0 con 0x7f0dd80c5a90 2024-09-21T06:46:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.689+0000 7f0dddf33640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd815a600 con 0x7f0dc0005350 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.689+0000 7f0dddf33640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd815d850 con 0x7f0dd80c5ea0 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd80c5a90 0x7f0dd814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd80c5a90 0x7f0dd814f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49352/0 (socket says 172.21.15.81:49352) 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 -- 172.21.15.81:0/2643494482 learned_addr learned my addr 172.21.15.81:0/2643494482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd7fff640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dd80c5ea0 0x7f0dd80c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd77fe640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc0005350 0x7f0dd80ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 -- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dd80c5ea0 msgr2=0x7f0dd80c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dd80c5ea0 0x7f0dd80c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 -- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc0005350 msgr2=0x7f0dd80ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc0005350 0x7f0dd80ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 -- 172.21.15.81:0/2643494482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd80c88a0 con 0x7f0dd80c5a90 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd7fff640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dd80c5ea0 0x7f0dd80c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd77fe640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc0005350 0x7f0dd80ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dd6ffd640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd80c5a90 0x7f0dd814f450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0066b0 tx=0x7f0dcc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dbffff640 1 -- 172.21.15.81:0/2643494482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc015070 con 0x7f0dd80c5a90 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dbffff640 1 -- 172.21.15.81:0/2643494482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dcc011920 con 0x7f0dd80c5a90 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd80c8b80 con 0x7f0dd80c5a90 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dbffff640 1 -- 172.21.15.81:0/2643494482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011d70 con 0x7f0dd80c5a90 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.690+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd80c9480 con 0x7f0dd80c5a90 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.691+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd80b1b90 con 0x7f0dd80c5a90 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.692+0000 7f0dbffff640 1 -- 172.21.15.81:0/2643494482 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0dcc018070 con 0x7f0dd80c5a90 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.692+0000 7f0dbffff640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0dc4078b90 0x7f0dc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.692+0000 7f0dbffff640 1 -- 172.21.15.81:0/2643494482 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6159+0+0 (secure 0 0 0) 0x7f0dcc09bc80 con 0x7f0dd80c5a90 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.693+0000 7f0dd77fe640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0dc4078b90 0x7f0dc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.693+0000 7f0dd77fe640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0dc4078b90 0x7f0dc407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009a20 tx=0x7f0dc8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.697+0000 7f0dbffff640 1 -- 172.21.15.81:0/2643494482 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0dcc063fd0 con 0x7f0dd80c5a90 2024-09-21T06:46:56.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.909+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dd8159c70 con 0x7f0dd80c5a90 2024-09-21T06:46:56.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.910+0000 7f0dbffff640 1 -- 172.21.15.81:0/2643494482 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5220 (secure 0 0 0) 0x7f0dcc0638d0 con 0x7f0dd80c5a90 2024-09-21T06:46:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:56.912 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T06:46:41:839050+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2835319060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2835319060},{"type":"v1","addr":"172.21.15.89:6836","nonce":2835319060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4230376453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4230376453},{"type":"v1","addr":"172.21.15.89:6837","nonce":4230376453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/325230929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":325230929},{"type":"v1","addr":"172.21.15.81:6834","nonce":325230929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:38.173502+0000","modified":"2024-09-21T06:46:41.202759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5430":{"gid":5430,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1408396045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1408396045},{"type":"v1","addr":"172.21.15.81:6835","nonce":1408396045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5430,"qdb_cluster":[5430]},"id":3}]} 2024-09-21T06:46:56.912 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T06:46:56.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0dc4078b90 msgr2=0x7f0dc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0dc4078b90 0x7f0dc407b0a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009a20 tx=0x7f0dc8005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:56.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd80c5a90 msgr2=0x7f0dd814f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd80c5a90 0x7f0dd814f450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0066b0 tx=0x7f0dcc0039c0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 shutdown_connections 2024-09-21T06:46:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f0dc4078b90 0x7f0dc407b0a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dd80c5ea0 0x7f0dd80c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd80c5a90 0x7f0dd814f450 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 --2- 172.21.15.81:0/2643494482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc0005350 0x7f0dd80ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 >> 172.21.15.81:0/2643494482 conn(0x7f0dd80d25e0 msgr2=0x7f0dd80700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 shutdown_connections 2024-09-21T06:46:56.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:56.912+0000 7f0dddf33640 1 -- 172.21.15.81:0/2643494482 wait complete. 2024-09-21T06:46:56.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:46:57.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.037+0000 7f499c40e640 1 -- 172.21.15.81:0/3462736107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4980003fd0 msgr2=0x7f4980004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.037+0000 7f499c40e640 1 --2- 172.21.15.81:0/3462736107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4980003fd0 0x7f4980004800 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4984009b50 tx=0x7f4980005830 comp rx=0 tx=0).stop 2024-09-21T06:46:57.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.037+0000 7f499a9ab640 1 -- 172.21.15.81:0/3462736107 reap_dead start 2024-09-21T06:46:57.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.037+0000 7f499c40e640 1 -- 172.21.15.81:0/3462736107 shutdown_connections 2024-09-21T06:46:57.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.037+0000 7f499c40e640 1 -- 172.21.15.81:0/3462736107 >> 172.21.15.81:0/3462736107 conn(0x7f49940cd370 msgr2=0x7f49940cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:57.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.038+0000 7f499c40e640 1 -- 172.21.15.81:0/3462736107 shutdown_connections 2024-09-21T06:46:57.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.038+0000 7f499c40e640 1 -- 172.21.15.81:0/3462736107 wait complete. 2024-09-21T06:46:57.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.039+0000 7f499c40e640 1 Processor -- start 2024-09-21T06:46:57.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.039+0000 7f499c40e640 1 -- start start 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4980003fd0 0x7f49941536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49940b5840 0x7f499415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49940b5c50 0x7f499415e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f499406fc70 con 0x7f49940b5c50 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f499406faf0 con 0x7f4980003fd0 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f499406fdf0 con 0x7f49940b5840 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49940b5c50 0x7f499415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49940b5c50 0x7f499415e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49366/0 (socket says 172.21.15.81:49366) 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 -- 172.21.15.81:0/585142306 learned_addr learned my addr 172.21.15.81:0/585142306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:57.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a1aa640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4980003fd0 0x7f49941536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f49999a9640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49940b5840 0x7f499415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 -- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49940b5840 msgr2=0x7f499415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49940b5840 0x7f499415e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 -- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4980003fd0 msgr2=0x7f49941536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4980003fd0 0x7f49941536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 -- 172.21.15.81:0/585142306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49941f6e40 con 0x7f49940b5c50 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f49999a9640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49940b5840 0x7f499415e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499a9ab640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49940b5c50 0x7f499415e700 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4994074910 tx=0x7f498c010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f498affd640 1 -- 172.21.15.81:0/585142306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c00ed90 con 0x7f49940b5c50 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f498affd640 1 -- 172.21.15.81:0/585142306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f498c015070 con 0x7f49940b5c50 2024-09-21T06:46:57.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49941f7340 con 0x7f49940b5c50 2024-09-21T06:46:57.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f498affd640 1 -- 172.21.15.81:0/585142306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c003bb0 con 0x7f49940b5c50 2024-09-21T06:46:57.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.041+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49941f7900 con 0x7f49940b5c50 2024-09-21T06:46:57.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.042+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499414f470 con 0x7f49940b5c50 2024-09-21T06:46:57.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.043+0000 7f498affd640 1 -- 172.21.15.81:0/585142306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f498c004030 con 0x7f49940b5c50 2024-09-21T06:46:57.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.044+0000 7f498affd640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4978078bc0 0x7f497807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.044+0000 7f498affd640 1 -- 172.21.15.81:0/585142306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6159+0+0 (secure 0 0 0) 0x7f498c09b520 con 0x7f49940b5c50 2024-09-21T06:46:57.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.044+0000 7f499a1aa640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4978078bc0 0x7f497807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.045+0000 7f499a1aa640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4978078bc0 0x7f497807b0d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4990001a30 tx=0x7f4990001d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:57.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.048+0000 7f498affd640 1 -- 172.21.15.81:0/585142306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f498c0637a0 con 0x7f49940b5c50 2024-09-21T06:46:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.264+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49940cd900 con 0x7f49940b5c50 2024-09-21T06:46:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.264+0000 7f498affd640 1 -- 172.21.15.81:0/585142306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5220 (secure 0 0 0) 0x7f498c0630a0 con 0x7f49940b5c50 2024-09-21T06:46:57.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:57.267 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-21T06:46:41:839050+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2835319060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2835319060},{"type":"v1","addr":"172.21.15.89:6836","nonce":2835319060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4230376453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4230376453},{"type":"v1","addr":"172.21.15.89:6837","nonce":4230376453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/325230929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":325230929},{"type":"v1","addr":"172.21.15.81:6834","nonce":325230929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T06:46:38.173502+0000","modified":"2024-09-21T06:46:41.202759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5430":{"gid":5430,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1408396045","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1408396045},{"type":"v1","addr":"172.21.15.81:6835","nonce":1408396045}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5430,"qdb_cluster":[5430]},"id":3}]} 2024-09-21T06:46:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4978078bc0 msgr2=0x7f497807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4978078bc0 0x7f497807b0d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4990001a30 tx=0x7f4990001d40 comp rx=0 tx=0).stop 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49940b5c50 msgr2=0x7f499415e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49940b5c50 0x7f499415e700 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4994074910 tx=0x7f498c010e50 comp rx=0 tx=0).stop 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 shutdown_connections 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4978078bc0 0x7f497807b0d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49940b5840 0x7f499415e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49940b5c50 0x7f499415e700 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 --2- 172.21.15.81:0/585142306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4980003fd0 0x7f49941536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.266+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 >> 172.21.15.81:0/585142306 conn(0x7f49940cd370 msgr2=0x7f499414ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.267+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 shutdown_connections 2024-09-21T06:46:57.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.267+0000 7f499c40e640 1 -- 172.21.15.81:0/585142306 wait complete. 2024-09-21T06:46:57.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:57.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.390+0000 7f9a2c6de640 1 -- 172.21.15.81:0/1132725265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 msgr2=0x7f9a240d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.390+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/1132725265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240d45b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c005fd0 tx=0x7f9a1c02a820 comp rx=0 tx=0).stop 2024-09-21T06:46:57.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.390+0000 7f9a2c6de640 1 -- 172.21.15.81:0/1132725265 shutdown_connections 2024-09-21T06:46:57.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.390+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/1132725265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240d45b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.390+0000 7f9a2c6de640 1 -- 172.21.15.81:0/1132725265 >> 172.21.15.81:0/1132725265 conn(0x7f9a240b7330 msgr2=0x7f9a240b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:57.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.390+0000 7f9a2c6de640 1 -- 172.21.15.81:0/1132725265 shutdown_connections 2024-09-21T06:46:57.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.390+0000 7f9a2c6de640 1 -- 172.21.15.81:0/1132725265 wait complete. 2024-09-21T06:46:57.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.392+0000 7f9a2c6de640 1 Processor -- start 2024-09-21T06:46:57.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.392+0000 7f9a2c6de640 1 -- start start 2024-09-21T06:46:57.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2c6de640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a240d3220 0x7f9a240c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2c6de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2c6de640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a2415c450 0x7f9a240b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2c6de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240b3670 con 0x7f9a240d41a0 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2c6de640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240b34f0 con 0x7f9a2415c450 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2c6de640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9a240b37f0 con 0x7f9a240d3220 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a29c79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a29c79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49392/0 (socket says 172.21.15.81:49392) 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a29c79640 1 -- 172.21.15.81:0/2663534464 learned_addr learned my addr 172.21.15.81:0/2663534464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2ac7b640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a2415c450 0x7f9a240b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.393+0000 7f9a2a47a640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a240d3220 0x7f9a240c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a29c79640 1 -- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a240d3220 msgr2=0x7f9a240c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a29c79640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a240d3220 0x7f9a240c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a29c79640 1 -- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a2415c450 msgr2=0x7f9a240b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a29c79640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a2415c450 0x7f9a240b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a29c79640 1 -- 172.21.15.81:0/2663534464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2406fd80 con 0x7f9a240d41a0 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a29c79640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240b5170 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b3c0 tx=0x7f9a1400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a1affd640 1 -- 172.21.15.81:0/2663534464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14015020 con 0x7f9a240d41a0 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a1affd640 1 -- 172.21.15.81:0/2663534464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a14011920 con 0x7f9a240d41a0 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a240caf20 con 0x7f9a240d41a0 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a1affd640 1 -- 172.21.15.81:0/2663534464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011db0 con 0x7f9a240d41a0 2024-09-21T06:46:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.394+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a240ca680 con 0x7f9a240d41a0 2024-09-21T06:46:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.395+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a2408d110 con 0x7f9a240d41a0 2024-09-21T06:46:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.396+0000 7f9a1affd640 1 -- 172.21.15.81:0/2663534464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a14018020 con 0x7f9a240d41a0 2024-09-21T06:46:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.396+0000 7f9a1affd640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9a08078b90 0x7f9a0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.397+0000 7f9a1affd640 1 -- 172.21.15.81:0/2663534464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6159+0+0 (secure 0 0 0) 0x7f9a1409a730 con 0x7f9a240d41a0 2024-09-21T06:46:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.397+0000 7f9a2a47a640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9a08078b90 0x7f9a0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.397+0000 7f9a2a47a640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9a08078b90 0x7f9a0807b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a20007fd0 tx=0x7f9a20001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:57.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.401+0000 7f9a1affd640 1 -- 172.21.15.81:0/2663534464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9a2408d110 con 0x7f9a240d41a0 2024-09-21T06:46:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.578+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a240d45b0 con 0x7f9a240d41a0 2024-09-21T06:46:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.579+0000 7f9a1affd640 1 -- 172.21.15.81:0/2663534464 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+17058 (secure 0 0 0) 0x7f9a1401f070 con 0x7f9a240d41a0 2024-09-21T06:46:57.582 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:46:57.582 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:46:57.068300+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:46:35.820919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T06:46:37.143302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.30","mappings":[{"from":6,"to":1}]},{"pgid":"9.37","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9a08078b90 msgr2=0x7f9a0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9a08078b90 0x7f9a0807b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a20007fd0 tx=0x7f9a20001370 comp rx=0 tx=0).stop 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 msgr2=0x7f9a240b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240b5170 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b3c0 tx=0x7f9a1400b880 comp rx=0 tx=0).stop 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 shutdown_connections 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9a08078b90 0x7f9a0807b0a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a2415c450 0x7f9a240b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d41a0 0x7f9a240b5170 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 --2- 172.21.15.81:0/2663534464 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a240d3220 0x7f9a240c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.581+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 >> 172.21.15.81:0/2663534464 conn(0x7f9a240b7330 msgr2=0x7f9a240cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.582+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 shutdown_connections 2024-09-21T06:46:57.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.582+0000 7f9a2c6de640 1 -- 172.21.15.81:0/2663534464 wait complete. 2024-09-21T06:46:57.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 -- 172.21.15.81:0/2474091755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 msgr2=0x7f4d3c0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 --2- 172.21.15.81:0/2474091755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c0d3220 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009830 tx=0x7f4d3802a510 comp rx=0 tx=0).stop 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 -- 172.21.15.81:0/2474091755 shutdown_connections 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 --2- 172.21.15.81:0/2474091755 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3c0d41a0 0x7f4d3c0d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 --2- 172.21.15.81:0/2474091755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c0d3220 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 -- 172.21.15.81:0/2474091755 >> 172.21.15.81:0/2474091755 conn(0x7f4d3c0b7330 msgr2=0x7f4d3c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 -- 172.21.15.81:0/2474091755 shutdown_connections 2024-09-21T06:46:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.706+0000 7f4d43d58640 1 -- 172.21.15.81:0/2474091755 wait complete. 2024-09-21T06:46:57.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.708+0000 7f4d43d58640 1 Processor -- start 2024-09-21T06:46:57.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.708+0000 7f4d43d58640 1 -- start start 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.709+0000 7f4d43d58640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3c0d41a0 0x7f4d3c1f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.709+0000 7f4d43d58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c1f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.709+0000 7f4d43d58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d3c15eda0 0x7f4d3c1f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.709+0000 7f4d43d58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c0b35c0 con 0x7f4d3c15c450 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.709+0000 7f4d43d58640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c0b3440 con 0x7f4d3c15eda0 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.709+0000 7f4d43d58640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f4d3c0b3740 con 0x7f4d3c0d41a0 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c1f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c1f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49398/0 (socket says 172.21.15.81:49398) 2024-09-21T06:46:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 -- 172.21.15.81:0/736093779 learned_addr learned my addr 172.21.15.81:0/736093779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d41af4640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3c0d41a0 0x7f4d3c1f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d422f5640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d3c15eda0 0x7f4d3c1f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 -- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3c0d41a0 msgr2=0x7f4d3c1f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3c0d41a0 0x7f4d3c1f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 -- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d3c15eda0 msgr2=0x7f4d3c1f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d3c15eda0 0x7f4d3c1f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 -- 172.21.15.81:0/736093779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c153410 con 0x7f4d3c15c450 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d412f3640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c1f8dd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c370 tx=0x7f4d2c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d327fc640 1 -- 172.21.15.81:0/736093779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011790 con 0x7f4d3c15c450 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d327fc640 1 -- 172.21.15.81:0/736093779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d2c017070 con 0x7f4d3c15c450 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3c06f080 con 0x7f4d3c15c450 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d327fc640 1 -- 172.21.15.81:0/736093779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c011c80 con 0x7f4d3c15c450 2024-09-21T06:46:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.710+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3c06f640 con 0x7f4d3c15c450 2024-09-21T06:46:57.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.711+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3c08d110 con 0x7f4d3c15c450 2024-09-21T06:46:57.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.712+0000 7f4d327fc640 1 -- 172.21.15.81:0/736093779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d2c01c460 con 0x7f4d3c15c450 2024-09-21T06:46:57.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.713+0000 7f4d327fc640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4d20078b90 0x7f4d2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:57.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.713+0000 7f4d327fc640 1 -- 172.21.15.81:0/736093779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6159+0+0 (secure 0 0 0) 0x7f4d2c09aae0 con 0x7f4d3c15c450 2024-09-21T06:46:57.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.713+0000 7f4d41af4640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4d20078b90 0x7f4d2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:57.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.713+0000 7f4d41af4640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4d20078b90 0x7f4d2007b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d38034000 tx=0x7f4d38004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:57.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.717+0000 7f4d327fc640 1 -- 172.21.15.81:0/736093779 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4d3c08d110 con 0x7f4d3c15c450 2024-09-21T06:46:57.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.930+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4d3c0d45b0 con 0x7f4d3c15c450 2024-09-21T06:46:57.932 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-21T06:46:57.930+0000 7ffaf0bb2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:46:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.932+0000 7f4d327fc640 1 -- 172.21.15.81:0/736093779 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f4d2c0627a0 con 0x7f4d3c15c450 2024-09-21T06:46:57.934 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.934+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4d20078b90 msgr2=0x7f4d2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.934+0000 7f4d43d58640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4d20078b90 0x7f4d2007b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d38034000 tx=0x7f4d38004730 comp rx=0 tx=0).stop 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.934+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 msgr2=0x7f4d3c1f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.934+0000 7f4d43d58640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c1f8dd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c370 tx=0x7f4d2c00c830 comp rx=0 tx=0).stop 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 shutdown_connections 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4d20078b90 0x7f4d2007b0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d3c15eda0 0x7f4d3c1f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d3c15c450 0x7f4d3c1f8dd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 --2- 172.21.15.81:0/736093779 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d3c0d41a0 0x7f4d3c1f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 >> 172.21.15.81:0/736093779 conn(0x7f4d3c0b7330 msgr2=0x7f4d3c0d2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:57.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 shutdown_connections 2024-09-21T06:46:57.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:57.935+0000 7f4d43d58640 1 -- 172.21.15.81:0/736093779 wait complete. 2024-09-21T06:46:57.939 INFO:tasks.ceph.mds.c.smithi081.stderr: -3899> 2024-09-21T06:46:44.796+0000 7efe7a36c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:46:57.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:46:57.992 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-21T06:46:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 -- 172.21.15.81:0/3644423524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac15c450 msgr2=0x7f89ac0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 --2- 172.21.15.81:0/3644423524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac15c450 0x7f89ac0d3220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0b91a0 tx=0x7f899c02a560 comp rx=0 tx=0).stop 2024-09-21T06:46:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 -- 172.21.15.81:0/3644423524 shutdown_connections 2024-09-21T06:46:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 --2- 172.21.15.81:0/3644423524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89ac0b9c00 0x7f89ac0d41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 --2- 172.21.15.81:0/3644423524 >> v2:172.21.15.89:3300/0 conn(0x7f89ac15eda0 0x7f89ac0b96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 --2- 172.21.15.81:0/3644423524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac15c450 0x7f89ac0d3220 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 -- 172.21.15.81:0/3644423524 >> 172.21.15.81:0/3644423524 conn(0x7f89ac0b7330 msgr2=0x7f89ac0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 -- 172.21.15.81:0/3644423524 shutdown_connections 2024-09-21T06:46:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.062+0000 7f89b1939640 1 -- 172.21.15.81:0/3644423524 wait complete. 2024-09-21T06:46:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.064+0000 7f89b1939640 1 Processor -- start 2024-09-21T06:46:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.064+0000 7f89b1939640 1 -- start start 2024-09-21T06:46:58.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89b1939640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac0b9c00 0x7f89ac0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89b1939640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89ac15c450 0x7f89ac06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89b1939640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89ac15eda0 0x7f89ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89b1939640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b3230 con 0x7f89ac0b9c00 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89b1939640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0d4ae0 con 0x7f89ac15c450 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89b1939640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac0b33b0 con 0x7f89ac15eda0 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac0b9c00 0x7f89ac0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac0b9c00 0x7f89ac0caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49438/0 (socket says 172.21.15.81:49438) 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 -- 172.21.15.81:0/3608444175 learned_addr learned my addr 172.21.15.81:0/3608444175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aa7fc640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89ac15c450 0x7f89ac06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89ab7fe640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89ac15eda0 0x7f89ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 -- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89ac15eda0 msgr2=0x7f89ac06e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89ac15eda0 0x7f89ac06e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 -- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89ac15c450 msgr2=0x7f89ac06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89ac15c450 0x7f89ac06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 -- 172.21.15.81:0/3608444175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac159a70 con 0x7f89ac0b9c00 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89ab7fe640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89ac15eda0 0x7f89ac06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89aaffd640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac0b9c00 0x7f89ac0caae0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f899c034040 tx=0x7f899c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f8993fff640 1 -- 172.21.15.81:0/3608444175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c03e030 con 0x7f89ac0b9c00 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f8993fff640 1 -- 172.21.15.81:0/3608444175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f899c003db0 con 0x7f89ac0b9c00 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac0b6620 con 0x7f89ac0b9c00 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.066+0000 7f8993fff640 1 -- 172.21.15.81:0/3608444175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c035040 con 0x7f89ac0b9c00 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.067+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac0b4250 con 0x7f89ac0b9c00 2024-09-21T06:46:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.067+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac08d110 con 0x7f89ac0b9c00 2024-09-21T06:46:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.068+0000 7f8993fff640 1 -- 172.21.15.81:0/3608444175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f899c041030 con 0x7f89ac0b9c00 2024-09-21T06:46:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.069+0000 7f8993fff640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8998078b90 0x7f899807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.069+0000 7f8993fff640 1 -- 172.21.15.81:0/3608444175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6245+0+0 (secure 0 0 0) 0x7f899c0bb9b0 con 0x7f89ac0b9c00 2024-09-21T06:46:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.069+0000 7f89aa7fc640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8998078b90 0x7f899807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.069+0000 7f89aa7fc640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8998078b90 0x7f899807b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f89ac15a070 tx=0x7f89a0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:58.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.073+0000 7f8993fff640 1 -- 172.21.15.81:0/3608444175 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f89ac08d110 con 0x7f89ac0b9c00 2024-09-21T06:46:58.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.289+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f89ac069140 con 0x7f89ac0b9c00 2024-09-21T06:46:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.933+0000 7f8993fff640 1 -- 172.21.15.81:0/3608444175 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f899c083cf0 con 0x7f89ac0b9c00 2024-09-21T06:46:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8998078b90 msgr2=0x7f899807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8998078b90 0x7f899807b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f89ac15a070 tx=0x7f89a0005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac0b9c00 msgr2=0x7f89ac0caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac0b9c00 0x7f89ac0caae0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f899c034040 tx=0x7f899c0038a0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 shutdown_connections 2024-09-21T06:46:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8998078b90 0x7f899807b0a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89ac15eda0 0x7f89ac06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89ac15c450 0x7f89ac06dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 --2- 172.21.15.81:0/3608444175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89ac0b9c00 0x7f89ac0caae0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 >> 172.21.15.81:0/3608444175 conn(0x7f89ac0b7330 msgr2=0x7f89ac0d2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 shutdown_connections 2024-09-21T06:46:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:58.936+0000 7f89b1939640 1 -- 172.21.15.81:0/3608444175 wait complete. 2024-09-21T06:46:58.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 -- 172.21.15.81:0/1144508266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 msgr2=0x7f42280b99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 --2- 172.21.15.81:0/1144508266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f42280b99a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4224005fd0 tx=0x7f422402a520 comp rx=0 tx=0).stop 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 -- 172.21.15.81:0/1144508266 shutdown_connections 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 --2- 172.21.15.81:0/1144508266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280cf130 0x7f42280cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 --2- 172.21.15.81:0/1144508266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f42280b99a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 -- 172.21.15.81:0/1144508266 >> 172.21.15.81:0/1144508266 conn(0x7f42280b7330 msgr2=0x7f42280b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 -- 172.21.15.81:0/1144508266 shutdown_connections 2024-09-21T06:46:59.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.109+0000 7f42305e4640 1 -- 172.21.15.81:0/1144508266 wait complete. 2024-09-21T06:46:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.111+0000 7f42305e4640 1 Processor -- start 2024-09-21T06:46:59.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.111+0000 7f42305e4640 1 -- start start 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.112+0000 7f42305e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280cf130 0x7f422809e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.112+0000 7f42305e4640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280d4370 0x7f422806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.112+0000 7f42305e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f422806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.112+0000 7f42305e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f42280cfe10 con 0x7f422815e800 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.112+0000 7f42305e4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f42280cfc90 con 0x7f42280cf130 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.112+0000 7f42305e4640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f42280cff90 con 0x7f42280d4370 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f422806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f422806f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60668/0 (socket says 172.21.15.81:60668) 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 -- 172.21.15.81:0/1233940130 learned_addr learned my addr 172.21.15.81:0/1233940130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422e380640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280cf130 0x7f422809e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422db7f640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280d4370 0x7f422806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 -- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280d4370 msgr2=0x7f422806ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280d4370 0x7f422806ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 -- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280cf130 msgr2=0x7f422809e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280cf130 0x7f422809e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 -- 172.21.15.81:0/1233940130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42281f5990 con 0x7f422815e800 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f422eb81640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f422806f4a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f422000b9e0 tx=0x7f422000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f421effd640 1 -- 172.21.15.81:0/1233940130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220019070 con 0x7f422815e800 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f421effd640 1 -- 172.21.15.81:0/1233940130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f422000cc10 con 0x7f422815e800 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f421effd640 1 -- 172.21.15.81:0/1233940130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42200146a0 con 0x7f422815e800 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42281f5c70 con 0x7f422815e800 2024-09-21T06:46:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.113+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42281f6230 con 0x7f422815e800 2024-09-21T06:46:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.114+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42280cf540 con 0x7f422815e800 2024-09-21T06:46:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.115+0000 7f421effd640 1 -- 172.21.15.81:0/1233940130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f422001c070 con 0x7f422815e800 2024-09-21T06:46:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.115+0000 7f421effd640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f420c078b90 0x7f420c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.115+0000 7f421effd640 1 -- 172.21.15.81:0/1233940130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6245+0+0 (secure 0 0 0) 0x7f422009ac50 con 0x7f422815e800 2024-09-21T06:46:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.116+0000 7f422e380640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f420c078b90 0x7f420c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.116+0000 7f422e380640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f420c078b90 0x7f420c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4224033000 tx=0x7f4224004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:59.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.120+0000 7f421effd640 1 -- 172.21.15.81:0/1233940130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f42200a0020 con 0x7f422815e800 2024-09-21T06:46:59.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:46:59.299+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42280a1ea0 con 0x7f422815e800 2024-09-21T06:47:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.092+0000 7f421effd640 1 -- 172.21.15.81:0/1233940130 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) ==== 181+0+0 (secure 0 0 0) 0x7f4220062820 con 0x7f422815e800 2024-09-21T06:47:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:47:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f420c078b90 msgr2=0x7f420c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f420c078b90 0x7f420c07b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4224033000 tx=0x7f4224004730 comp rx=0 tx=0).stop 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 msgr2=0x7f422806f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f422806f4a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f422000b9e0 tx=0x7f422000bea0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 shutdown_connections 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f420c078b90 0x7f420c07b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42280d4370 0x7f422806ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f422815e800 0x7f422806f4a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 --2- 172.21.15.81:0/1233940130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42280cf130 0x7f422809e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 >> 172.21.15.81:0/1233940130 conn(0x7f42280b7330 msgr2=0x7f42280b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.096+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 shutdown_connections 2024-09-21T06:47:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.097+0000 7f42305e4640 1 -- 172.21.15.81:0/1233940130 wait complete. 2024-09-21T06:47:00.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:47:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 -- 172.21.15.81:0/728219225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0b1ae0 msgr2=0x7f20bc0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 --2- 172.21.15.81:0/728219225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0b1ae0 0x7f20bc0b1ef0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0749f0 tx=0x7f20b402aac0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 -- 172.21.15.81:0/728219225 shutdown_connections 2024-09-21T06:47:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 --2- 172.21.15.81:0/728219225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0b1ae0 0x7f20bc0b1ef0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 --2- 172.21.15.81:0/728219225 >> v2:172.21.15.89:3300/0 conn(0x7f20bc0d18c0 0x7f20bc1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 -- 172.21.15.81:0/728219225 >> 172.21.15.81:0/728219225 conn(0x7f20bc0cec30 msgr2=0x7f20bc0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 -- 172.21.15.81:0/728219225 shutdown_connections 2024-09-21T06:47:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.233+0000 7f20c0eec640 1 -- 172.21.15.81:0/728219225 wait complete. 2024-09-21T06:47:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.235+0000 7f20c0eec640 1 Processor -- start 2024-09-21T06:47:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.235+0000 7f20c0eec640 1 -- start start 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20c0eec640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20bc0b1ae0 0x7f20bc1f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20c0eec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0cc800 0x7f20bc13d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20c0eec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20bc0d18c0 0x7f20bc150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20c0eec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc0b2a00 con 0x7f20bc0cc800 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20c0eec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f20bc0b2880 con 0x7f20bc0d18c0 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20c0eec640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f20bc0b2b80 con 0x7f20bc0b1ae0 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20b9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0cc800 0x7f20bc13d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20b9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0cc800 0x7f20bc13d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60680/0 (socket says 172.21.15.81:60680) 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20b9d9b640 1 -- 172.21.15.81:0/3342059843 learned_addr learned my addr 172.21.15.81:0/3342059843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20bad9d640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20bc0d18c0 0x7f20bc150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.236+0000 7f20ba59c640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20bc0b1ae0 0x7f20bc1f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20b9d9b640 1 -- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20bc0b1ae0 msgr2=0x7f20bc1f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20b9d9b640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20bc0b1ae0 0x7f20bc1f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20b9d9b640 1 -- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20bc0d18c0 msgr2=0x7f20bc150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20b9d9b640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20bc0d18c0 0x7f20bc150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20b9d9b640 1 -- 172.21.15.81:0/3342059843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20bc0b60d0 con 0x7f20bc0cc800 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20ba59c640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20bc0b1ae0 0x7f20bc1f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20b9d9b640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0cc800 0x7f20bc13d140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f20b000c3a0 tx=0x7f20b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20aaffd640 1 -- 172.21.15.81:0/3342059843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0017070 con 0x7f20bc0cc800 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20aaffd640 1 -- 172.21.15.81:0/3342059843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20b00053c0 con 0x7f20bc0cc800 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20bc0b63b0 con 0x7f20bc0cc800 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20aaffd640 1 -- 172.21.15.81:0/3342059843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0003850 con 0x7f20bc0cc800 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.237+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20bc0b6970 con 0x7f20bc0cc800 2024-09-21T06:47:00.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.238+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20bc0b1ef0 con 0x7f20bc0cc800 2024-09-21T06:47:00.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.239+0000 7f20aaffd640 1 -- 172.21.15.81:0/3342059843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20b001a070 con 0x7f20bc0cc800 2024-09-21T06:47:00.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.239+0000 7f20aaffd640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f209c078bc0 0x7f209c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:00.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.239+0000 7f20aaffd640 1 -- 172.21.15.81:0/3342059843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5807+0+0 (secure 0 0 0) 0x7f20b009a090 con 0x7f20bc0cc800 2024-09-21T06:47:00.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.239+0000 7f20ba59c640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f209c078bc0 0x7f209c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:00.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.240+0000 7f20ba59c640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f209c078bc0 0x7f209c07b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20ac005fd0 tx=0x7f20ac00f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:00.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.244+0000 7f20aaffd640 1 -- 172.21.15.81:0/3342059843 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f20b0061e20 con 0x7f20bc0cc800 2024-09-21T06:47:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:00.420+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20bc150cc0 con 0x7f20bc0cc800 2024-09-21T06:47:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.100+0000 7f20aaffd640 1 -- 172.21.15.81:0/3342059843 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) ==== 169+0+0 (secure 0 0 0) 0x7f20b0066850 con 0x7f20bc0cc800 2024-09-21T06:47:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-21T06:47:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.103+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f209c078bc0 msgr2=0x7f209c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.103+0000 7f20c0eec640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f209c078bc0 0x7f209c07b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f20ac005fd0 tx=0x7f20ac00f360 comp rx=0 tx=0).stop 2024-09-21T06:47:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0cc800 msgr2=0x7f20bc13d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0cc800 0x7f20bc13d140 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f20b000c3a0 tx=0x7f20b000c860 comp rx=0 tx=0).stop 2024-09-21T06:47:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 shutdown_connections 2024-09-21T06:47:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f209c078bc0 0x7f209c07b0d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20bc0d18c0 0x7f20bc150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20bc0cc800 0x7f20bc13d140 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 --2- 172.21.15.81:0/3342059843 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20bc0b1ae0 0x7f20bc1f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.104+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 >> 172.21.15.81:0/3342059843 conn(0x7f20bc0cec30 msgr2=0x7f20bc070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.105+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 shutdown_connections 2024-09-21T06:47:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.105+0000 7f20c0eec640 1 -- 172.21.15.81:0/3342059843 wait complete. 2024-09-21T06:47:01.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T06:47:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 -- 172.21.15.81:0/4240196876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 msgr2=0x7f13fc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 --2- 172.21.15.81:0/4240196876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 0x7f13fc06f1c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009830 tx=0x7f13ec02a480 comp rx=0 tx=0).stop 2024-09-21T06:47:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 -- 172.21.15.81:0/4240196876 shutdown_connections 2024-09-21T06:47:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 --2- 172.21.15.81:0/4240196876 >> v2:172.21.15.89:3300/0 conn(0x7f13fc163300 0x7f13fc165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 --2- 172.21.15.81:0/4240196876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 0x7f13fc06f1c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 -- 172.21.15.81:0/4240196876 >> 172.21.15.81:0/4240196876 conn(0x7f13fc0740a0 msgr2=0x7f13fc0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 -- 172.21.15.81:0/4240196876 shutdown_connections 2024-09-21T06:47:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.240+0000 7f1404162640 1 -- 172.21.15.81:0/4240196876 wait complete. 2024-09-21T06:47:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.242+0000 7f1404162640 1 Processor -- start 2024-09-21T06:47:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.242+0000 7f1404162640 1 -- start start 2024-09-21T06:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f1404162640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13fc06e6a0 0x7f13fc0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f1404162640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 0x7f13fc14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f1404162640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc163300 0x7f13fc0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f1404162640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc06f880 con 0x7f13fc163300 2024-09-21T06:47:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f1404162640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc06f700 con 0x7f13fc06e6a0 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f1404162640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc165c60 con 0x7f13fc0afac0 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc163300 0x7f13fc0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc163300 0x7f13fc0b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60692/0 (socket says 172.21.15.81:60692) 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 -- 172.21.15.81:0/1273649984 learned_addr learned my addr 172.21.15.81:0/1273649984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f1401efe640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13fc06e6a0 0x7f13fc0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14016fd640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 0x7f13fc14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 -- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 msgr2=0x7f13fc14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 0x7f13fc14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 -- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13fc06e6a0 msgr2=0x7f13fc0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13fc06e6a0 0x7f13fc0b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 -- 172.21.15.81:0/1273649984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc15ed00 con 0x7f13fc163300 2024-09-21T06:47:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.243+0000 7f14026ff640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc163300 0x7f13fc0b0900 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f13f400ec20 tx=0x7f13f400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.244+0000 7f13f27fc640 1 -- 172.21.15.81:0/1273649984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4003b70 con 0x7f13fc163300 2024-09-21T06:47:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.244+0000 7f13f27fc640 1 -- 172.21.15.81:0/1273649984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13f4003d10 con 0x7f13fc163300 2024-09-21T06:47:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.244+0000 7f13f27fc640 1 -- 172.21.15.81:0/1273649984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4004280 con 0x7f13fc163300 2024-09-21T06:47:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.244+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc149130 con 0x7f13fc163300 2024-09-21T06:47:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.244+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc15ea20 con 0x7f13fc163300 2024-09-21T06:47:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.245+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc166180 con 0x7f13fc163300 2024-09-21T06:47:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.245+0000 7f13f27fc640 1 -- 172.21.15.81:0/1273649984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13f4004420 con 0x7f13fc163300 2024-09-21T06:47:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.246+0000 7f13f27fc640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f13e0078b90 0x7f13e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.246+0000 7f13f27fc640 1 -- 172.21.15.81:0/1273649984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f13f409b7c0 con 0x7f13fc163300 2024-09-21T06:47:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.246+0000 7f1401efe640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f13e0078b90 0x7f13e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.247+0000 7f1401efe640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f13e0078b90 0x7f13e007b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f13f8007fd0 tx=0x7f13f8001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.250+0000 7f13f27fc640 1 -- 172.21.15.81:0/1273649984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f13f40636a0 con 0x7f13fc163300 2024-09-21T06:47:01.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.427+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f13fc149e00 con 0x7f13fc163300 2024-09-21T06:47:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.430+0000 7f13f27fc640 1 -- 172.21.15.81:0/1273649984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f13f40680d0 con 0x7f13fc163300 2024-09-21T06:47:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f13e0078b90 msgr2=0x7f13e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f13e0078b90 0x7f13e007b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f13f8007fd0 tx=0x7f13f8001370 comp rx=0 tx=0).stop 2024-09-21T06:47:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc163300 msgr2=0x7f13fc0b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc163300 0x7f13fc0b0900 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f13f400ec20 tx=0x7f13f400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 shutdown_connections 2024-09-21T06:47:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f13e0078b90 0x7f13e007b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13fc0afac0 0x7f13fc14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc163300 0x7f13fc0b0900 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 --2- 172.21.15.81:0/1273649984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f13fc06e6a0 0x7f13fc0b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 >> 172.21.15.81:0/1273649984 conn(0x7f13fc0740a0 msgr2=0x7f13fc14a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 shutdown_connections 2024-09-21T06:47:01.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.433+0000 7f1404162640 1 -- 172.21.15.81:0/1273649984 wait complete. 2024-09-21T06:47:01.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2024-09-21T06:47:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 -- 172.21.15.81:0/36879416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740ce3a0 msgr2=0x7fa97415e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 --2- 172.21.15.81:0/36879416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740ce3a0 0x7fa97415e780 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa9740d3340 tx=0x7fa96402a4e0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 -- 172.21.15.81:0/36879416 shutdown_connections 2024-09-21T06:47:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 --2- 172.21.15.81:0/36879416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740cefc0 0x7fa9740cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 --2- 172.21.15.81:0/36879416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740ce3a0 0x7fa97415e780 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 --2- 172.21.15.81:0/36879416 >> v2:172.21.15.89:3300/0 conn(0x7fa9740cda10 0x7fa97406fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 -- 172.21.15.81:0/36879416 >> 172.21.15.81:0/36879416 conn(0x7fa9740b4220 msgr2=0x7fa9740b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 -- 172.21.15.81:0/36879416 shutdown_connections 2024-09-21T06:47:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.559+0000 7fa97bf19640 1 -- 172.21.15.81:0/36879416 wait complete. 2024-09-21T06:47:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.561+0000 7fa97bf19640 1 Processor -- start 2024-09-21T06:47:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.561+0000 7fa97bf19640 1 -- start start 2024-09-21T06:47:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.562+0000 7fa97bf19640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740ce3a0 0x7fa9741518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.562+0000 7fa97bf19640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740cefc0 0x7fa9740aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.562+0000 7fa97bf19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740af120 0x7fa9740af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.562+0000 7fa97bf19640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa974162790 con 0x7fa9740af120 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.562+0000 7fa97bf19640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa974162610 con 0x7fa9740cefc0 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.562+0000 7fa97bf19640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa974162910 con 0x7fa9740ce3a0 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740af120 0x7fa9740af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740af120 0x7fa9740af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60708/0 (socket says 172.21.15.81:60708) 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 -- 172.21.15.81:0/259744223 learned_addr learned my addr 172.21.15.81:0/259744223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa979cb5640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740ce3a0 0x7fa9741518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa9794b4640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740cefc0 0x7fa9740aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 -- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740ce3a0 msgr2=0x7fa9741518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740ce3a0 0x7fa9741518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 -- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740cefc0 msgr2=0x7fa9740aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740cefc0 0x7fa9740aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 -- 172.21.15.81:0/259744223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9740afa70 con 0x7fa9740af120 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97a4b6640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740af120 0x7fa9740af530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00e9c0 tx=0x7fa96c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa96a7fc640 1 -- 172.21.15.81:0/259744223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c004d20 con 0x7fa9740af120 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa96a7fc640 1 -- 172.21.15.81:0/259744223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa96c00cb20 con 0x7fa9740af120 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa974161bf0 con 0x7fa9740af120 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa96a7fc640 1 -- 172.21.15.81:0/259744223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c005020 con 0x7fa9740af120 2024-09-21T06:47:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.563+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9740ae3e0 con 0x7fa9740af120 2024-09-21T06:47:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.564+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9740cda10 con 0x7fa9740af120 2024-09-21T06:47:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.565+0000 7fa96a7fc640 1 -- 172.21.15.81:0/259744223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa96c0051c0 con 0x7fa9740af120 2024-09-21T06:47:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.566+0000 7fa96a7fc640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa958078b90 0x7fa95807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.566+0000 7fa96a7fc640 1 -- 172.21.15.81:0/259744223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7fa96c09b440 con 0x7fa9740af120 2024-09-21T06:47:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.566+0000 7fa979cb5640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa958078b90 0x7fa95807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.566+0000 7fa979cb5640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa958078b90 0x7fa95807b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa970005fd0 tx=0x7fa97000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.570+0000 7fa96a7fc640 1 -- 172.21.15.81:0/259744223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa96c016030 con 0x7fa9740af120 2024-09-21T06:47:01.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:01.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:01.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:01.829+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) -- 0x7fa9740cea30 con 0x7fa9740af120 2024-09-21T06:47:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.101+0000 7fa96a7fc640 1 -- 172.21.15.81:0/259744223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v124) ==== 134+0+0 (secure 0 0 0) 0x7fa96c0633a0 con 0x7fa9740af120 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa958078b90 msgr2=0x7fa95807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa958078b90 0x7fa95807b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa970005fd0 tx=0x7fa97000b260 comp rx=0 tx=0).stop 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740af120 msgr2=0x7fa9740af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740af120 0x7fa9740af530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00e9c0 tx=0x7fa96c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 shutdown_connections 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa958078b90 0x7fa95807b0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9740af120 0x7fa9740af530 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9740cefc0 0x7fa9740aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 --2- 172.21.15.81:0/259744223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9740ce3a0 0x7fa9741518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 >> 172.21.15.81:0/259744223 conn(0x7fa9740b4220 msgr2=0x7fa97415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 shutdown_connections 2024-09-21T06:47:02.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:02.103+0000 7fa97bf19640 1 -- 172.21.15.81:0/259744223 wait complete. 2024-09-21T06:47:02.117 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ok 2024-09-21T06:47:02.117 INFO:tasks.cephfs_test_runner: 2024-09-21T06:47:02.117 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-21T06:47:02.117 INFO:tasks.cephfs_test_runner:Ran 2 tests in 76.805s 2024-09-21T06:47:02.118 INFO:tasks.cephfs_test_runner: 2024-09-21T06:47:02.118 INFO:tasks.cephfs_test_runner:OK 2024-09-21T06:47:02.118 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-21T06:47:02.126 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:47:02.168 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:47:02.168 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:47:02.168 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:47:02.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=10698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:47:02.184 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-21T06:47:02.185 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:47:02.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=10698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T06:47:02.241 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:47:02.241 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:47:02.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:47:02.261 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-21T06:47:02.261 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:47:02.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20970 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T06:47:02.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.320 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:47:02.336 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T06:47:02.336 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:47:02.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T06:47:02.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:47:02.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-21T06:47:02.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.555 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-21T06:47:02.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-21T06:47:02.638 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-21T06:47:02.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:47:02.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.640 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-21T06:47:02.659 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T06:47:02.659 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T06:47:02.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T06:47:02.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T06:47:02.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-21T06:47:02.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.895 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-21T06:47:02.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:47:02.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-21T06:47:02.980 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2024-09-21T06:47:02.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:47:02.981 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T06:47:02.990 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T06:47:02.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:47:03.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 -- 172.21.15.81:0/593125514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f681406f630 msgr2=0x7f68140ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 --2- 172.21.15.81:0/593125514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f681406f630 0x7f68140ada70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f68140cc4a0 tx=0x7f67fc02a480 comp rx=0 tx=0).stop 2024-09-21T06:47:03.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 -- 172.21.15.81:0/593125514 shutdown_connections 2024-09-21T06:47:03.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 --2- 172.21.15.81:0/593125514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f681406f630 0x7f68140ada70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 --2- 172.21.15.81:0/593125514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140b4c60 0x7f68140b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 -- 172.21.15.81:0/593125514 >> 172.21.15.81:0/593125514 conn(0x7f68140b2030 msgr2=0x7f68140b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 -- 172.21.15.81:0/593125514 shutdown_connections 2024-09-21T06:47:03.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.102+0000 7f68198e6640 1 -- 172.21.15.81:0/593125514 wait complete. 2024-09-21T06:47:03.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.104+0000 7f68198e6640 1 Processor -- start 2024-09-21T06:47:03.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.104+0000 7f68198e6640 1 -- start start 2024-09-21T06:47:03.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68198e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f681406f630 0x7f68141f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68198e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140adfb0 0x7f68140cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68198e6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140b4c60 0x7f681415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68198e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6814158c30 con 0x7f68140adfb0 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68198e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f6814158ab0 con 0x7f681406f630 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68198e6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f681406d780 con 0x7f68140b4c60 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68127fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140adfb0 0x7f68140cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68127fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140adfb0 0x7f68140cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60728/0 (socket says 172.21.15.81:60728) 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68127fc640 1 -- 172.21.15.81:0/1710269187 learned_addr learned my addr 172.21.15.81:0/1710269187 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f6812ffd640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f681406f630 0x7f68141f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.105+0000 7f68137fe640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140b4c60 0x7f681415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68127fc640 1 -- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140b4c60 msgr2=0x7f681415e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68127fc640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140b4c60 0x7f681415e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68127fc640 1 -- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f681406f630 msgr2=0x7f68141f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68127fc640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f681406f630 0x7f68141f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68127fc640 1 -- 172.21.15.81:0/1710269187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68140cf3a0 con 0x7f68140adfb0 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f6812ffd640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f681406f630 0x7f68141f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68127fc640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140adfb0 0x7f68140cca70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f67fc02aa70 tx=0x7f67fc005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f680bfff640 1 -- 172.21.15.81:0/1710269187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc031b50 con 0x7f68140adfb0 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f680bfff640 1 -- 172.21.15.81:0/1710269187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67fc040070 con 0x7f68140adfb0 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68140cf680 con 0x7f68140adfb0 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f680bfff640 1 -- 172.21.15.81:0/1710269187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67fc005020 con 0x7f68140adfb0 2024-09-21T06:47:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.106+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f681415dd50 con 0x7f68140adfb0 2024-09-21T06:47:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.107+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681406dc40 con 0x7f68140adfb0 2024-09-21T06:47:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.108+0000 7f680bfff640 1 -- 172.21.15.81:0/1710269187 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67fc0051e0 con 0x7f68140adfb0 2024-09-21T06:47:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.108+0000 7f680bfff640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f67f4078bc0 0x7f67f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.109+0000 7f680bfff640 1 -- 172.21.15.81:0/1710269187 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f67fc0bd960 con 0x7f68140adfb0 2024-09-21T06:47:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.109+0000 7f6812ffd640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f67f4078bc0 0x7f67f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.109+0000 7f6812ffd640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f67f4078bc0 0x7f67f407b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6804005fd0 tx=0x7f6804011040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.117+0000 7f680bfff640 1 -- 172.21.15.81:0/1710269187 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f67fc031770 con 0x7f68140adfb0 2024-09-21T06:47:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.290+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68140766f0 con 0x7f67f4078bc0 2024-09-21T06:47:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.291+0000 7f680bfff640 1 -- 172.21.15.81:0/1710269187 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13414 (secure 0 0 0) 0x7f68140766f0 con 0x7f67f4078bc0 2024-09-21T06:47:03.293 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:47:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:47:03.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f67f4078bc0 msgr2=0x7f67f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f67f4078bc0 0x7f67f407b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6804005fd0 tx=0x7f6804011040 comp rx=0 tx=0).stop 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140adfb0 msgr2=0x7f68140cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140adfb0 0x7f68140cca70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f67fc02aa70 tx=0x7f67fc005d00 comp rx=0 tx=0).stop 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 shutdown_connections 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f67f4078bc0 0x7f67f407b0d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68140b4c60 0x7f681415e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68140adfb0 0x7f68140cca70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 --2- 172.21.15.81:0/1710269187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f681406f630 0x7f68141f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 >> 172.21.15.81:0/1710269187 conn(0x7f68140b2030 msgr2=0x7f68140b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 shutdown_connections 2024-09-21T06:47:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.293+0000 7f68198e6640 1 -- 172.21.15.81:0/1710269187 wait complete. 2024-09-21T06:47:03.306 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-21T06:47:02.679197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222600,"kb_used_data":6348,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752120,"statfs":{"total":773094113280,"available":772866170880,"internally_reserved":0,"allocated":6500352,"data_stored":3545753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12356,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-58,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.604111"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T06:46:58.758142+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:58.758142+0000","last_peered":"2024-09-21T06:46:58.758142+0000","last_clean":"2024-09-21T06:46:58.758142+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:58.758142+0000","last_undegraded":"2024-09-21T06:46:58.758142+0000","last_fullsized":"2024-09-21T06:46:58.758142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":667648,"data_stored":297071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":307173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":881400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":313544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":290542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":655360,"data_stored":290472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":880852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":284699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:47:03.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:47:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.417+0000 7fd03012b640 1 -- 172.21.15.81:0/1888988142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd014005320 msgr2=0x7fd01400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.417+0000 7fd03012b640 1 --2- 172.21.15.81:0/1888988142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd014005320 0x7fd01400b9e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd020005fd0 tx=0x7fd014005830 comp rx=0 tx=0).stop 2024-09-21T06:47:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.418+0000 7fd03012b640 1 -- 172.21.15.81:0/1888988142 shutdown_connections 2024-09-21T06:47:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.418+0000 7fd03012b640 1 --2- 172.21.15.81:0/1888988142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd014005320 0x7fd01400b9e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.418+0000 7fd03012b640 1 -- 172.21.15.81:0/1888988142 >> 172.21.15.81:0/1888988142 conn(0x7fd0280b2030 msgr2=0x7fd0280b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.418+0000 7fd03012b640 1 -- 172.21.15.81:0/1888988142 shutdown_connections 2024-09-21T06:47:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.418+0000 7fd03012b640 1 -- 172.21.15.81:0/1888988142 wait complete. 2024-09-21T06:47:03.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.419+0000 7fd03012b640 1 Processor -- start 2024-09-21T06:47:03.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.419+0000 7fd03012b640 1 -- start start 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd014005320 0x7fd02815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd028146890 0x7fd028142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0281507d0 0x7fd028150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0280b3600 con 0x7fd028146890 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd028158cc0 con 0x7fd014005320 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd0280b3780 con 0x7fd0281507d0 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd028146890 0x7fd028142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd028146890 0x7fd028142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60736/0 (socket says 172.21.15.81:60736) 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 -- 172.21.15.81:0/2016234047 learned_addr learned my addr 172.21.15.81:0/2016234047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:03.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02e6c8640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0281507d0 0x7fd028150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02dec7640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd014005320 0x7fd02815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 -- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0281507d0 msgr2=0x7fd028150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0281507d0 0x7fd028150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 -- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd014005320 msgr2=0x7fd02815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd014005320 0x7fd02815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 -- 172.21.15.81:0/2016234047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0280cea20 con 0x7fd028146890 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd02d6c6640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd028146890 0x7fd028142a80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd018003d30 tx=0x7fd018001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd01e7fc640 1 -- 172.21.15.81:0/2016234047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018011640 con 0x7fd028146890 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd01e7fc640 1 -- 172.21.15.81:0/2016234047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd018016020 con 0x7fd028146890 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd01e7fc640 1 -- 172.21.15.81:0/2016234047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018011a60 con 0x7fd028146890 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0280ced00 con 0x7fd028146890 2024-09-21T06:47:03.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.421+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0280cf2c0 con 0x7fd028146890 2024-09-21T06:47:03.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.422+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd02806d070 con 0x7fd028146890 2024-09-21T06:47:03.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.423+0000 7fd01e7fc640 1 -- 172.21.15.81:0/2016234047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd018011c00 con 0x7fd028146890 2024-09-21T06:47:03.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.423+0000 7fd01e7fc640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd00c078b90 0x7fd00c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.424+0000 7fd01e7fc640 1 -- 172.21.15.81:0/2016234047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7fd01809b8c0 con 0x7fd028146890 2024-09-21T06:47:03.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.424+0000 7fd02dec7640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd00c078b90 0x7fd00c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.424+0000 7fd02dec7640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd00c078b90 0x7fd00c07b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd024000c00 tx=0x7fd024006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.428+0000 7fd01e7fc640 1 -- 172.21.15.81:0/2016234047 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd018020020 con 0x7fd028146890 2024-09-21T06:47:03.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.601+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd02814f680 con 0x7fd00c078b90 2024-09-21T06:47:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.602+0000 7fd01e7fc640 1 -- 172.21.15.81:0/2016234047 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13414 (secure 0 0 0) 0x7fd02814f680 con 0x7fd00c078b90 2024-09-21T06:47:03.604 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:47:03.604 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd00c078b90 msgr2=0x7fd00c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd00c078b90 0x7fd00c07b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd024000c00 tx=0x7fd024006720 comp rx=0 tx=0).stop 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd028146890 msgr2=0x7fd028142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd028146890 0x7fd028142a80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd018003d30 tx=0x7fd018001800 comp rx=0 tx=0).stop 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 shutdown_connections 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd00c078b90 0x7fd00c07b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0281507d0 0x7fd028150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd028146890 0x7fd028142a80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 --2- 172.21.15.81:0/2016234047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd014005320 0x7fd02815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 >> 172.21.15.81:0/2016234047 conn(0x7fd0280b2030 msgr2=0x7fd0280b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 shutdown_connections 2024-09-21T06:47:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.604+0000 7fd03012b640 1 -- 172.21.15.81:0/2016234047 wait complete. 2024-09-21T06:47:03.618 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-21T06:47:02.679197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222600,"kb_used_data":6348,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752120,"statfs":{"total":773094113280,"available":772866170880,"internally_reserved":0,"allocated":6500352,"data_stored":3545753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12356,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-58,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.604111"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T06:46:58.758142+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:58.758142+0000","last_peered":"2024-09-21T06:46:58.758142+0000","last_clean":"2024-09-21T06:46:58.758142+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:58.758142+0000","last_undegraded":"2024-09-21T06:46:58.758142+0000","last_fullsized":"2024-09-21T06:46:58.758142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":667648,"data_stored":297071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":307173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":881400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":313544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":290542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":655360,"data_stored":290472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":880852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":284699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:47:03.618 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T06:47:03.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:47:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.728+0000 7f3eafc63640 1 -- 172.21.15.81:0/1097984910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 msgr2=0x7f3ea81601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.728+0000 7f3eafc63640 1 --2- 172.21.15.81:0/1097984910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 0x7f3ea81601c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009890 tx=0x7f3e9802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.728+0000 7f3eafc63640 1 -- 172.21.15.81:0/1097984910 shutdown_connections 2024-09-21T06:47:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.728+0000 7f3eafc63640 1 --2- 172.21.15.81:0/1097984910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 0x7f3ea81601c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.728+0000 7f3eafc63640 1 -- 172.21.15.81:0/1097984910 >> 172.21.15.81:0/1097984910 conn(0x7f3ea80d25e0 msgr2=0x7f3ea80d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.728+0000 7f3eafc63640 1 -- 172.21.15.81:0/1097984910 shutdown_connections 2024-09-21T06:47:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.728+0000 7f3eafc63640 1 -- 172.21.15.81:0/1097984910 wait complete. 2024-09-21T06:47:03.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.730+0000 7f3eafc63640 1 Processor -- start 2024-09-21T06:47:03.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.730+0000 7f3eafc63640 1 -- start start 2024-09-21T06:47:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3eafc63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea80d19a0 0x7f3ea80b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3eafc63640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 0x7f3ea80cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3eafc63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea815d2c0 0x7f3ea80b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3eafc63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea815d6d0 con 0x7f3ea80d19a0 2024-09-21T06:47:03.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3eafc63640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea8073660 con 0x7f3ea815d2c0 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3eafc63640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea815d850 con 0x7f3ea815a290 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3ead9ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea80d19a0 0x7f3ea80b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3ead9ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea80d19a0 0x7f3ea80b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60742/0 (socket says 172.21.15.81:60742) 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.731+0000 7f3ead9ff640 1 -- 172.21.15.81:0/2522485666 learned_addr learned my addr 172.21.15.81:0/2522485666 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3ead1fe640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 0x7f3ea80cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3eae200640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea815d2c0 0x7f3ea80b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3ead9ff640 1 -- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 msgr2=0x7f3ea80cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3ead9ff640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 0x7f3ea80cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3ead9ff640 1 -- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea815d2c0 msgr2=0x7f3ea80b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3ead9ff640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea815d2c0 0x7f3ea80b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3ead9ff640 1 -- 172.21.15.81:0/2522485666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea80b52a0 con 0x7f3ea80d19a0 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3ead9ff640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea80d19a0 0x7f3ea80b6340 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c410 tx=0x7f3ea400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3e9e7fc640 1 -- 172.21.15.81:0/2522485666 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011790 con 0x7f3ea80d19a0 2024-09-21T06:47:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3e9e7fc640 1 -- 172.21.15.81:0/2522485666 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ea4017070 con 0x7f3ea80d19a0 2024-09-21T06:47:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea80b5580 con 0x7f3ea80d19a0 2024-09-21T06:47:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3e9e7fc640 1 -- 172.21.15.81:0/2522485666 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011d40 con 0x7f3ea80d19a0 2024-09-21T06:47:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.732+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea80b5b40 con 0x7f3ea80d19a0 2024-09-21T06:47:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.733+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea81601c0 con 0x7f3ea80d19a0 2024-09-21T06:47:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.734+0000 7f3e9e7fc640 1 -- 172.21.15.81:0/2522485666 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ea401c460 con 0x7f3ea80d19a0 2024-09-21T06:47:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.734+0000 7f3e9e7fc640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3e8c078bc0 0x7f3e8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.734+0000 7f3e9e7fc640 1 -- 172.21.15.81:0/2522485666 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f3ea409aab0 con 0x7f3ea80d19a0 2024-09-21T06:47:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.735+0000 7f3ead1fe640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3e8c078bc0 0x7f3e8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.735+0000 7f3ead1fe640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3e8c078bc0 0x7f3e8c07b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e98034000 tx=0x7f3e98004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.739+0000 7f3e9e7fc640 1 -- 172.21.15.81:0/2522485666 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ea4062fe0 con 0x7f3ea80d19a0 2024-09-21T06:47:03.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.913+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ea815c110 con 0x7f3e8c078bc0 2024-09-21T06:47:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.914+0000 7f3e9e7fc640 1 -- 172.21.15.81:0/2522485666 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13414 (secure 0 0 0) 0x7f3ea815c110 con 0x7f3e8c078bc0 2024-09-21T06:47:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:47:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3e8c078bc0 msgr2=0x7f3e8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3e8c078bc0 0x7f3e8c07b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e98034000 tx=0x7f3e98004730 comp rx=0 tx=0).stop 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea80d19a0 msgr2=0x7f3ea80b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea80d19a0 0x7f3ea80b6340 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400c410 tx=0x7f3ea400c8d0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 shutdown_connections 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f3e8c078bc0 0x7f3e8c07b0d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea815a290 0x7f3ea80cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea815d2c0 0x7f3ea80b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 --2- 172.21.15.81:0/2522485666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ea80d19a0 0x7f3ea80b6340 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 >> 172.21.15.81:0/2522485666 conn(0x7f3ea80d25e0 msgr2=0x7f3ea80d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 shutdown_connections 2024-09-21T06:47:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:03.916+0000 7f3eafc63640 1 -- 172.21.15.81:0/2522485666 wait complete. 2024-09-21T06:47:03.929 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-21T06:47:02.679197+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222600,"kb_used_data":6348,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752120,"statfs":{"total":773094113280,"available":772866170880,"internally_reserved":0,"allocated":6500352,"data_stored":3545753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12356,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-58,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.604111"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":174,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T06:46:58.758142+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:46:58.758142+0000","last_peered":"2024-09-21T06:46:58.758142+0000","last_clean":"2024-09-21T06:46:58.758142+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:46:58.758142+0000","last_undegraded":"2024-09-21T06:46:58.758142+0000","last_fullsized":"2024-09-21T06:46:58.758142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":667648,"data_stored":297071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":307173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":881400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":313544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":290542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":655360,"data_stored":290472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1249280,"data_stored":880852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":284699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:47:03.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:47:04.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 -- 172.21.15.81:0/3784368241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b01601c0 msgr2=0x7fa7b00b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:04.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/3784368241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b01601c0 0x7fa7b00b1b90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009830 tx=0x7fa7a002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 -- 172.21.15.81:0/3784368241 shutdown_connections 2024-09-21T06:47:04.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/3784368241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b01601c0 0x7fa7b00b1b90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/3784368241 >> v2:172.21.15.89:3300/0 conn(0x7fa7b00d19a0 0x7fa7b015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 -- 172.21.15.81:0/3784368241 >> 172.21.15.81:0/3784368241 conn(0x7fa7b00d25e0 msgr2=0x7fa7b00d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:04.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 -- 172.21.15.81:0/3784368241 shutdown_connections 2024-09-21T06:47:04.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.040+0000 7fa7b87a1640 1 -- 172.21.15.81:0/3784368241 wait complete. 2024-09-21T06:47:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.042+0000 7fa7b87a1640 1 Processor -- start 2024-09-21T06:47:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.042+0000 7fa7b87a1640 1 -- start start 2024-09-21T06:47:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b87a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b00b20d0 0x7fa7b00c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b87a1640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7b00d19a0 0x7fa7b00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b87a1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b01601c0 0x7fa7b01f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b87a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b0072ec0 con 0x7fa7b00b20d0 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b87a1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b0072d40 con 0x7fa7b01601c0 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b87a1640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b0073040 con 0x7fa7b00d19a0 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b653d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b00b20d0 0x7fa7b00c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b653d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b00b20d0 0x7fa7b00c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60758/0 (socket says 172.21.15.81:60758) 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b653d640 1 -- 172.21.15.81:0/2100651946 learned_addr learned my addr 172.21.15.81:0/2100651946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b6d3e640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b01601c0 0x7fa7b01f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.043+0000 7fa7b5d3c640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7b00d19a0 0x7fa7b00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b653d640 1 -- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7b00d19a0 msgr2=0x7fa7b00cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b653d640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7b00d19a0 0x7fa7b00cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b653d640 1 -- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b01601c0 msgr2=0x7fa7b01f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b653d640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b01601c0 0x7fa7b01f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b653d640 1 -- 172.21.15.81:0/2100651946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b00c7540 con 0x7fa7b00b20d0 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b5d3c640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7b00d19a0 0x7fa7b00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b6d3e640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b01601c0 0x7fa7b01f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b653d640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b00b20d0 0x7fa7b00c6d10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00dac0 tx=0x7fa7ac00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7a6ffd640 1 -- 172.21.15.81:0/2100651946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac017070 con 0x7fa7b00b20d0 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7a6ffd640 1 -- 172.21.15.81:0/2100651946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7ac003970 con 0x7fa7b00b20d0 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b00c7820 con 0x7fa7b00b20d0 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7a6ffd640 1 -- 172.21.15.81:0/2100651946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac003dc0 con 0x7fa7b00b20d0 2024-09-21T06:47:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.044+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b00c7de0 con 0x7fa7b00b20d0 2024-09-21T06:47:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.045+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b0073560 con 0x7fa7b00b20d0 2024-09-21T06:47:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.046+0000 7fa7a6ffd640 1 -- 172.21.15.81:0/2100651946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7ac004020 con 0x7fa7b00b20d0 2024-09-21T06:47:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.046+0000 7fa7a6ffd640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa794078b90 0x7fa79407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.046+0000 7fa7a6ffd640 1 -- 172.21.15.81:0/2100651946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7fa7ac09b2f0 con 0x7fa7b00b20d0 2024-09-21T06:47:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.046+0000 7fa7b5d3c640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa794078b90 0x7fa79407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.047+0000 7fa7b5d3c640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa794078b90 0x7fa79407b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0034000 tx=0x7fa7a0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:04.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.051+0000 7fa7a6ffd640 1 -- 172.21.15.81:0/2100651946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa7ac020030 con 0x7fa7b00b20d0 2024-09-21T06:47:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.232+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7b00b17c0 con 0x7fa7b00b20d0 2024-09-21T06:47:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.233+0000 7fa7a6ffd640 1 -- 172.21.15.81:0/2100651946 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+13269 (secure 0 0 0) 0x7fa7ac0638a0 con 0x7fa7b00b20d0 2024-09-21T06:47:04.244 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:47:04.244 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"fsid":"5acf265c-1f37-45bc-9438-eb9ad71b6190","created":"2024-09-21T06:44:50.271189+0000","modified":"2024-09-21T06:47:01.093921+0000","last_up_change":"2024-09-21T06:45:03.731050+0000","last_in_change":"2024-09-21T06:44:53.749731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:45:04.668203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0d51cbed-f6af-449e-acaa-b6218d92f263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6817","nonce":3316093224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6819","nonce":3316093224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6823","nonce":3316093224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3316093224},{"type":"v1","addr":"172.21.15.81:6821","nonce":3316093224}]},"public_addr":"172.21.15.81:6817/3316093224","cluster_addr":"172.21.15.81:6819/3316093224","heartbeat_back_addr":"172.21.15.81:6823/3316093224","heartbeat_front_addr":"172.21.15.81:6821/3316093224","state":["exists","up"]},{"osd":1,"uuid":"a285756c-6abd-4c2a-947c-6924296cde5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6825","nonce":3679651054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6827","nonce":3679651054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6831","nonce":3679651054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3679651054},{"type":"v1","addr":"172.21.15.81:6829","nonce":3679651054}]},"public_addr":"172.21.15.81:6825/3679651054","cluster_addr":"172.21.15.81:6827/3679651054","heartbeat_back_addr":"172.21.15.81:6831/3679651054","heartbeat_front_addr":"172.21.15.81:6829/3679651054","state":["exists","up"]},{"osd":2,"uuid":"8effc0a6-a110-434a-a89c-5a3f13f59425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6801","nonce":1250280053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6803","nonce":1250280053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6807","nonce":1250280053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1250280053},{"type":"v1","addr":"172.21.15.81:6805","nonce":1250280053}]},"public_addr":"172.21.15.81:6801/1250280053","cluster_addr":"172.21.15.81:6803/1250280053","heartbeat_back_addr":"172.21.15.81:6807/1250280053","heartbeat_front_addr":"172.21.15.81:6805/1250280053","state":["exists","up"]},{"osd":3,"uuid":"93a4d391-8dfe-468a-8b0c-d36d7e1bb531","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6809","nonce":1925632354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6811","nonce":1925632354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6815","nonce":1925632354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1925632354},{"type":"v1","addr":"172.21.15.81:6813","nonce":1925632354}]},"public_addr":"172.21.15.81:6809/1925632354","cluster_addr":"172.21.15.81:6811/1925632354","heartbeat_back_addr":"172.21.15.81:6815/1925632354","heartbeat_front_addr":"172.21.15.81:6813/1925632354","state":["exists","up"]},{"osd":4,"uuid":"62d75e80-b6ca-48d1-a2bb-c7db05fdf99b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6803","nonce":1367095570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6805","nonce":1367095570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6809","nonce":1367095570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1367095570},{"type":"v1","addr":"172.21.15.89:6807","nonce":1367095570}]},"public_addr":"172.21.15.89:6803/1367095570","cluster_addr":"172.21.15.89:6805/1367095570","heartbeat_back_addr":"172.21.15.89:6809/1367095570","heartbeat_front_addr":"172.21.15.89:6807/1367095570","state":["exists","up"]},{"osd":5,"uuid":"13d1a733-1e42-4bee-99b7-61bce85e5e6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6811","nonce":2407243866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6813","nonce":2407243866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6817","nonce":2407243866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2407243866},{"type":"v1","addr":"172.21.15.89:6815","nonce":2407243866}]},"public_addr":"172.21.15.89:6811/2407243866","cluster_addr":"172.21.15.89:6813/2407243866","heartbeat_back_addr":"172.21.15.89:6817/2407243866","heartbeat_front_addr":"172.21.15.89:6815/2407243866","state":["exists","up"]},{"osd":6,"uuid":"0e81012a-bcd4-467f-b394-cc3f09651729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6819","nonce":990103659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6821","nonce":990103659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6825","nonce":990103659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":990103659},{"type":"v1","addr":"172.21.15.89:6823","nonce":990103659}]},"public_addr":"172.21.15.89:6819/990103659","cluster_addr":"172.21.15.89:6821/990103659","heartbeat_back_addr":"172.21.15.89:6825/990103659","heartbeat_front_addr":"172.21.15.89:6823/990103659","state":["exists","up"]},{"osd":7,"uuid":"5fd95c74-868d-4f5e-aeb6-2e2ece20a3d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6827","nonce":2470132384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6829","nonce":2470132384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6833","nonce":2470132384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2470132384},{"type":"v1","addr":"172.21.15.89:6831","nonce":2470132384}]},"public_addr":"172.21.15.89:6827/2470132384","cluster_addr":"172.21.15.89:6829/2470132384","heartbeat_back_addr":"172.21.15.89:6833/2470132384","heartbeat_front_addr":"172.21.15.89:6831/2470132384","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.704995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.594257+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.335102+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.397766+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.030583+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.127748+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.073738+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:45:00.532079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/1408396045":"2024-09-22T06:46:57.931703+0000","172.21.15.81:6833/1408396045":"2024-09-22T06:46:57.931703+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:47:04.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa794078b90 msgr2=0x7fa79407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:04.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa794078b90 0x7fa79407b0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0034000 tx=0x7fa7a0004730 comp rx=0 tx=0).stop 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b00b20d0 msgr2=0x7fa7b00c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b00b20d0 0x7fa7b00c6d10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00dac0 tx=0x7fa7ac00df80 comp rx=0 tx=0).stop 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 shutdown_connections 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fa794078b90 0x7fa79407b0a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7b00d19a0 0x7fa7b00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b01601c0 0x7fa7b01f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 --2- 172.21.15.81:0/2100651946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7b00b20d0 0x7fa7b00c6d10 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 >> 172.21.15.81:0/2100651946 conn(0x7fa7b00d25e0 msgr2=0x7fa7b015a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 shutdown_connections 2024-09-21T06:47:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:04.235+0000 7fa7b87a1640 1 -- 172.21.15.81:0/2100651946 wait complete. 2024-09-21T06:47:05.249 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T06:47:05.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 -- 172.21.15.81:0/2490353528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd094162ed0 msgr2=0x7fd0940d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 --2- 172.21.15.81:0/2490353528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd094162ed0 0x7fd0940d0de0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd088005fd0 tx=0x7fd08802a4a0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 -- 172.21.15.81:0/2490353528 shutdown_connections 2024-09-21T06:47:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 --2- 172.21.15.81:0/2490353528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd094162ed0 0x7fd0940d0de0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 --2- 172.21.15.81:0/2490353528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0940cf1c0 0x7fd09415e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 -- 172.21.15.81:0/2490353528 >> 172.21.15.81:0/2490353528 conn(0x7fd0940b7320 msgr2=0x7fd0940b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 -- 172.21.15.81:0/2490353528 shutdown_connections 2024-09-21T06:47:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.369+0000 7fd09a582640 1 -- 172.21.15.81:0/2490353528 wait complete. 2024-09-21T06:47:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.371+0000 7fd09a582640 1 Processor -- start 2024-09-21T06:47:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.371+0000 7fd09a582640 1 -- start start 2024-09-21T06:47:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd09a582640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0940cf1c0 0x7fd0940b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd09a582640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940d1320 0x7fd0940b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd09a582640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd094162ed0 0x7fd094160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd09a582640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940d1c50 con 0x7fd0940cf1c0 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd09a582640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940d1ad0 con 0x7fd0940d1320 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd09a582640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fd0940d4a70 con 0x7fd094162ed0 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd093fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0940cf1c0 0x7fd0940b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd093fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0940cf1c0 0x7fd0940b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60782/0 (socket says 172.21.15.81:60782) 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd093fff640 1 -- 172.21.15.81:0/843460837 learned_addr learned my addr 172.21.15.81:0/843460837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd0937fe640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940d1320 0x7fd0940b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.372+0000 7fd098b1f640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd094162ed0 0x7fd094160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd093fff640 1 -- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd094162ed0 msgr2=0x7fd094160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd093fff640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd094162ed0 0x7fd094160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd093fff640 1 -- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940d1320 msgr2=0x7fd0940b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd093fff640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0940d1320 0x7fd0940b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd093fff640 1 -- 172.21.15.81:0/843460837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0940cbc70 con 0x7fd0940cf1c0 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd093fff640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0940cf1c0 0x7fd0940b3cc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd08400d6d0 tx=0x7fd08400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084017070 con 0x7fd0940cf1c0 2024-09-21T06:47:05.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd084005330 con 0x7fd0940cf1c0 2024-09-21T06:47:05.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd084009820 con 0x7fd0940cf1c0 2024-09-21T06:47:05.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0940cb6b0 con 0x7fd0940cf1c0 2024-09-21T06:47:05.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.373+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0940b5240 con 0x7fd0940cf1c0 2024-09-21T06:47:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.374+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0940d4f90 con 0x7fd0940cf1c0 2024-09-21T06:47:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd084009bd0 con 0x7fd0940cf1c0 2024-09-21T06:47:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd090ff9640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd080078b90 0x7fd08007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7fd08409ae20 con 0x7fd0940cf1c0 2024-09-21T06:47:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd090ff9640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fd08007f080 0x7fd080081510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 --> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd080081be0 con 0x7fd08007f080 2024-09-21T06:47:05.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fd08409d520 con 0x7fd0940cf1c0 2024-09-21T06:47:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd0937fe640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd080078b90 0x7fd08007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.375+0000 7fd098b1f640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fd08007f080 0x7fd080081510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.376+0000 7fd098b1f640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fd08007f080 0x7fd080081510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.376+0000 7fd0937fe640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd080078b90 0x7fd08007b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd088033000 tx=0x7fd088004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.376+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== osd.0 v2:172.21.15.81:6816/3316093224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd080081be0 con 0x7fd08007f080 2024-09-21T06:47:05.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.389+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 --> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd0940b8080 con 0x7fd08007f080 2024-09-21T06:47:05.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.389+0000 7fd090ff9640 1 -- 172.21.15.81:0/843460837 <== osd.0 v2:172.21.15.81:6816/3316093224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd0940b8080 con 0x7fd08007f080 2024-09-21T06:47:05.391 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:05.392 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:05.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.389+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fd08007f080 msgr2=0x7fd080081510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:6816/3316093224,v1:172.21.15.81:6817/3316093224] conn(0x7fd08007f080 0x7fd080081510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd080078b90 msgr2=0x7fd08007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fd080078b90 0x7fd08007b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd088033000 tx=0x7fd088004730 comp rx=0 tx=0).stop 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0940cf1c0 msgr2=0x7fd0940b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 --2- 172.21.15.81:0/843460837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0940cf1c0 0x7fd0940b3cc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd08400d6d0 tx=0x7fd08400db90 comp rx=0 tx=0).stop 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd098b1f640 1 -- 172.21.15.81:0/843460837 reap_dead start 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 shutdown_connections 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 >> 172.21.15.81:0/843460837 conn(0x7fd0940b7320 msgr2=0x7fd0940b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 shutdown_connections 2024-09-21T06:47:05.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.390+0000 7fd09a582640 1 -- 172.21.15.81:0/843460837 wait complete. 2024-09-21T06:47:05.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T06:47:05.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 -- 172.21.15.81:0/1523485842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 msgr2=0x7f700c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 --2- 172.21.15.81:0/1523485842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c15a290 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009be0 tx=0x7f6ffc02a8d0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 -- 172.21.15.81:0/1523485842 shutdown_connections 2024-09-21T06:47:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 --2- 172.21.15.81:0/1523485842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f700c1601c0 0x7f700c0b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 --2- 172.21.15.81:0/1523485842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c15a290 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 -- 172.21.15.81:0/1523485842 >> 172.21.15.81:0/1523485842 conn(0x7f700c0d25e0 msgr2=0x7f700c0d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 -- 172.21.15.81:0/1523485842 shutdown_connections 2024-09-21T06:47:05.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.512+0000 7f7011319640 1 -- 172.21.15.81:0/1523485842 wait complete. 2024-09-21T06:47:05.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.514+0000 7f7011319640 1 Processor -- start 2024-09-21T06:47:05.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.514+0000 7f7011319640 1 -- start start 2024-09-21T06:47:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f7011319640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f700c0b20d0 0x7f700c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f7011319640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c0b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f7011319640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f700c1601c0 0x7f700c0b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f7011319640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f700c072ec0 con 0x7f700c0d19a0 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f7011319640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f700c072d40 con 0x7f700c1601c0 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f7011319640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f700c073040 con 0x7f700c0b20d0 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c0b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c0b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60800/0 (socket says 172.21.15.81:60800) 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 -- 172.21.15.81:0/2035660453 learned_addr learned my addr 172.21.15.81:0/2035660453 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700affd640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f700c0b20d0 0x7f700c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700b7fe640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f700c1601c0 0x7f700c0b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 -- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f700c0b20d0 msgr2=0x7f700c1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f700c0b20d0 0x7f700c1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 -- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f700c1601c0 msgr2=0x7f700c0b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f700c1601c0 0x7f700c0b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.515+0000 7f700a7fc640 1 -- 172.21.15.81:0/2035660453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700c1f34d0 con 0x7f700c0d19a0 2024-09-21T06:47:05.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.516+0000 7f700b7fe640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f700c1601c0 0x7f700c0b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.516+0000 7f700a7fc640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c0b6eb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f700000e790 tx=0x7f700000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.516+0000 7f6ff37fe640 1 -- 172.21.15.81:0/2035660453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700000eea0 con 0x7f700c0d19a0 2024-09-21T06:47:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.516+0000 7f6ff37fe640 1 -- 172.21.15.81:0/2035660453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f700000cdb0 con 0x7f700c0d19a0 2024-09-21T06:47:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.516+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f700c1f37b0 con 0x7f700c0d19a0 2024-09-21T06:47:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.516+0000 7f6ff37fe640 1 -- 172.21.15.81:0/2035660453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7000010690 con 0x7f700c0d19a0 2024-09-21T06:47:05.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.516+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f700c1f3d70 con 0x7f700c0d19a0 2024-09-21T06:47:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.517+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700c1f7510 con 0x7f700c0d19a0 2024-09-21T06:47:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.518+0000 7f6ff37fe640 1 -- 172.21.15.81:0/2035660453 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7000010830 con 0x7f700c0d19a0 2024-09-21T06:47:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.518+0000 7f6ff37fe640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6ff8078b90 0x7f6ff807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.518+0000 7f6ff37fe640 1 -- 172.21.15.81:0/2035660453 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f700009b590 con 0x7f700c0d19a0 2024-09-21T06:47:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.519+0000 7f700affd640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6ff8078b90 0x7f6ff807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.519+0000 7f700affd640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6ff8078b90 0x7f6ff807b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc034000 tx=0x7f6ffc004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.523+0000 7f6ff37fe640 1 -- 172.21.15.81:0/2035660453 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7000063bd0 con 0x7f700c0d19a0 2024-09-21T06:47:05.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.698+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f700c0734f0 con 0x7f6ff8078b90 2024-09-21T06:47:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.699+0000 7f6ff37fe640 1 -- 172.21.15.81:0/2035660453 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f700c0734f0 con 0x7f6ff8078b90 2024-09-21T06:47:05.701 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6ff8078b90 msgr2=0x7f6ff807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6ff8078b90 0x7f6ff807b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc034000 tx=0x7f6ffc004ab0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 msgr2=0x7f700c0b6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c0b6eb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f700000e790 tx=0x7f700000ec50 comp rx=0 tx=0).stop 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 shutdown_connections 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6ff8078b90 0x7f6ff807b0a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f700c1601c0 0x7f700c0b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f700c0d19a0 0x7f700c0b6eb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 --2- 172.21.15.81:0/2035660453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f700c0b20d0 0x7f700c1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.701+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 >> 172.21.15.81:0/2035660453 conn(0x7f700c0d25e0 msgr2=0x7f700c159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.702+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 shutdown_connections 2024-09-21T06:47:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.702+0000 7f7011319640 1 -- 172.21.15.81:0/2035660453 wait complete. 2024-09-21T06:47:05.715 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T06:47:05.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:05.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.829+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1645907398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6480b1bc0 msgr2=0x7fb6480ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.829+0000 7fb64d2bd640 1 --2- 172.21.15.81:0/1645907398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6480b1bc0 0x7fb6480ccca0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb638009830 tx=0x7fb63802a530 comp rx=0 tx=0).stop 2024-09-21T06:47:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.829+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1645907398 shutdown_connections 2024-09-21T06:47:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.829+0000 7fb64d2bd640 1 --2- 172.21.15.81:0/1645907398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6480b1bc0 0x7fb6480ccca0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.829+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1645907398 >> 172.21.15.81:0/1645907398 conn(0x7fb6480b3f60 msgr2=0x7fb6480b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.829+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1645907398 shutdown_connections 2024-09-21T06:47:05.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.829+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1645907398 wait complete. 2024-09-21T06:47:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.831+0000 7fb64d2bd640 1 Processor -- start 2024-09-21T06:47:05.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.831+0000 7fb64d2bd640 1 -- start start 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.832+0000 7fb64d2bd640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6480b1bc0 0x7fb648148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.832+0000 7fb64d2bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6480d1880 0x7fb6481f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.832+0000 7fb64d2bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb648154a30 0x7fb6481f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.832+0000 7fb64d2bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6480d1e10 con 0x7fb648154a30 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.832+0000 7fb64d2bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fb6480d1c90 con 0x7fb6480d1880 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.832+0000 7fb64d2bd640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fb6480d1f90 con 0x7fb6480b1bc0 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.832+0000 7fb6477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb648154a30 0x7fb6481f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb648154a30 0x7fb6481f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60812/0 (socket says 172.21.15.81:60812) 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 -- 172.21.15.81:0/1587722788 learned_addr learned my addr 172.21.15.81:0/1587722788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:05.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb646ffd640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6480b1bc0 0x7fb648148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb63e7fc640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6480d1880 0x7fb6481f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 -- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6480b1bc0 msgr2=0x7fb648148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6480b1bc0 0x7fb648148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 -- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6480d1880 msgr2=0x7fb6481f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6480d1880 0x7fb6481f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 -- 172.21.15.81:0/1587722788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb648148b80 con 0x7fb648154a30 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb6477fe640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb648154a30 0x7fb6481f6cc0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c700 tx=0x7fb64000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb640003b70 con 0x7fb648154a30 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb640003d10 con 0x7fb648154a30 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6481f7350 con 0x7fb648154a30 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64000aab0 con 0x7fb648154a30 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.833+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6480c65a0 con 0x7fb648154a30 2024-09-21T06:47:05.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.834+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb64815d720 con 0x7fb648154a30 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.835+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb64000ac50 con 0x7fb648154a30 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.835+0000 7fb63ffff640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb628078bc0 0x7fb62807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.835+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7fb64009b180 con 0x7fb648154a30 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.836+0000 7fb63ffff640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7fb62807f0b0 0x7fb628081540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.836+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 --> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb628081c10 con 0x7fb62807f0b0 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.836+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fb64009b610 con 0x7fb648154a30 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.836+0000 7fb646ffd640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb628078bc0 0x7fb62807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.836+0000 7fb63e7fc640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7fb62807f0b0 0x7fb628081540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.836+0000 7fb63e7fc640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7fb62807f0b0 0x7fb628081540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.836+0000 7fb646ffd640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb628078bc0 0x7fb62807b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb638034000 tx=0x7fb638004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.837+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== osd.1 v2:172.21.15.81:6824/3679651054 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb628081c10 con 0x7fb62807f0b0 2024-09-21T06:47:05.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.849+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 --> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb6480c5e60 con 0x7fb62807f0b0 2024-09-21T06:47:05.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.849+0000 7fb63ffff640 1 -- 172.21.15.81:0/1587722788 <== osd.1 v2:172.21.15.81:6824/3679651054 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb6480c5e60 con 0x7fb62807f0b0 2024-09-21T06:47:05.851 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:05.852 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:05.852 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7fb62807f0b0 msgr2=0x7fb628081540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:6824/3679651054,v1:172.21.15.81:6825/3679651054] conn(0x7fb62807f0b0 0x7fb628081540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb628078bc0 msgr2=0x7fb62807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fb628078bc0 0x7fb62807b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb638034000 tx=0x7fb638004730 comp rx=0 tx=0).stop 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb648154a30 msgr2=0x7fb6481f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 --2- 172.21.15.81:0/1587722788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb648154a30 0x7fb6481f6cc0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb64000c700 tx=0x7fb64000cbc0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb6477fe640 1 -- 172.21.15.81:0/1587722788 reap_dead start 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 shutdown_connections 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 >> 172.21.15.81:0/1587722788 conn(0x7fb6480b3f60 msgr2=0x7fb64815c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 shutdown_connections 2024-09-21T06:47:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.850+0000 7fb64d2bd640 1 -- 172.21.15.81:0/1587722788 wait complete. 2024-09-21T06:47:05.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T06:47:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.974+0000 7f34f7952640 1 -- 172.21.15.81:0/3082389410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 msgr2=0x7f34f006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.974+0000 7f34f7952640 1 --2- 172.21.15.81:0/3082389410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f006eac0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f34f00d22b0 tx=0x7f34e002a3d0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.974+0000 7f34f7952640 1 -- 172.21.15.81:0/3082389410 shutdown_connections 2024-09-21T06:47:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.974+0000 7f34f7952640 1 --2- 172.21.15.81:0/3082389410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f006eac0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.974+0000 7f34f7952640 1 -- 172.21.15.81:0/3082389410 >> 172.21.15.81:0/3082389410 conn(0x7f34f00740a0 msgr2=0x7f34f00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.974+0000 7f34f7952640 1 -- 172.21.15.81:0/3082389410 shutdown_connections 2024-09-21T06:47:05.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.974+0000 7f34f7952640 1 -- 172.21.15.81:0/3082389410 wait complete. 2024-09-21T06:47:05.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.975+0000 7f34f7952640 1 Processor -- start 2024-09-21T06:47:05.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.975+0000 7f34f7952640 1 -- start start 2024-09-21T06:47:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f7952640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34f006f000 0x7f34f0156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f7952640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f0152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f7952640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34f01539d0 0x7f34f0152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f7952640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0167c10 con 0x7f34f00d15b0 2024-09-21T06:47:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f7952640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0167a90 con 0x7f34f01539d0 2024-09-21T06:47:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f7952640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f34f0167d90 con 0x7f34f006f000 2024-09-21T06:47:05.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f0152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f0152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60834/0 (socket says 172.21.15.81:60834) 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 -- 172.21.15.81:0/2113920886 learned_addr learned my addr 172.21.15.81:0/2113920886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f56ee640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34f006f000 0x7f34f0156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f5eef640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34f01539d0 0x7f34f0152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 -- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34f006f000 msgr2=0x7f34f0156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34f006f000 0x7f34f0156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 -- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34f01539d0 msgr2=0x7f34f0152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34f01539d0 0x7f34f0152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 -- 172.21.15.81:0/2113920886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f00cf600 con 0x7f34f00d15b0 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f5eef640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34f01539d0 0x7f34f0152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34f4eed640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f0152660 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f34e00098f0 tx=0x7f34e0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.977+0000 7f34e5ffb640 1 -- 172.21.15.81:0/2113920886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0031d60 con 0x7f34f00d15b0 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.978+0000 7f34e5ffb640 1 -- 172.21.15.81:0/2113920886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34e0033e10 con 0x7f34f00d15b0 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.978+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f009d5e0 con 0x7f34f00d15b0 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.978+0000 7f34e5ffb640 1 -- 172.21.15.81:0/2113920886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0005260 con 0x7f34f00d15b0 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.978+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f009db80 con 0x7f34f00d15b0 2024-09-21T06:47:05.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.979+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f01f7890 con 0x7f34f00d15b0 2024-09-21T06:47:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.980+0000 7f34e5ffb640 1 -- 172.21.15.81:0/2113920886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34e0005400 con 0x7f34f00d15b0 2024-09-21T06:47:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.980+0000 7f34e5ffb640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34d4078bc0 0x7f34d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.980+0000 7f34e5ffb640 1 -- 172.21.15.81:0/2113920886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f34e00bbe20 con 0x7f34f00d15b0 2024-09-21T06:47:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.980+0000 7f34f56ee640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34d4078bc0 0x7f34d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.981+0000 7f34f56ee640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34d4078bc0 0x7f34d407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006fd0 tx=0x7f34ec009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:05.984+0000 7f34e5ffb640 1 -- 172.21.15.81:0/2113920886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f34f00cf600 con 0x7f34f00d15b0 2024-09-21T06:47:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.164+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f34f006eac0 con 0x7f34d4078bc0 2024-09-21T06:47:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.164+0000 7f34e5ffb640 1 -- 172.21.15.81:0/2113920886 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f34f006eac0 con 0x7f34d4078bc0 2024-09-21T06:47:06.166 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T06:47:06.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34d4078bc0 msgr2=0x7f34d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34d4078bc0 0x7f34d407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f34ec006fd0 tx=0x7f34ec009060 comp rx=0 tx=0).stop 2024-09-21T06:47:06.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 msgr2=0x7f34f0152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f0152660 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f34e00098f0 tx=0x7f34e0033c20 comp rx=0 tx=0).stop 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 shutdown_connections 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f34d4078bc0 0x7f34d407b0d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34f01539d0 0x7f34f0152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34f00d15b0 0x7f34f0152660 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 --2- 172.21.15.81:0/2113920886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f34f006f000 0x7f34f0156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 >> 172.21.15.81:0/2113920886 conn(0x7f34f00740a0 msgr2=0x7f34f00b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 shutdown_connections 2024-09-21T06:47:06.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.167+0000 7f34f7952640 1 -- 172.21.15.81:0/2113920886 wait complete. 2024-09-21T06:47:06.180 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T06:47:06.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.295+0000 7f39d2313640 1 -- 172.21.15.81:0/693543691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc0d14f0 msgr2=0x7f39cc15e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.295+0000 7f39d2313640 1 --2- 172.21.15.81:0/693543691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc0d14f0 0x7f39cc15e8f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009830 tx=0x7f39c002a480 comp rx=0 tx=0).stop 2024-09-21T06:47:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.295+0000 7f39d2313640 1 -- 172.21.15.81:0/693543691 shutdown_connections 2024-09-21T06:47:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.295+0000 7f39d2313640 1 --2- 172.21.15.81:0/693543691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc0d14f0 0x7f39cc15e8f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.295+0000 7f39d2313640 1 -- 172.21.15.81:0/693543691 >> 172.21.15.81:0/693543691 conn(0x7f39cc0b7320 msgr2=0x7f39cc0b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.295+0000 7f39d2313640 1 -- 172.21.15.81:0/693543691 shutdown_connections 2024-09-21T06:47:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.295+0000 7f39d2313640 1 -- 172.21.15.81:0/693543691 wait complete. 2024-09-21T06:47:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.297+0000 7f39d2313640 1 Processor -- start 2024-09-21T06:47:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.297+0000 7f39d2313640 1 -- start start 2024-09-21T06:47:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d2313640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39cc0cf1c0 0x7f39cc0b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d2313640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39cc162ed0 0x7f39cc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d2313640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc161aa0 0x7f39cc15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d2313640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc0d2f40 con 0x7f39cc161aa0 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d2313640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc0d2dc0 con 0x7f39cc162ed0 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d2313640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f39cc0d30c0 con 0x7f39cc0cf1c0 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d08b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc161aa0 0x7f39cc15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d08b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc161aa0 0x7f39cc15efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60848/0 (socket says 172.21.15.81:60848) 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39d08b0640 1 -- 172.21.15.81:0/1107914852 learned_addr learned my addr 172.21.15.81:0/1107914852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39cb7fe640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39cc162ed0 0x7f39cc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.298+0000 7f39cbfff640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39cc0cf1c0 0x7f39cc0b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d08b0640 1 -- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39cc0cf1c0 msgr2=0x7f39cc0b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d08b0640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39cc0cf1c0 0x7f39cc0b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d08b0640 1 -- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39cc162ed0 msgr2=0x7f39cc0b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d08b0640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39cc162ed0 0x7f39cc0b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d08b0640 1 -- 172.21.15.81:0/1107914852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc0b3e60 con 0x7f39cc161aa0 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39cbfff640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39cc0cf1c0 0x7f39cc0b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d08b0640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc161aa0 0x7f39cc15efc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f39c400b9a0 tx=0x7f39c400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4019070 con 0x7f39cc161aa0 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39c400cc90 con 0x7f39cc161aa0 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc0b4140 con 0x7f39cc161aa0 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c40146a0 con 0x7f39cc161aa0 2024-09-21T06:47:06.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.299+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc0b4700 con 0x7f39cc161aa0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.300+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39cc0d3590 con 0x7f39cc161aa0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.301+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39c401c070 con 0x7f39cc161aa0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.301+0000 7f39c8ff9640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f39b8078b90 0x7f39b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.301+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f39c409acd0 con 0x7f39cc161aa0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.302+0000 7f39c8ff9640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7f39b807f080 0x7f39b8081510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.302+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 --> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39b8081be0 con 0x7f39b807f080 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.302+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f39c409b160 con 0x7f39cc161aa0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.302+0000 7f39cbfff640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f39b8078b90 0x7f39b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.302+0000 7f39cb7fe640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7f39b807f080 0x7f39b8081510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.302+0000 7f39cb7fe640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7f39b807f080 0x7f39b8081510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.302+0000 7f39cbfff640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f39b8078b90 0x7f39b807b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f39bc007a50 tx=0x7f39bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.303+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== osd.2 v2:172.21.15.81:6800/1250280053 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39b8081be0 con 0x7f39b807f080 2024-09-21T06:47:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.315+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 --> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f39cc0b8080 con 0x7f39b807f080 2024-09-21T06:47:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.315+0000 7f39c8ff9640 1 -- 172.21.15.81:0/1107914852 <== osd.2 v2:172.21.15.81:6800/1250280053 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f39cc0b8080 con 0x7f39b807f080 2024-09-21T06:47:06.317 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:06.318 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:06.318 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7f39b807f080 msgr2=0x7f39b8081510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:6800/1250280053,v1:172.21.15.81:6801/1250280053] conn(0x7f39b807f080 0x7f39b8081510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f39b8078b90 msgr2=0x7f39b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f39b8078b90 0x7f39b807b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f39bc007a50 tx=0x7f39bc009040 comp rx=0 tx=0).stop 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc161aa0 msgr2=0x7f39cc15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 --2- 172.21.15.81:0/1107914852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39cc161aa0 0x7f39cc15efc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f39c400b9a0 tx=0x7f39c400be60 comp rx=0 tx=0).stop 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d08b0640 1 -- 172.21.15.81:0/1107914852 reap_dead start 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 shutdown_connections 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 >> 172.21.15.81:0/1107914852 conn(0x7f39cc0b7320 msgr2=0x7f39cc15dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 shutdown_connections 2024-09-21T06:47:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.316+0000 7f39d2313640 1 -- 172.21.15.81:0/1107914852 wait complete. 2024-09-21T06:47:06.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.437+0000 7f317120e640 1 -- 172.21.15.81:0/2307717761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c15c450 msgr2=0x7f316c0d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.437+0000 7f317120e640 1 --2- 172.21.15.81:0/2307717761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c15c450 0x7f316c0d3220 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f315c009830 tx=0x7f315c02a510 comp rx=0 tx=0).stop 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.437+0000 7f317120e640 1 -- 172.21.15.81:0/2307717761 shutdown_connections 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.437+0000 7f317120e640 1 --2- 172.21.15.81:0/2307717761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f316c0d41a0 0x7f316c0d45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.437+0000 7f317120e640 1 --2- 172.21.15.81:0/2307717761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c15c450 0x7f316c0d3220 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.437+0000 7f317120e640 1 -- 172.21.15.81:0/2307717761 >> 172.21.15.81:0/2307717761 conn(0x7f316c0b7330 msgr2=0x7f316c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.438+0000 7f317120e640 1 -- 172.21.15.81:0/2307717761 shutdown_connections 2024-09-21T06:47:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.438+0000 7f317120e640 1 -- 172.21.15.81:0/2307717761 wait complete. 2024-09-21T06:47:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.439+0000 7f317120e640 1 Processor -- start 2024-09-21T06:47:06.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.439+0000 7f317120e640 1 -- start start 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f317120e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c0d41a0 0x7f316c14a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f317120e640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f316c15c450 0x7f316c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f317120e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f316c15eda0 0x7f316c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f317120e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f316c0b35c0 con 0x7f316c0d41a0 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f317120e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f316c0b3440 con 0x7f316c15eda0 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f317120e640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f316c0b3740 con 0x7f316c15c450 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c0d41a0 0x7f316c14a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c0d41a0 0x7f316c14a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60866/0 (socket says 172.21.15.81:60866) 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 -- 172.21.15.81:0/3557660741 learned_addr learned my addr 172.21.15.81:0/3557660741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 -- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f316c15c450 msgr2=0x7f316c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f316c15c450 0x7f316c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 -- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f316c15eda0 msgr2=0x7f316c0c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f316c15eda0 0x7f316c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 -- 172.21.15.81:0/3557660741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c06fbd0 con 0x7f316c0d41a0 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f316ad9d640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c0d41a0 0x7f316c14a7a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f315c009950 tx=0x7f315c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f31637fe640 1 -- 172.21.15.81:0/3557660741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c005c90 con 0x7f316c0d41a0 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f31637fe640 1 -- 172.21.15.81:0/3557660741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f315c031e50 con 0x7f316c0d41a0 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f31637fe640 1 -- 172.21.15.81:0/3557660741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c005260 con 0x7f316c0d41a0 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.441+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c0ca590 con 0x7f316c0d41a0 2024-09-21T06:47:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.442+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c0ca290 con 0x7f316c0d41a0 2024-09-21T06:47:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.443+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c0caab0 con 0x7f316c0d41a0 2024-09-21T06:47:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.443+0000 7f31637fe640 1 -- 172.21.15.81:0/3557660741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f315c005400 con 0x7f316c0d41a0 2024-09-21T06:47:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.444+0000 7f31637fe640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f314c078b90 0x7f314c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.444+0000 7f31637fe640 1 -- 172.21.15.81:0/3557660741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f315c0bbd00 con 0x7f316c0d41a0 2024-09-21T06:47:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.444+0000 7f3163fff640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f314c078b90 0x7f314c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.445+0000 7f3163fff640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f314c078b90 0x7f314c07b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f316c153010 tx=0x7f3154007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.448+0000 7f31637fe640 1 -- 172.21.15.81:0/3557660741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f316c0caab0 con 0x7f316c0d41a0 2024-09-21T06:47:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.624+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f316c0d3220 con 0x7f314c078b90 2024-09-21T06:47:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.625+0000 7f31637fe640 1 -- 172.21.15.81:0/3557660741 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f316c0d3220 con 0x7f314c078b90 2024-09-21T06:47:06.627 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T06:47:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f314c078b90 msgr2=0x7f314c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f314c078b90 0x7f314c07b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f316c153010 tx=0x7f3154007930 comp rx=0 tx=0).stop 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c0d41a0 msgr2=0x7f316c14a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c0d41a0 0x7f316c14a7a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f315c009950 tx=0x7f315c033c20 comp rx=0 tx=0).stop 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 shutdown_connections 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f314c078b90 0x7f314c07b0a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f316c15c450 0x7f316c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f316c15eda0 0x7f316c0c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 --2- 172.21.15.81:0/3557660741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c0d41a0 0x7f316c14a7a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 >> 172.21.15.81:0/3557660741 conn(0x7f316c0b7330 msgr2=0x7f316c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 shutdown_connections 2024-09-21T06:47:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.627+0000 7f317120e640 1 -- 172.21.15.81:0/3557660741 wait complete. 2024-09-21T06:47:06.640 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T06:47:06.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.755+0000 7fe289590640 1 -- 172.21.15.81:0/888223481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26c004800 msgr2=0x7fe26c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.755+0000 7fe289590640 1 --2- 172.21.15.81:0/888223481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26c004800 0x7fe26c004c10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fe278001710 tx=0x7fe26c005830 comp rx=0 tx=0).stop 2024-09-21T06:47:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.755+0000 7fe289590640 1 -- 172.21.15.81:0/888223481 shutdown_connections 2024-09-21T06:47:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.755+0000 7fe289590640 1 --2- 172.21.15.81:0/888223481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe26c004800 0x7fe26c004c10 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.755+0000 7fe289590640 1 -- 172.21.15.81:0/888223481 >> 172.21.15.81:0/888223481 conn(0x7fe2840b7330 msgr2=0x7fe2840b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.755+0000 7fe289590640 1 -- 172.21.15.81:0/888223481 shutdown_connections 2024-09-21T06:47:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.755+0000 7fe289590640 1 -- 172.21.15.81:0/888223481 wait complete. 2024-09-21T06:47:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.757+0000 7fe289590640 1 Processor -- start 2024-09-21T06:47:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.757+0000 7fe289590640 1 -- start start 2024-09-21T06:47:06.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe289590640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe26c004800 0x7fe28406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe289590640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2840b4630 0x7fe2840b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe289590640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840b64d0 0x7fe2841f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe289590640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840b9b20 con 0x7fe2840b4630 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe289590640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840b99a0 con 0x7fe2840b64d0 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe289590640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fe2840b9ca0 con 0x7fe26c004800 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2840b4630 0x7fe2840b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2840b4630 0x7fe2840b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60888/0 (socket says 172.21.15.81:60888) 2024-09-21T06:47:06.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 -- 172.21.15.81:0/2105364950 learned_addr learned my addr 172.21.15.81:0/2105364950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe282ffd640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe26c004800 0x7fe28406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2837fe640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840b64d0 0x7fe2841f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 -- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe26c004800 msgr2=0x7fe28406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe26c004800 0x7fe28406f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 -- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840b64d0 msgr2=0x7fe2841f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2840b64d0 0x7fe2841f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 -- 172.21.15.81:0/2105364950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2840b68e0 con 0x7fe2840b4630 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe2827fc640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2840b4630 0x7fe2840b5f90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe278001830 tx=0x7fe2780062f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278042070 con 0x7fe2840b4630 2024-09-21T06:47:06.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe278039070 con 0x7fe2840b4630 2024-09-21T06:47:06.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2841e9060 con 0x7fe2840b4630 2024-09-21T06:47:06.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.759+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278003bd0 con 0x7fe2840b4630 2024-09-21T06:47:06.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.760+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2841e9620 con 0x7fe2840b4630 2024-09-21T06:47:06.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.760+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2840d4860 con 0x7fe2840b4630 2024-09-21T06:47:06.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.761+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe27803b070 con 0x7fe2840b4630 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.762+0000 7fe26b7fe640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe270078b90 0x7fe27007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.762+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7fe2780ba750 con 0x7fe2840b4630 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.762+0000 7fe26b7fe640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fe27007f080 0x7fe270081510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.762+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 --> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe270081be0 con 0x7fe27007f080 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.762+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fe2780babe0 con 0x7fe2840b4630 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.762+0000 7fe282ffd640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe270078b90 0x7fe27007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.762+0000 7fe2837fe640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fe27007f080 0x7fe270081510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.763+0000 7fe2837fe640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fe27007f080 0x7fe270081510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.763+0000 7fe282ffd640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe270078b90 0x7fe27007b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2740018a0 tx=0x7fe274001d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.763+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== osd.3 v2:172.21.15.81:6808/1925632354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe270081be0 con 0x7fe27007f080 2024-09-21T06:47:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.775+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 --> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe2841e8e10 con 0x7fe27007f080 2024-09-21T06:47:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe26b7fe640 1 -- 172.21.15.81:0/2105364950 <== osd.3 v2:172.21.15.81:6808/1925632354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe2841e8e10 con 0x7fe27007f080 2024-09-21T06:47:06.778 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:06.778 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:06.778 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fe27007f080 msgr2=0x7fe270081510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:6808/1925632354,v1:172.21.15.81:6809/1925632354] conn(0x7fe27007f080 0x7fe270081510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe270078b90 msgr2=0x7fe27007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fe270078b90 0x7fe27007b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2740018a0 tx=0x7fe274001d90 comp rx=0 tx=0).stop 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2840b4630 msgr2=0x7fe2840b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 --2- 172.21.15.81:0/2105364950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2840b4630 0x7fe2840b5f90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe278001830 tx=0x7fe2780062f0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe2837fe640 1 -- 172.21.15.81:0/2105364950 reap_dead start 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 shutdown_connections 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 >> 172.21.15.81:0/2105364950 conn(0x7fe2840b7330 msgr2=0x7fe2840c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 shutdown_connections 2024-09-21T06:47:06.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.776+0000 7fe289590640 1 -- 172.21.15.81:0/2105364950 wait complete. 2024-09-21T06:47:06.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T06:47:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 -- 172.21.15.81:0/3453446420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 msgr2=0x7f9b080b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/3453446420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b080b1b90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009860 tx=0x7f9af802a540 comp rx=0 tx=0).stop 2024-09-21T06:47:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 -- 172.21.15.81:0/3453446420 shutdown_connections 2024-09-21T06:47:06.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/3453446420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b080b1b90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/3453446420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b080d19a0 0x7f9b0815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 -- 172.21.15.81:0/3453446420 >> 172.21.15.81:0/3453446420 conn(0x7f9b080d25e0 msgr2=0x7f9b080d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:06.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 -- 172.21.15.81:0/3453446420 shutdown_connections 2024-09-21T06:47:06.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.900+0000 7f9b0f50b640 1 -- 172.21.15.81:0/3453446420 wait complete. 2024-09-21T06:47:06.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.902+0000 7f9b0f50b640 1 Processor -- start 2024-09-21T06:47:06.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.902+0000 7f9b0f50b640 1 -- start start 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0f50b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b080b20d0 0x7f9b0814a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0f50b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b080d19a0 0x7f9b08157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0f50b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b081582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0f50b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08072ec0 con 0x7f9b081601c0 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0f50b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08072d40 con 0x7f9b080b20d0 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0f50b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f9b08073040 con 0x7f9b080d19a0 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b081582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b081582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60906/0 (socket says 172.21.15.81:60906) 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 -- 172.21.15.81:0/2864210850 learned_addr learned my addr 172.21.15.81:0/2864210850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0caa6640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b080d19a0 0x7f9b08157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0d2a7640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b080b20d0 0x7f9b0814a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 -- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b080d19a0 msgr2=0x7f9b08157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b080d19a0 0x7f9b08157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 -- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b080b20d0 msgr2=0x7f9b0814a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b080b20d0 0x7f9b0814a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 -- 172.21.15.81:0/2864210850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b080cbb80 con 0x7f9b081601c0 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0caa6640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b080d19a0 0x7f9b08157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.903+0000 7f9b0daa8640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b081582a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000caa0 tx=0x7f9b0000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.904+0000 7f9afdffb640 1 -- 172.21.15.81:0/2864210850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00016020 con 0x7f9b081601c0 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.904+0000 7f9afdffb640 1 -- 172.21.15.81:0/2864210850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b0000acf0 con 0x7f9b081601c0 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.904+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b080cbe60 con 0x7f9b081601c0 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.904+0000 7f9afdffb640 1 -- 172.21.15.81:0/2864210850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00012680 con 0x7f9b081601c0 2024-09-21T06:47:06.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.904+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b080cc140 con 0x7f9b081601c0 2024-09-21T06:47:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.905+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b081f7920 con 0x7f9b081601c0 2024-09-21T06:47:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.906+0000 7f9afdffb640 1 -- 172.21.15.81:0/2864210850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b00019020 con 0x7f9b081601c0 2024-09-21T06:47:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.906+0000 7f9afdffb640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9aec078b90 0x7f9aec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.907+0000 7f9afdffb640 1 -- 172.21.15.81:0/2864210850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f9b0009b1c0 con 0x7f9b081601c0 2024-09-21T06:47:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.907+0000 7f9b0d2a7640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9aec078b90 0x7f9aec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:06.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.907+0000 7f9b0d2a7640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9aec078b90 0x7f9aec07b0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400a490 tx=0x7f9b0400a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:06.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:06.911+0000 7f9afdffb640 1 -- 172.21.15.81:0/2864210850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9b00020020 con 0x7f9b081601c0 2024-09-21T06:47:07.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.088+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f9b080734f0 con 0x7f9aec078b90 2024-09-21T06:47:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.089+0000 7f9afdffb640 1 -- 172.21.15.81:0/2864210850 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9b080734f0 con 0x7f9aec078b90 2024-09-21T06:47:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T06:47:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9aec078b90 msgr2=0x7f9aec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9aec078b90 0x7f9aec07b0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400a490 tx=0x7f9b0400a420 comp rx=0 tx=0).stop 2024-09-21T06:47:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 msgr2=0x7f9b081582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b081582a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000caa0 tx=0x7f9b0000cf60 comp rx=0 tx=0).stop 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 shutdown_connections 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f9aec078b90 0x7f9aec07b0a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b080d19a0 0x7f9b08157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b081601c0 0x7f9b081582a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 --2- 172.21.15.81:0/2864210850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b080b20d0 0x7f9b0814a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 >> 172.21.15.81:0/2864210850 conn(0x7f9b080d25e0 msgr2=0x7f9b0815c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 shutdown_connections 2024-09-21T06:47:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.091+0000 7f9b0f50b640 1 -- 172.21.15.81:0/2864210850 wait complete. 2024-09-21T06:47:07.104 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T06:47:07.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 -- 172.21.15.81:0/3554020162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 msgr2=0x7f15540b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 --2- 172.21.15.81:0/3554020162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 0x7f15540b1ef0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f15540749f0 tx=0x7f155002aac0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 -- 172.21.15.81:0/3554020162 shutdown_connections 2024-09-21T06:47:07.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 --2- 172.21.15.81:0/3554020162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 0x7f15540b1ef0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 --2- 172.21.15.81:0/3554020162 >> v2:172.21.15.89:3300/0 conn(0x7f15540d18c0 0x7f15541533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 -- 172.21.15.81:0/3554020162 >> 172.21.15.81:0/3554020162 conn(0x7f15540cec30 msgr2=0x7f15540cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 -- 172.21.15.81:0/3554020162 shutdown_connections 2024-09-21T06:47:07.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.221+0000 7f155b620640 1 -- 172.21.15.81:0/3554020162 wait complete. 2024-09-21T06:47:07.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.223+0000 7f155b620640 1 Processor -- start 2024-09-21T06:47:07.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.223+0000 7f155b620640 1 -- start start 2024-09-21T06:47:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f155b620640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 0x7f15541f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f155b620640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15540cc800 0x7f15541f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f155b620640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15540d18c0 0x7f15541f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f155b620640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15540b2950 con 0x7f15540b1ae0 2024-09-21T06:47:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f155b620640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f15540b27d0 con 0x7f15540d18c0 2024-09-21T06:47:07.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f155b620640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f15540b2ad0 con 0x7f15540cc800 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 0x7f15541f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 0x7f15541f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60926/0 (socket says 172.21.15.81:60926) 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 -- 172.21.15.81:0/36893085 learned_addr learned my addr 172.21.15.81:0/36893085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f1559bbd640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15540d18c0 0x7f15541f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f1558bbb640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15540cc800 0x7f15541f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 -- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15540cc800 msgr2=0x7f15541f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15540cc800 0x7f15541f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 -- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15540d18c0 msgr2=0x7f15541f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15540d18c0 0x7f15541f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 -- 172.21.15.81:0/36893085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15541f3f40 con 0x7f15540b1ae0 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f1559bbd640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15540d18c0 0x7f15541f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.224+0000 7f15593bc640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 0x7f15541f2fd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f154c00d770 tx=0x7f154c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.225+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c017070 con 0x7f15540b1ae0 2024-09-21T06:47:07.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.225+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f154c009d20 con 0x7f15540b1ae0 2024-09-21T06:47:07.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.225+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15541f4220 con 0x7f15540b1ae0 2024-09-21T06:47:07.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.225+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c0106c0 con 0x7f15540b1ae0 2024-09-21T06:47:07.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.225+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15541f47e0 con 0x7f15540b1ae0 2024-09-21T06:47:07.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.226+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f15541f4bc0 con 0x7f15540b1ae0 2024-09-21T06:47:07.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.227+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f154c01a070 con 0x7f15540b1ae0 2024-09-21T06:47:07.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.227+0000 7f1549ffb640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1538078b90 0x7f153807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.227+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f154c09b260 con 0x7f15540b1ae0 2024-09-21T06:47:07.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.227+0000 7f1549ffb640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f153807f080 0x7f1538081510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.227+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 --> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f154c026e50 con 0x7f153807f080 2024-09-21T06:47:07.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.227+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f154c09b6f0 con 0x7f15540b1ae0 2024-09-21T06:47:07.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.227+0000 7f1558bbb640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1538078b90 0x7f153807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.228+0000 7f1559bbd640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f153807f080 0x7f1538081510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.228+0000 7f1558bbb640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1538078b90 0x7f153807b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15540b1940 tx=0x7f1544009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.228+0000 7f1559bbd640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f153807f080 0x7f1538081510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.229+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== osd.4 v2:172.21.15.89:6802/1367095570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f154c026e50 con 0x7f153807f080 2024-09-21T06:47:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.241+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 --> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f15540b1ef0 con 0x7f153807f080 2024-09-21T06:47:07.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f1549ffb640 1 -- 172.21.15.81:0/36893085 <== osd.4 v2:172.21.15.89:6802/1367095570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f15540b1ef0 con 0x7f153807f080 2024-09-21T06:47:07.244 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:07.244 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:07.244 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f153807f080 msgr2=0x7f1538081510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6802/1367095570,v1:172.21.15.89:6803/1367095570] conn(0x7f153807f080 0x7f1538081510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1538078b90 msgr2=0x7f153807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f1538078b90 0x7f153807b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f15540b1940 tx=0x7f1544009040 comp rx=0 tx=0).stop 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 msgr2=0x7f15541f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 --2- 172.21.15.81:0/36893085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15540b1ae0 0x7f15541f2fd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f154c00d770 tx=0x7f154c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f1559bbd640 1 -- 172.21.15.81:0/36893085 reap_dead start 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 shutdown_connections 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 >> 172.21.15.81:0/36893085 conn(0x7f15540cec30 msgr2=0x7f1554070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 shutdown_connections 2024-09-21T06:47:07.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.242+0000 7f155b620640 1 -- 172.21.15.81:0/36893085 wait complete. 2024-09-21T06:47:07.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.366+0000 7fc451913640 1 -- 172.21.15.81:0/1962048523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc438004d40 msgr2=0x7fc438005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.366+0000 7fc451913640 1 --2- 172.21.15.81:0/1962048523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc438004d40 0x7fc438005150 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc444009ed0 tx=0x7fc438005830 comp rx=0 tx=0).stop 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.366+0000 7fc44b7fe640 1 -- 172.21.15.81:0/1962048523 reap_dead start 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.366+0000 7fc451913640 1 -- 172.21.15.81:0/1962048523 shutdown_connections 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.366+0000 7fc451913640 1 -- 172.21.15.81:0/1962048523 >> 172.21.15.81:0/1962048523 conn(0x7fc44c0b7330 msgr2=0x7fc44c0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.366+0000 7fc451913640 1 -- 172.21.15.81:0/1962048523 shutdown_connections 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.366+0000 7fc451913640 1 -- 172.21.15.81:0/1962048523 wait complete. 2024-09-21T06:47:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.368+0000 7fc451913640 1 Processor -- start 2024-09-21T06:47:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.368+0000 7fc451913640 1 -- start start 2024-09-21T06:47:07.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc451913640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc438004d40 0x7fc44c153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc451913640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc44c1477c0 0x7fc44c1f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc451913640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c1f9070 0x7fc44c0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc451913640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0d4860 con 0x7fc44c1f9070 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc451913640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0d46e0 con 0x7fc438004d40 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc451913640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c0d49e0 con 0x7fc44c1477c0 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c1f9070 0x7fc44c0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc44b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c1f9070 0x7fc44c0b5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60948/0 (socket says 172.21.15.81:60948) 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc44b7fe640 1 -- 172.21.15.81:0/251015274 learned_addr learned my addr 172.21.15.81:0/251015274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc443fff640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc44c1477c0 0x7fc44c1f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.369+0000 7fc44affd640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc438004d40 0x7fc44c153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc44b7fe640 1 -- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc44c1477c0 msgr2=0x7fc44c1f8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc44b7fe640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc44c1477c0 0x7fc44c1f8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc44b7fe640 1 -- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc438004d40 msgr2=0x7fc44c153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc44b7fe640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc438004d40 0x7fc44c153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc44b7fe640 1 -- 172.21.15.81:0/251015274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c1f98a0 con 0x7fc44c1f9070 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc44affd640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc438004d40 0x7fc44c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc44b7fe640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c1f9070 0x7fc44c0b5ff0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc444036040 tx=0x7fc444033de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc448ff9640 1 -- 172.21.15.81:0/251015274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444038040 con 0x7fc44c1f9070 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc448ff9640 1 -- 172.21.15.81:0/251015274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc444003c60 con 0x7fc44c1f9070 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c146ce0 con 0x7fc44c1f9070 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc448ff9640 1 -- 172.21.15.81:0/251015274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444009ad0 con 0x7fc44c1f9070 2024-09-21T06:47:07.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.370+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c0b6530 con 0x7fc44c1f9070 2024-09-21T06:47:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.371+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c08d110 con 0x7fc44c1f9070 2024-09-21T06:47:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.372+0000 7fc448ff9640 1 -- 172.21.15.81:0/251015274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc444045060 con 0x7fc44c1f9070 2024-09-21T06:47:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.372+0000 7fc448ff9640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc42c078bc0 0x7fc42c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.372+0000 7fc448ff9640 1 -- 172.21.15.81:0/251015274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7fc4440bae40 con 0x7fc44c1f9070 2024-09-21T06:47:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.372+0000 7fc44affd640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc42c078bc0 0x7fc42c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.373+0000 7fc44affd640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc42c078bc0 0x7fc42c07b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc43c001860 tx=0x7fc43c001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.377+0000 7fc448ff9640 1 -- 172.21.15.81:0/251015274 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc44c08d110 con 0x7fc44c1f9070 2024-09-21T06:47:07.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.553+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc44c154380 con 0x7fc42c078bc0 2024-09-21T06:47:07.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.554+0000 7fc448ff9640 1 -- 172.21.15.81:0/251015274 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc43c0064f0 con 0x7fc42c078bc0 2024-09-21T06:47:07.556 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc42c078bc0 msgr2=0x7fc42c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc42c078bc0 0x7fc42c07b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc43c001860 tx=0x7fc43c001650 comp rx=0 tx=0).stop 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c1f9070 msgr2=0x7fc44c0b5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c1f9070 0x7fc44c0b5ff0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc444036040 tx=0x7fc444033de0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 shutdown_connections 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7fc42c078bc0 0x7fc42c07b0d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc44c1477c0 0x7fc44c1f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc44c1f9070 0x7fc44c0b5ff0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 --2- 172.21.15.81:0/251015274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc438004d40 0x7fc44c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 >> 172.21.15.81:0/251015274 conn(0x7fc44c0b7330 msgr2=0x7fc44c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 shutdown_connections 2024-09-21T06:47:07.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.556+0000 7fc451913640 1 -- 172.21.15.81:0/251015274 wait complete. 2024-09-21T06:47:07.570 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T06:47:07.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:07.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 -- 172.21.15.81:0/2221397449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64161ec0 msgr2=0x7f8d640cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 --2- 172.21.15.81:0/2221397449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64161ec0 0x7f8d640cf230 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8d640b9940 tx=0x7f8d4c02a4b0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 -- 172.21.15.81:0/2221397449 shutdown_connections 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 --2- 172.21.15.81:0/2221397449 >> v2:172.21.15.89:3300/0 conn(0x7f8d640cf770 0x7f8d640d2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 --2- 172.21.15.81:0/2221397449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64161ec0 0x7f8d640cf230 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 --2- 172.21.15.81:0/2221397449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d640b8f70 0x7f8d640b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 -- 172.21.15.81:0/2221397449 >> 172.21.15.81:0/2221397449 conn(0x7f8d640b7320 msgr2=0x7f8d640b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 -- 172.21.15.81:0/2221397449 shutdown_connections 2024-09-21T06:47:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.684+0000 7f8d6905c640 1 -- 172.21.15.81:0/2221397449 wait complete. 2024-09-21T06:47:07.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.686+0000 7f8d6905c640 1 Processor -- start 2024-09-21T06:47:07.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.686+0000 7f8d6905c640 1 -- start start 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.687+0000 7f8d6905c640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d640b8f70 0x7f8d6414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.687+0000 7f8d6905c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d640cf770 0x7f8d6406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.687+0000 7f8d6905c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d64161ec0 0x7f8d6406f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.687+0000 7f8d6905c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d640d13f0 con 0x7f8d640cf770 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.687+0000 7f8d6905c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f8d640d1270 con 0x7f8d64161ec0 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.687+0000 7f8d6905c640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f8d640d1570 con 0x7f8d640b8f70 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d640cf770 0x7f8d6406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d640cf770 0x7f8d6406ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60960/0 (socket says 172.21.15.81:60960) 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 -- 172.21.15.81:0/3520646430 learned_addr learned my addr 172.21.15.81:0/3520646430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d6359e640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d64161ec0 0x7f8d6406f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d62d9d640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d640b8f70 0x7f8d6414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 -- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d640b8f70 msgr2=0x7f8d6414f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d640b8f70 0x7f8d6414f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 -- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d64161ec0 msgr2=0x7f8d6406f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d64161ec0 0x7f8d6406f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 -- 172.21.15.81:0/3520646430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d641552f0 con 0x7f8d640cf770 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5a59c640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d640cf770 0x7f8d6406ef60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009230 tx=0x7f8d4c005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c03e030 con 0x7f8d640cf770 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d4c031780 con 0x7f8d640cf770 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6415b550 con 0x7f8d640cf770 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c035040 con 0x7f8d640cf770 2024-09-21T06:47:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.688+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6415bb10 con 0x7f8d640cf770 2024-09-21T06:47:07.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.689+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d640d5110 con 0x7f8d640cf770 2024-09-21T06:47:07.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.690+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d4c041030 con 0x7f8d640cf770 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.690+0000 7f8d5bfff640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8d44078b90 0x7f8d4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f8d4c0bb3d0 con 0x7f8d640cf770 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d5bfff640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8d4407f080 0x7f8d44081510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 --> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d4c02cea0 con 0x7f8d4407f080 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f8d4c0c2050 con 0x7f8d640cf770 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d62d9d640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8d44078b90 0x7f8d4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d6359e640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8d4407f080 0x7f8d44081510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d62d9d640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8d44078b90 0x7f8d4407b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d54005fd0 tx=0x7f8d5400b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.691+0000 7f8d6359e640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8d4407f080 0x7f8d44081510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.692+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== osd.5 v2:172.21.15.89:6810/2407243866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d4c02cea0 con 0x7f8d4407f080 2024-09-21T06:47:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.704+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 --> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8d6415b2c0 con 0x7f8d4407f080 2024-09-21T06:47:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.705+0000 7f8d5bfff640 1 -- 172.21.15.81:0/3520646430 <== osd.5 v2:172.21.15.89:6810/2407243866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8d6415b2c0 con 0x7f8d4407f080 2024-09-21T06:47:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:07.708 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.705+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8d4407f080 msgr2=0x7f8d44081510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.705+0000 7f8d6905c640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6810/2407243866,v1:172.21.15.89:6811/2407243866] conn(0x7f8d4407f080 0x7f8d44081510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8d44078b90 msgr2=0x7f8d4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f8d44078b90 0x7f8d4407b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8d54005fd0 tx=0x7f8d5400b260 comp rx=0 tx=0).stop 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d640cf770 msgr2=0x7f8d6406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 --2- 172.21.15.81:0/3520646430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d640cf770 0x7f8d6406ef60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009230 tx=0x7f8d4c005770 comp rx=0 tx=0).stop 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6359e640 1 -- 172.21.15.81:0/3520646430 reap_dead start 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 shutdown_connections 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 >> 172.21.15.81:0/3520646430 conn(0x7f8d640b7320 msgr2=0x7f8d640b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 shutdown_connections 2024-09-21T06:47:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.706+0000 7f8d6905c640 1 -- 172.21.15.81:0/3520646430 wait complete. 2024-09-21T06:47:07.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T06:47:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 -- 172.21.15.81:0/2411800042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415d2c0 msgr2=0x7f222415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 --2- 172.21.15.81:0/2411800042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415d2c0 0x7f222415d6d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f221c009ca0 tx=0x7f221c02aac0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 -- 172.21.15.81:0/2411800042 shutdown_connections 2024-09-21T06:47:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 --2- 172.21.15.81:0/2411800042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415d2c0 0x7f222415d6d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 --2- 172.21.15.81:0/2411800042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f222415a290 0x7f22241601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 -- 172.21.15.81:0/2411800042 >> 172.21.15.81:0/2411800042 conn(0x7f22240d25e0 msgr2=0x7f22240d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 -- 172.21.15.81:0/2411800042 shutdown_connections 2024-09-21T06:47:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.829+0000 7f2228a27640 1 -- 172.21.15.81:0/2411800042 wait complete. 2024-09-21T06:47:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.831+0000 7f2228a27640 1 Processor -- start 2024-09-21T06:47:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.831+0000 7f2228a27640 1 -- start start 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2228a27640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22240d19a0 0x7f2224149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2228a27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415a290 0x7f22240c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2228a27640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f222415d2c0 0x7f22241f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2228a27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2224072ec0 con 0x7f222415a290 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2228a27640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f2224072d40 con 0x7f22240d19a0 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2228a27640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f2224073040 con 0x7f222415d2c0 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2219d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415a290 0x7f22240c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2219d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415a290 0x7f22240c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60984/0 (socket says 172.21.15.81:60984) 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2219d9b640 1 -- 172.21.15.81:0/3159646041 learned_addr learned my addr 172.21.15.81:0/3159646041 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f2222d9d640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f222415d2c0 0x7f22241f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.832+0000 7f222259c640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22240d19a0 0x7f2224149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2219d9b640 1 -- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f222415d2c0 msgr2=0x7f22241f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2219d9b640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f222415d2c0 0x7f22241f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2219d9b640 1 -- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22240d19a0 msgr2=0x7f2224149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2219d9b640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22240d19a0 0x7f2224149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2219d9b640 1 -- 172.21.15.81:0/3159646041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22241f7ab0 con 0x7f222415a290 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2219d9b640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415a290 0x7f22240c6870 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f220c00d740 tx=0x7f220c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f221b7fe640 1 -- 172.21.15.81:0/3159646041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c017070 con 0x7f222415a290 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f221b7fe640 1 -- 172.21.15.81:0/3159646041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f220c009d20 con 0x7f222415a290 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22241f7d90 con 0x7f222415a290 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f221b7fe640 1 -- 172.21.15.81:0/3159646041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c0106c0 con 0x7f222415a290 2024-09-21T06:47:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.833+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22240c6070 con 0x7f222415a290 2024-09-21T06:47:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.834+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2224069f10 con 0x7f222415a290 2024-09-21T06:47:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.835+0000 7f221b7fe640 1 -- 172.21.15.81:0/3159646041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f220c01a070 con 0x7f222415a290 2024-09-21T06:47:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.835+0000 7f221b7fe640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2204078b90 0x7f220407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.835+0000 7f221b7fe640 1 -- 172.21.15.81:0/3159646041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f220c09ac60 con 0x7f222415a290 2024-09-21T06:47:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.835+0000 7f222259c640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2204078b90 0x7f220407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.836+0000 7f222259c640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2204078b90 0x7f220407b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2214001720 tx=0x7f2214009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:07.840+0000 7f221b7fe640 1 -- 172.21.15.81:0/3159646041 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f220c062c50 con 0x7f222415a290 2024-09-21T06:47:08.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.018+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f2224158f40 con 0x7f2204078b90 2024-09-21T06:47:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.019+0000 7f221b7fe640 1 -- 172.21.15.81:0/3159646041 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2214001d00 con 0x7f2204078b90 2024-09-21T06:47:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T06:47:08.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2204078b90 msgr2=0x7f220407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2204078b90 0x7f220407b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2214001720 tx=0x7f2214009040 comp rx=0 tx=0).stop 2024-09-21T06:47:08.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415a290 msgr2=0x7f22240c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415a290 0x7f22240c6870 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f220c00d740 tx=0x7f220c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 shutdown_connections 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f2204078b90 0x7f220407b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f222415d2c0 0x7f22241f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f222415a290 0x7f22240c6870 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 --2- 172.21.15.81:0/3159646041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22240d19a0 0x7f2224149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 >> 172.21.15.81:0/3159646041 conn(0x7f22240d25e0 msgr2=0x7f222415c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 shutdown_connections 2024-09-21T06:47:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.021+0000 7f2228a27640 1 -- 172.21.15.81:0/3159646041 wait complete. 2024-09-21T06:47:08.034 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T06:47:08.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.150+0000 7ff470ede640 1 -- 172.21.15.81:0/1739902403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 msgr2=0x7ff458004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.150+0000 7ff470ede640 1 --2- 172.21.15.81:0/1739902403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 0x7ff458004c10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff4540016c0 tx=0x7ff458005830 comp rx=0 tx=0).stop 2024-09-21T06:47:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.150+0000 7ff470ede640 1 -- 172.21.15.81:0/1739902403 shutdown_connections 2024-09-21T06:47:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.150+0000 7ff470ede640 1 --2- 172.21.15.81:0/1739902403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 0x7ff458004c10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.150+0000 7ff470ede640 1 -- 172.21.15.81:0/1739902403 >> 172.21.15.81:0/1739902403 conn(0x7ff46c0b7320 msgr2=0x7ff46c0b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.150+0000 7ff470ede640 1 -- 172.21.15.81:0/1739902403 shutdown_connections 2024-09-21T06:47:08.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.150+0000 7ff470ede640 1 -- 172.21.15.81:0/1739902403 wait complete. 2024-09-21T06:47:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.152+0000 7ff470ede640 1 Processor -- start 2024-09-21T06:47:08.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.152+0000 7ff470ede640 1 -- start start 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff470ede640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 0x7ff46c1f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff470ede640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c154f20 0x7ff46c149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff470ede640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff46c154960 0x7ff46c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff470ede640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c163050 con 0x7ff458004800 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff470ede640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c162ed0 con 0x7ff46c154f20 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff470ede640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff46c1631d0 con 0x7ff46c154960 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff46a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 0x7ff46c1f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff46a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 0x7ff46c1f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48898/0 (socket says 172.21.15.81:48898) 2024-09-21T06:47:08.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.153+0000 7ff46a59c640 1 -- 172.21.15.81:0/1111301939 learned_addr learned my addr 172.21.15.81:0/1111301939 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46ad9d640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff46c154960 0x7ff46c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46a59c640 1 -- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff46c154960 msgr2=0x7ff46c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff461d9b640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c154f20 0x7ff46c149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46a59c640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff46c154960 0x7ff46c0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46a59c640 1 -- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c154f20 msgr2=0x7ff46c149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46a59c640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c154f20 0x7ff46c149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46a59c640 1 -- 172.21.15.81:0/1111301939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c0c9b90 con 0x7ff458004800 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46ad9d640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff46c154960 0x7ff46c0cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff461d9b640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c154f20 0x7ff46c149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff46a59c640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 0x7ff46c1f5410 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006680 tx=0x7ff45c0066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011700 con 0x7ff458004800 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff45c016020 con 0x7ff458004800 2024-09-21T06:47:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46c0c9e70 con 0x7ff458004800 2024-09-21T06:47:08.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011b40 con 0x7ff458004800 2024-09-21T06:47:08.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.154+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46c0cb160 con 0x7ff458004800 2024-09-21T06:47:08.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.155+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff46c0d10d0 con 0x7ff458004800 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff45c011ce0 con 0x7ff458004800 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff4637fe640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff44c078b90 0x7ff44c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7ff45c09bd40 con 0x7ff458004800 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff4637fe640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7ff44c07f080 0x7ff44c081510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 --> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff44c081be0 con 0x7ff44c07f080 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7ff45c09c1d0 con 0x7ff458004800 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff461d9b640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff44c078b90 0x7ff44c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.156+0000 7ff46ad9d640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7ff44c07f080 0x7ff44c081510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.157+0000 7ff46ad9d640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7ff44c07f080 0x7ff44c081510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.157+0000 7ff461d9b640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff44c078b90 0x7ff44c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff454032000 tx=0x7ff454001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.158+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== osd.6 v2:172.21.15.89:6818/990103659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff44c081be0 con 0x7ff44c07f080 2024-09-21T06:47:08.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.170+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 --> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff46c0b8080 con 0x7ff44c07f080 2024-09-21T06:47:08.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff4637fe640 1 -- 172.21.15.81:0/1111301939 <== osd.6 v2:172.21.15.89:6818/990103659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff46c0b8080 con 0x7ff44c07f080 2024-09-21T06:47:08.173 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:08.173 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7ff44c07f080 msgr2=0x7ff44c081510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6818/990103659,v1:172.21.15.89:6819/990103659] conn(0x7ff44c07f080 0x7ff44c081510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff44c078b90 msgr2=0x7ff44c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff44c078b90 0x7ff44c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff454032000 tx=0x7ff454001190 comp rx=0 tx=0).stop 2024-09-21T06:47:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 msgr2=0x7ff46c1f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 --2- 172.21.15.81:0/1111301939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff458004800 0x7ff46c1f5410 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006680 tx=0x7ff45c0066b0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff46ad9d640 1 -- 172.21.15.81:0/1111301939 reap_dead start 2024-09-21T06:47:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 shutdown_connections 2024-09-21T06:47:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 >> 172.21.15.81:0/1111301939 conn(0x7ff46c0b7320 msgr2=0x7ff46c06ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 shutdown_connections 2024-09-21T06:47:08.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.171+0000 7ff470ede640 1 -- 172.21.15.81:0/1111301939 wait complete. 2024-09-21T06:47:08.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T06:47:08.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.296+0000 7efc79e8b640 1 -- 172.21.15.81:0/3459207235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415c450 msgr2=0x7efc740d3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.296+0000 7efc79e8b640 1 --2- 172.21.15.81:0/3459207235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415c450 0x7efc740d3220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efc740b93b0 tx=0x7efc6402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.296+0000 7efc79e8b640 1 -- 172.21.15.81:0/3459207235 shutdown_connections 2024-09-21T06:47:08.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.296+0000 7efc79e8b640 1 --2- 172.21.15.81:0/3459207235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415c450 0x7efc740d3220 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.296+0000 7efc79e8b640 1 -- 172.21.15.81:0/3459207235 >> 172.21.15.81:0/3459207235 conn(0x7efc740b7330 msgr2=0x7efc740b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.296+0000 7efc79e8b640 1 -- 172.21.15.81:0/3459207235 shutdown_connections 2024-09-21T06:47:08.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.296+0000 7efc79e8b640 1 -- 172.21.15.81:0/3459207235 wait complete. 2024-09-21T06:47:08.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.297+0000 7efc79e8b640 1 Processor -- start 2024-09-21T06:47:08.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.298+0000 7efc79e8b640 1 -- start start 2024-09-21T06:47:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc79e8b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc740d41a0 0x7efc740caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc79e8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc7415c450 0x7efc741f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc79e8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415eda0 0x7efc74153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc79e8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc740b3700 con 0x7efc7415c450 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc79e8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7efc740b3580 con 0x7efc7415eda0 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc79e8b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7efc740b3880 con 0x7efc740d41a0 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc7415c450 0x7efc741f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc7415c450 0x7efc741f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48912/0 (socket says 172.21.15.81:48912) 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 -- 172.21.15.81:0/637206599 learned_addr learned my addr 172.21.15.81:0/637206599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc737fe640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc740d41a0 0x7efc740caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc73fff640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415eda0 0x7efc74153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 -- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc740d41a0 msgr2=0x7efc740caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc740d41a0 0x7efc740caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 -- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415eda0 msgr2=0x7efc74153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415eda0 0x7efc74153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.299+0000 7efc72ffd640 1 -- 172.21.15.81:0/637206599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7406e2b0 con 0x7efc7415c450 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.300+0000 7efc72ffd640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc7415c450 0x7efc741f6230 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efc6800c400 tx=0x7efc6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.300+0000 7efc5bfff640 1 -- 172.21.15.81:0/637206599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68017070 con 0x7efc7415c450 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.300+0000 7efc5bfff640 1 -- 172.21.15.81:0/637206599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc680053c0 con 0x7efc7415c450 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.300+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc741f8f20 con 0x7efc7415c450 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.300+0000 7efc5bfff640 1 -- 172.21.15.81:0/637206599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68003850 con 0x7efc7415c450 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.300+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc741f94e0 con 0x7efc7415c450 2024-09-21T06:47:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.301+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7408d110 con 0x7efc7415c450 2024-09-21T06:47:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.302+0000 7efc5bfff640 1 -- 172.21.15.81:0/637206599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc6801a070 con 0x7efc7415c450 2024-09-21T06:47:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.302+0000 7efc5bfff640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7efc60078b90 0x7efc6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.302+0000 7efc5bfff640 1 -- 172.21.15.81:0/637206599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7efc68099f10 con 0x7efc7415c450 2024-09-21T06:47:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.302+0000 7efc737fe640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7efc60078b90 0x7efc6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.303+0000 7efc737fe640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7efc60078b90 0x7efc6007b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efc64034000 tx=0x7efc64004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.307+0000 7efc5bfff640 1 -- 172.21.15.81:0/637206599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efc7408d110 con 0x7efc7415c450 2024-09-21T06:47:08.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.483+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7efc74153d90 con 0x7efc60078b90 2024-09-21T06:47:08.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.484+0000 7efc5bfff640 1 -- 172.21.15.81:0/637206599 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efc74153d90 con 0x7efc60078b90 2024-09-21T06:47:08.486 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7efc60078b90 msgr2=0x7efc6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7efc60078b90 0x7efc6007b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efc64034000 tx=0x7efc64004730 comp rx=0 tx=0).stop 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc7415c450 msgr2=0x7efc741f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc7415c450 0x7efc741f6230 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efc6800c400 tx=0x7efc6800c8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 shutdown_connections 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7efc60078b90 0x7efc6007b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc7415eda0 0x7efc74153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc7415c450 0x7efc741f6230 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 --2- 172.21.15.81:0/637206599 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc740d41a0 0x7efc740caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.486+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 >> 172.21.15.81:0/637206599 conn(0x7efc740b7330 msgr2=0x7efc74161530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.487+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 shutdown_connections 2024-09-21T06:47:08.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.487+0000 7efc79e8b640 1 -- 172.21.15.81:0/637206599 wait complete. 2024-09-21T06:47:08.500 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T06:47:08.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 -- 172.21.15.81:0/3957243945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 msgr2=0x7f643c15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 --2- 172.21.15.81:0/3957243945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 0x7f643c15d730 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f643c0d1030 tx=0x7f643802a5d0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 -- 172.21.15.81:0/3957243945 shutdown_connections 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 --2- 172.21.15.81:0/3957243945 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f643c15e0b0 0x7f643c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 --2- 172.21.15.81:0/3957243945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 0x7f643c15d730 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 -- 172.21.15.81:0/3957243945 >> 172.21.15.81:0/3957243945 conn(0x7f643c0b4210 msgr2=0x7f643c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 -- 172.21.15.81:0/3957243945 shutdown_connections 2024-09-21T06:47:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.614+0000 7f6444230640 1 -- 172.21.15.81:0/3957243945 wait complete. 2024-09-21T06:47:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.616+0000 7f6444230640 1 Processor -- start 2024-09-21T06:47:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.616+0000 7f6444230640 1 -- start start 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.617+0000 7f6444230640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 0x7f643c1e9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.617+0000 7f6444230640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f643c0d1340 0x7f643c1430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.617+0000 7f6444230640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f643c15e0b0 0x7f643c143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.617+0000 7f6444230640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f643c15ed90 con 0x7f643c0cfda0 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.617+0000 7f6444230640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f643c15ec10 con 0x7f643c0d1340 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.617+0000 7f6444230640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f643c15ef10 con 0x7f643c15e0b0 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.617+0000 7f6441fcc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 0x7f643c1e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 0x7f643c1e9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48934/0 (socket says 172.21.15.81:48934) 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 -- 172.21.15.81:0/3242734952 learned_addr learned my addr 172.21.15.81:0/3242734952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f64417cb640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f643c0d1340 0x7f643c1430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 -- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f643c15e0b0 msgr2=0x7f643c143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f64427cd640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f643c15e0b0 0x7f643c143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f643c15e0b0 0x7f643c143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 -- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f643c0d1340 msgr2=0x7f643c1430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f643c0d1340 0x7f643c1430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 -- 172.21.15.81:0/3242734952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c0c7ad0 con 0x7f643c0cfda0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6441fcc640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 0x7f643c1e9030 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6438000c00 tx=0x7f6438005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643803e030 con 0x7f643c0cfda0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6438004ce0 con 0x7f643c0cfda0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c0c7db0 con 0x7f643c0cfda0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438035040 con 0x7f643c0cfda0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.618+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c1428c0 con 0x7f643c0cfda0 2024-09-21T06:47:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.619+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f643c15d730 con 0x7f643c0cfda0 2024-09-21T06:47:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.620+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6438041030 con 0x7f643c0cfda0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.620+0000 7f64327fc640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6420078bc0 0x7f642007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.620+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f64380bb850 con 0x7f643c0cfda0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.621+0000 7f64327fc640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f642007f0b0 0x7f6420081540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.621+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 --> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f643803be50 con 0x7f642007f0b0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.621+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f64380bbce0 con 0x7f643c0cfda0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.621+0000 7f64417cb640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6420078bc0 0x7f642007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.621+0000 7f64427cd640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f642007f0b0 0x7f6420081540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.621+0000 7f64417cb640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6420078bc0 0x7f642007b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f643c0c8b70 tx=0x7f642c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.621+0000 7f64427cd640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f642007f0b0 0x7f6420081540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.622+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== osd.7 v2:172.21.15.89:6826/2470132384 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f643803be50 con 0x7f642007f0b0 2024-09-21T06:47:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.634+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 --> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f643c0c5ae0 con 0x7f642007f0b0 2024-09-21T06:47:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f64327fc640 1 -- 172.21.15.81:0/3242734952 <== osd.7 v2:172.21.15.89:6826/2470132384 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f643c0c5ae0 con 0x7f642007f0b0 2024-09-21T06:47:08.637 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-21T06:47:08.637 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T06:47:08.637 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-21T06:47:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f642007f0b0 msgr2=0x7f6420081540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f6444230640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6826/2470132384,v1:172.21.15.89:6827/2470132384] conn(0x7f642007f0b0 0x7f6420081540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6420078bc0 msgr2=0x7f642007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f6444230640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f6420078bc0 0x7f642007b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f643c0c8b70 tx=0x7f642c009040 comp rx=0 tx=0).stop 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 msgr2=0x7f643c1e9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f6444230640 1 --2- 172.21.15.81:0/3242734952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f643c0cfda0 0x7f643c1e9030 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6438000c00 tx=0x7f6438005770 comp rx=0 tx=0).stop 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.635+0000 7f64427cd640 1 -- 172.21.15.81:0/3242734952 reap_dead start 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.636+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 shutdown_connections 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.636+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 >> 172.21.15.81:0/3242734952 conn(0x7f643c0b4210 msgr2=0x7f643c0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.636+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 shutdown_connections 2024-09-21T06:47:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.636+0000 7f6444230640 1 -- 172.21.15.81:0/3242734952 wait complete. 2024-09-21T06:47:08.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T06:47:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 -- 172.21.15.81:0/3294306232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 msgr2=0x7f170015d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 --2- 172.21.15.81:0/3294306232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f170015d6d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f16f8005fd0 tx=0x7f16f802a5a0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 -- 172.21.15.81:0/3294306232 shutdown_connections 2024-09-21T06:47:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 --2- 172.21.15.81:0/3294306232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f170015d6d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 --2- 172.21.15.81:0/3294306232 >> v2:172.21.15.89:3300/0 conn(0x7f17000d19a0 0x7f170015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 -- 172.21.15.81:0/3294306232 >> 172.21.15.81:0/3294306232 conn(0x7f17000d25e0 msgr2=0x7f17000d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 -- 172.21.15.81:0/3294306232 shutdown_connections 2024-09-21T06:47:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.759+0000 7f170783f640 1 -- 172.21.15.81:0/3294306232 wait complete. 2024-09-21T06:47:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.761+0000 7f170783f640 1 Processor -- start 2024-09-21T06:47:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.761+0000 7f170783f640 1 -- start start 2024-09-21T06:47:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f170783f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17000d19a0 0x7f17001f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f170783f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f17000b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f170783f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17001601c0 0x7f17000c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f170783f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17000730d0 con 0x7f170015d2c0 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f170783f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f1700072f50 con 0x7f17000d19a0 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f170783f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f1700073250 con 0x7f17001601c0 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f1704dda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f17000b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f1704dda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f17000b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48962/0 (socket says 172.21.15.81:48962) 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f1704dda640 1 -- 172.21.15.81:0/1229756337 learned_addr learned my addr 172.21.15.81:0/1229756337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f17055db640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17000d19a0 0x7f17001f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.762+0000 7f1705ddc640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17001601c0 0x7f17000c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f1704dda640 1 -- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17001601c0 msgr2=0x7f17000c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f1704dda640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17001601c0 0x7f17000c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f1704dda640 1 -- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17000d19a0 msgr2=0x7f17001f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f1704dda640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17000d19a0 0x7f17001f6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f1704dda640 1 -- 172.21.15.81:0/1229756337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17000b7100 con 0x7f170015d2c0 2024-09-21T06:47:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f1704dda640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f17000b6bc0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c3d0 tx=0x7f16f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f16fdffb640 1 -- 172.21.15.81:0/1229756337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4017070 con 0x7f170015d2c0 2024-09-21T06:47:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f16fdffb640 1 -- 172.21.15.81:0/1229756337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16f40053c0 con 0x7f170015d2c0 2024-09-21T06:47:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17001f5580 con 0x7f170015d2c0 2024-09-21T06:47:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f16fdffb640 1 -- 172.21.15.81:0/1229756337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4003850 con 0x7f170015d2c0 2024-09-21T06:47:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.763+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17000b7e20 con 0x7f170015d2c0 2024-09-21T06:47:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.764+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170015a290 con 0x7f170015d2c0 2024-09-21T06:47:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.765+0000 7f16fdffb640 1 -- 172.21.15.81:0/1229756337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16f401a070 con 0x7f170015d2c0 2024-09-21T06:47:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.765+0000 7f16fdffb640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f16ec078b90 0x7f16ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.765+0000 7f16fdffb640 1 -- 172.21.15.81:0/1229756337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f16f4099e30 con 0x7f170015d2c0 2024-09-21T06:47:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.765+0000 7f17055db640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f16ec078b90 0x7f16ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.766+0000 7f17055db640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f16ec078b90 0x7f16ec07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f16f0005fd0 tx=0x7f16f00095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.770+0000 7f16fdffb640 1 -- 172.21.15.81:0/1229756337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f17000b7100 con 0x7f170015d2c0 2024-09-21T06:47:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.946+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f17000b7860 con 0x7f16ec078b90 2024-09-21T06:47:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.947+0000 7f16fdffb640 1 -- 172.21.15.81:0/1229756337 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f17000b7860 con 0x7f16ec078b90 2024-09-21T06:47:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T06:47:08.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f16ec078b90 msgr2=0x7f16ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f16ec078b90 0x7f16ec07b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f16f0005fd0 tx=0x7f16f00095e0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 msgr2=0x7f17000b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f17000b6bc0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c3d0 tx=0x7f16f400c890 comp rx=0 tx=0).stop 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 shutdown_connections 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f16ec078b90 0x7f16ec07b0a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17001601c0 0x7f17000c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f170015d2c0 0x7f17000b6bc0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 --2- 172.21.15.81:0/1229756337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17000d19a0 0x7f17001f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 >> 172.21.15.81:0/1229756337 conn(0x7f17000d25e0 msgr2=0x7f170015b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 shutdown_connections 2024-09-21T06:47:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:08.949+0000 7f170783f640 1 -- 172.21.15.81:0/1229756337 wait complete. 2024-09-21T06:47:08.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 -- 172.21.15.81:0/3014295336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 msgr2=0x7f4cec0b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/3014295336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec0b96c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4cec08d040 tx=0x7f4cd402a4a0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 -- 172.21.15.81:0/3014295336 shutdown_connections 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/3014295336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec0b96c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/3014295336 >> v2:172.21.15.89:3300/0 conn(0x7f4cec15c450 0x7f4cec0d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 -- 172.21.15.81:0/3014295336 >> 172.21.15.81:0/3014295336 conn(0x7f4cec0b7330 msgr2=0x7f4cec0b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 -- 172.21.15.81:0/3014295336 shutdown_connections 2024-09-21T06:47:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.071+0000 7f4cf16f2640 1 -- 172.21.15.81:0/3014295336 wait complete. 2024-09-21T06:47:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.073+0000 7f4cf16f2640 1 Processor -- start 2024-09-21T06:47:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.073+0000 7f4cf16f2640 1 -- start start 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.074+0000 7f4cf16f2640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cec0b9c00 0x7f4cec1f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.074+0000 7f4cf16f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cec15c450 0x7f4cec14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.074+0000 7f4cf16f2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.074+0000 7f4cf16f2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec0b35c0 con 0x7f4cec15eda0 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.074+0000 7f4cf16f2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec0b3440 con 0x7f4cec15c450 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.074+0000 7f4cf16f2640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f4cec0b3740 con 0x7f4cec0b9c00 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec160ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48988/0 (socket says 172.21.15.81:48988) 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 -- 172.21.15.81:0/2705890996 learned_addr learned my addr 172.21.15.81:0/2705890996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceaffd640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cec0b9c00 0x7f4cec1f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ce27fc640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cec15c450 0x7f4cec14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 -- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cec0b9c00 msgr2=0x7f4cec1f94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cec0b9c00 0x7f4cec1f94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 -- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cec15c450 msgr2=0x7f4cec14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cec15c450 0x7f4cec14c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 -- 172.21.15.81:0/2705890996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cec14c840 con 0x7f4cec15eda0 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ceb7fe640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec160ee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400cab0 tx=0x7f4ce400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ce3fff640 1 -- 172.21.15.81:0/2705890996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4016020 con 0x7f4cec15eda0 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ce3fff640 1 -- 172.21.15.81:0/2705890996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ce400ad20 con 0x7f4cec15eda0 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cec06cea0 con 0x7f4cec15eda0 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4ce3fff640 1 -- 172.21.15.81:0/2705890996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4012660 con 0x7f4cec15eda0 2024-09-21T06:47:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.075+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cec06d460 con 0x7f4cec15eda0 2024-09-21T06:47:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.076+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cec08d110 con 0x7f4cec15eda0 2024-09-21T06:47:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.077+0000 7f4ce3fff640 1 -- 172.21.15.81:0/2705890996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ce4019020 con 0x7f4cec15eda0 2024-09-21T06:47:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.077+0000 7f4ce3fff640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4ccc078bc0 0x7f4ccc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.078+0000 7f4ce3fff640 1 -- 172.21.15.81:0/2705890996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f4ce409aed0 con 0x7f4cec15eda0 2024-09-21T06:47:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.078+0000 7f4ceaffd640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4ccc078bc0 0x7f4ccc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.078+0000 7f4ceaffd640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4ccc078bc0 0x7f4ccc07b0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc005fd0 tx=0x7f4cdc005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:09.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.082+0000 7f4ce3fff640 1 -- 172.21.15.81:0/2705890996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4cec08d110 con 0x7f4cec15eda0 2024-09-21T06:47:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.259+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cec0d3220 con 0x7f4ccc078bc0 2024-09-21T06:47:09.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.261+0000 7f4ce3fff640 1 -- 172.21.15.81:0/2705890996 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13405 (secure 0 0 0) 0x7f4cec0d3220 con 0x7f4ccc078bc0 2024-09-21T06:47:09.263 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:47:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4ccc078bc0 msgr2=0x7f4ccc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4ccc078bc0 0x7f4ccc07b0d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc005fd0 tx=0x7f4cdc005850 comp rx=0 tx=0).stop 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 msgr2=0x7f4cec160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec160ee0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400cab0 tx=0x7f4ce400cf70 comp rx=0 tx=0).stop 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 shutdown_connections 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f4ccc078bc0 0x7f4ccc07b0d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cec15eda0 0x7f4cec160ee0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cec15c450 0x7f4cec14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 --2- 172.21.15.81:0/2705890996 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4cec0b9c00 0x7f4cec1f94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 >> 172.21.15.81:0/2705890996 conn(0x7f4cec0b7330 msgr2=0x7f4cec0b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 shutdown_connections 2024-09-21T06:47:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:09.262+0000 7f4cf16f2640 1 -- 172.21.15.81:0/2705890996 wait complete. 2024-09-21T06:47:09.275 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-21T06:47:08.680529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227000,"kb_used_data":6600,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747720,"statfs":{"total":773094113280,"available":772861665280,"internally_reserved":0,"allocated":6758400,"data_stored":3656136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.583640"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":177,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T06:47:01.107072+0000","last_change":"2024-09-21T06:45:05.740815+0000","last_active":"2024-09-21T06:47:01.107072+0000","last_peered":"2024-09-21T06:47:01.107072+0000","last_clean":"2024-09-21T06:47:01.107072+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:47:01.107072+0000","last_undegraded":"2024-09-21T06:47:01.107072+0000","last_fullsized":"2024-09-21T06:47:01.107072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:45:04.732559+0000","last_clean_scrub_stamp":"2024-09-21T06:45:04.732559+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:19.899854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1290240,"data_stored":899793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":899793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:47:09.278 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T06:45:04.732559+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=6, tm_min=45, tm_sec=4, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=6, tm_min=47, tm_sec=4, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T06:47:09.278 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T06:47:29.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:47:29.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.406+0000 7f30c33e6640 1 -- 172.21.15.81:0/3708757363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8003a50 msgr2=0x7f30a8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.406+0000 7f30c33e6640 1 --2- 172.21.15.81:0/3708757363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8003a50 0x7f30a8003ec0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009b50 tx=0x7f30a8005830 comp rx=0 tx=0).stop 2024-09-21T06:47:29.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.406+0000 7f30c1983640 1 -- 172.21.15.81:0/3708757363 reap_dead start 2024-09-21T06:47:29.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.406+0000 7f30c33e6640 1 -- 172.21.15.81:0/3708757363 shutdown_connections 2024-09-21T06:47:29.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.406+0000 7f30c33e6640 1 -- 172.21.15.81:0/3708757363 >> 172.21.15.81:0/3708757363 conn(0x7f30bc0b2030 msgr2=0x7f30bc0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.406+0000 7f30c33e6640 1 -- 172.21.15.81:0/3708757363 shutdown_connections 2024-09-21T06:47:29.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.406+0000 7f30c33e6640 1 -- 172.21.15.81:0/3708757363 wait complete. 2024-09-21T06:47:29.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.407+0000 7f30c33e6640 1 Processor -- start 2024-09-21T06:47:29.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.408+0000 7f30c33e6640 1 -- start start 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c33e6640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30a8003a50 0x7f30bc156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c33e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc0cbb60 0x7f30bc15f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c33e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30bc15f540 0x7f30bc15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c33e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0b32b0 con 0x7f30bc0cbb60 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c33e6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc15cf60 con 0x7f30bc15f540 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c33e6640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc0b3430 con 0x7f30a8003a50 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc0cbb60 0x7f30bc15f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc0cbb60 0x7f30bc15f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43580/0 (socket says 172.21.15.81:43580) 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 -- 172.21.15.81:0/4179004989 learned_addr learned my addr 172.21.15.81:0/4179004989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 -- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30a8003a50 msgr2=0x7f30bc156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30a8003a50 0x7f30bc156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 -- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30bc15f540 msgr2=0x7f30bc15f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c1983640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30bc15f540 0x7f30bc15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30bc15f540 0x7f30bc15f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 -- 172.21.15.81:0/4179004989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc15fe90 con 0x7f30bc0cbb60 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.409+0000 7f30c0981640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc0cbb60 0x7f30bc15f000 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00e700 tx=0x7f30ac00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.410+0000 7f30b1ffb640 1 -- 172.21.15.81:0/4179004989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac015020 con 0x7f30bc0cbb60 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.410+0000 7f30b1ffb640 1 -- 172.21.15.81:0/4179004989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30ac004340 con 0x7f30bc0cbb60 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.410+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc15daf0 con 0x7f30bc0cbb60 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.410+0000 7f30b1ffb640 1 -- 172.21.15.81:0/4179004989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00ca00 con 0x7f30bc0cbb60 2024-09-21T06:47:29.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.410+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc15df60 con 0x7f30bc0cbb60 2024-09-21T06:47:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.411+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc15dcc0 con 0x7f30bc0cbb60 2024-09-21T06:47:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.412+0000 7f30b1ffb640 1 -- 172.21.15.81:0/4179004989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30ac018020 con 0x7f30bc0cbb60 2024-09-21T06:47:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.412+0000 7f30b1ffb640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f30a0078bc0 0x7f30a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.412+0000 7f30b1ffb640 1 -- 172.21.15.81:0/4179004989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f30ac09b360 con 0x7f30bc0cbb60 2024-09-21T06:47:29.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.413+0000 7f30c1182640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f30a0078bc0 0x7f30a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.413+0000 7f30c1182640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f30a0078bc0 0x7f30a007b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f30b8035000 tx=0x7f30b8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.417+0000 7f30b1ffb640 1 -- 172.21.15.81:0/4179004989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f30bc15dcc0 con 0x7f30bc0cbb60 2024-09-21T06:47:29.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.590+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 --> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30bc06ec90 con 0x7f30a0078bc0 2024-09-21T06:47:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.591+0000 7f30b1ffb640 1 -- 172.21.15.81:0/4179004989 <== mgr.4100 v2:172.21.15.89:6800/1544192706 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7f30bc06ec90 con 0x7f30a0078bc0 2024-09-21T06:47:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:47:29.592 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-21T06:47:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f30a0078bc0 msgr2=0x7f30a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f30a0078bc0 0x7f30a007b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f30b8035000 tx=0x7f30b8004730 comp rx=0 tx=0).stop 2024-09-21T06:47:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc0cbb60 msgr2=0x7f30bc15f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc0cbb60 0x7f30bc15f000 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00e700 tx=0x7f30ac00ebc0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 shutdown_connections 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f30a0078bc0 0x7f30a007b0d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30bc15f540 0x7f30bc15f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc0cbb60 0x7f30bc15f000 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 --2- 172.21.15.81:0/4179004989 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30a8003a50 0x7f30bc156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 >> 172.21.15.81:0/4179004989 conn(0x7f30bc0b2030 msgr2=0x7f30bc0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 shutdown_connections 2024-09-21T06:47:29.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.593+0000 7f30c33e6640 1 -- 172.21.15.81:0/4179004989 wait complete. 2024-09-21T06:47:29.605 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-21T06:47:28.685089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226996,"kb_used_data":6600,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747724,"statfs":{"total":773094113280,"available":772861669376,"internally_reserved":0,"allocated":6758400,"data_stored":3656136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002558"},"pg_stats":[{"pgid":"1.0","version":"58'74","reported_seq":188,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-21T06:47:06.807062+0000","last_change":"2024-09-21T06:47:06.807007+0000","last_active":"2024-09-21T06:47:06.807062+0000","last_peered":"2024-09-21T06:47:06.807062+0000","last_clean":"2024-09-21T06:47:06.807062+0000","last_became_active":"2024-09-21T06:45:05.740506+0000","last_became_peered":"2024-09-21T06:45:05.740506+0000","last_unstale":"2024-09-21T06:47:06.807062+0000","last_undegraded":"2024-09-21T06:47:06.807062+0000","last_fullsized":"2024-09-21T06:47:06.807062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'74","last_scrub_stamp":"2024-09-21T06:47:06.806929+0000","last_deep_scrub":"58'74","last_deep_scrub_stamp":"2024-09-21T06:47:06.806929+0000","last_clean_scrub_stamp":"2024-09-21T06:47:06.806929+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:13.606818+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1290240,"data_stored":899793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1290240,"data_stored":899793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542176,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":309425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:47:29.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T06:47:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.718+0000 7ff48727f640 1 -- 172.21.15.81:0/884485631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff46c004800 msgr2=0x7ff46c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.718+0000 7ff48727f640 1 --2- 172.21.15.81:0/884485631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff46c004800 0x7ff46c004c10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff4800b3e10 tx=0x7ff46c005830 comp rx=0 tx=0).stop 2024-09-21T06:47:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.718+0000 7ff48581c640 1 -- 172.21.15.81:0/884485631 reap_dead start 2024-09-21T06:47:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.718+0000 7ff48727f640 1 -- 172.21.15.81:0/884485631 shutdown_connections 2024-09-21T06:47:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.718+0000 7ff48727f640 1 -- 172.21.15.81:0/884485631 >> 172.21.15.81:0/884485631 conn(0x7ff4800b7330 msgr2=0x7ff4800b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.718+0000 7ff48727f640 1 -- 172.21.15.81:0/884485631 shutdown_connections 2024-09-21T06:47:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.718+0000 7ff48727f640 1 -- 172.21.15.81:0/884485631 wait complete. 2024-09-21T06:47:29.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.720+0000 7ff48727f640 1 Processor -- start 2024-09-21T06:47:29.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.720+0000 7ff48727f640 1 -- start start 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.721+0000 7ff48727f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c004800 0x7ff4801f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.721+0000 7ff48727f640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48006ec40 0x7ff48006f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.721+0000 7ff48727f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff48014a170 0x7ff48014a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.721+0000 7ff48727f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4800d4940 con 0x7ff48014a170 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.721+0000 7ff48727f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7ff4800d47c0 con 0x7ff46c004800 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.721+0000 7ff48727f640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7ff4800b9f70 con 0x7ff48006ec40 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff48014a170 0x7ff48014a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff48014a170 0x7ff48014a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43594/0 (socket says 172.21.15.81:43594) 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 -- 172.21.15.81:0/1310303819 learned_addr learned my addr 172.21.15.81:0/1310303819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48501b640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c004800 0x7ff4801f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48481a640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48006ec40 0x7ff48006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 -- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48006ec40 msgr2=0x7ff48006f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48006ec40 0x7ff48006f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 -- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c004800 msgr2=0x7ff4801f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c004800 0x7ff4801f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 -- 172.21.15.81:0/1310303819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4800c8340 con 0x7ff48014a170 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48481a640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48006ec40 0x7ff48006f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48581c640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff48014a170 0x7ff48014a580 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff478005fd0 tx=0x7ff47800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478004b20 con 0x7ff48014a170 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff478004cc0 con 0x7ff48014a170 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478003bd0 con 0x7ff48014a170 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4800cad30 con 0x7ff48014a170 2024-09-21T06:47:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.722+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48014b970 con 0x7ff48014a170 2024-09-21T06:47:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.723+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4800c80b0 con 0x7ff48014a170 2024-09-21T06:47:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.724+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff478004030 con 0x7ff48014a170 2024-09-21T06:47:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.724+0000 7ff475ffb640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff464078b90 0x7ff46407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.725+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7ff47809af40 con 0x7ff48014a170 2024-09-21T06:47:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.725+0000 7ff48501b640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff464078b90 0x7ff46407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.725+0000 7ff48501b640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff464078b90 0x7ff46407b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff47c005940 tx=0x7ff47c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.729+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff478062f30 con 0x7ff48014a170 2024-09-21T06:47:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.907+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff48008d110 con 0x7ff48014a170 2024-09-21T06:47:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.910+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v36)=0 v36) ==== 123+0+0 (secure 0 0 0) 0x7ff48008d110 con 0x7ff48014a170 2024-09-21T06:47:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.911+0000 7ff475ffb640 1 -- 172.21.15.81:0/1310303819 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7ff478062a40 con 0x7ff48014a170 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff464078b90 msgr2=0x7ff46407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff464078b90 0x7ff46407b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff47c005940 tx=0x7ff47c005f90 comp rx=0 tx=0).stop 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff48014a170 msgr2=0x7ff48014a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff48014a170 0x7ff48014a580 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff478005fd0 tx=0x7ff47800f3c0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 shutdown_connections 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7ff464078b90 0x7ff46407b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff48006ec40 0x7ff48006f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff48014a170 0x7ff48014a580 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 --2- 172.21.15.81:0/1310303819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff46c004800 0x7ff4801f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 >> 172.21.15.81:0/1310303819 conn(0x7ff4800b7330 msgr2=0x7ff48015d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 shutdown_connections 2024-09-21T06:47:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:29.913+0000 7ff48727f640 1 -- 172.21.15.81:0/1310303819 wait complete. 2024-09-21T06:47:29.925 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:47:29.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T06:47:30.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.037+0000 7f7250e8b640 1 -- 172.21.15.81:0/3292181365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7234004800 msgr2=0x7f7234004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:30.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.037+0000 7f7250e8b640 1 --2- 172.21.15.81:0/3292181365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7234004800 0x7f7234004c10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7240006fc0 tx=0x7f7234005830 comp rx=0 tx=0).stop 2024-09-21T06:47:30.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.037+0000 7f724ad9d640 1 -- 172.21.15.81:0/3292181365 reap_dead start 2024-09-21T06:47:30.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.037+0000 7f7250e8b640 1 -- 172.21.15.81:0/3292181365 shutdown_connections 2024-09-21T06:47:30.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.037+0000 7f7250e8b640 1 -- 172.21.15.81:0/3292181365 >> 172.21.15.81:0/3292181365 conn(0x7f724c09aa30 msgr2=0x7f724c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:30.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.037+0000 7f7250e8b640 1 -- 172.21.15.81:0/3292181365 shutdown_connections 2024-09-21T06:47:30.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.037+0000 7f7250e8b640 1 -- 172.21.15.81:0/3292181365 wait complete. 2024-09-21T06:47:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.039+0000 7f7250e8b640 1 Processor -- start 2024-09-21T06:47:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.039+0000 7f7250e8b640 1 -- start start 2024-09-21T06:47:30.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f7250e8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7234004800 0x7f724c09ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:30.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f7250e8b640 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c140670 0x7f724c140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:30.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f7250e8b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f724c06cd90 0x7f724c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f7250e8b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0d1030 con 0x7f724c06cd90 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f7250e8b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 -- 0x7f724c06f180 con 0x7f7234004800 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f7250e8b640 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 -- 0x7f724c0d11b0 con 0x7f724c140670 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f724ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f724c06cd90 0x7f724c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f724ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f724c06cd90 0x7f724c06d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43620/0 (socket says 172.21.15.81:43620) 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f724ad9d640 1 -- 172.21.15.81:0/3776335658 learned_addr learned my addr 172.21.15.81:0/3776335658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f724a59c640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7234004800 0x7f724c09ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.040+0000 7f7249d9b640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c140670 0x7f724c140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f724ad9d640 1 -- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c140670 msgr2=0x7f724c140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f724ad9d640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c140670 0x7f724c140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f724ad9d640 1 -- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7234004800 msgr2=0x7f724c09ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f724ad9d640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7234004800 0x7f724c09ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f724ad9d640 1 -- 172.21.15.81:0/3776335658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c06d6e0 con 0x7f724c06cd90 2024-09-21T06:47:30.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f724ad9d640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f724c06cd90 0x7f724c06d1a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f724c074c70 tx=0x7f7244011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f723affd640 1 -- 172.21.15.81:0/3776335658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7244004230 con 0x7f724c06cd90 2024-09-21T06:47:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f723affd640 1 -- 172.21.15.81:0/3776335658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f7244016070 con 0x7f724c06cd90 2024-09-21T06:47:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c1445f0 con 0x7f724c06cd90 2024-09-21T06:47:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f723affd640 1 -- 172.21.15.81:0/3776335658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724400f860 con 0x7f724c06cd90 2024-09-21T06:47:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.041+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c141510 con 0x7f724c06cd90 2024-09-21T06:47:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.042+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c1f7510 con 0x7f724c06cd90 2024-09-21T06:47:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.043+0000 7f723affd640 1 -- 172.21.15.81:0/3776335658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f724400fa00 con 0x7f724c06cd90 2024-09-21T06:47:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.043+0000 7f723affd640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f722c078bc0 0x7f722c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.043+0000 7f723affd640 1 -- 172.21.15.81:0/3776335658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f724409b410 con 0x7f724c06cd90 2024-09-21T06:47:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.043+0000 7f724a59c640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f722c078bc0 0x7f722c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.044+0000 7f724a59c640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f722c078bc0 0x7f722c07b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f723c000f80 tx=0x7f723c004a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:30.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.048+0000 7f723affd640 1 -- 172.21.15.81:0/3776335658 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f724c06d6e0 con 0x7f724c06cd90 2024-09-21T06:47:30.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.263+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f724c1447c0 con 0x7f724c06cd90 2024-09-21T06:47:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.264+0000 7f723affd640 1 -- 172.21.15.81:0/3776335658 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3908 (secure 0 0 0) 0x7f7244063400 con 0x7f724c06cd90 2024-09-21T06:47:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-21T06:47:30.265 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-21T06:46:58:933513+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4961,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2835319060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2835319060},{"type":"v1","addr":"172.21.15.89:6836","nonce":2835319060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4964,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/4230376453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":4230376453},{"type":"v1","addr":"172.21.15.89:6837","nonce":4230376453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/325230929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":325230929},{"type":"v1","addr":"172.21.15.81:6834","nonce":325230929}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5721,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3598477274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3598477274},{"type":"v1","addr":"172.21.15.81:6835","nonce":3598477274}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-09-21T06:47:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-21T06:47:30.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f722c078bc0 msgr2=0x7f722c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f722c078bc0 0x7f722c07b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f723c000f80 tx=0x7f723c004a00 comp rx=0 tx=0).stop 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f724c06cd90 msgr2=0x7f724c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f724c06cd90 0x7f724c06d1a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f724c074c70 tx=0x7f7244011b10 comp rx=0 tx=0).stop 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 shutdown_connections 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:6800/1544192706,v1:172.21.15.89:6801/1544192706] conn(0x7f722c078bc0 0x7f722c07b0d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f724c140670 0x7f724c140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f724c06cd90 0x7f724c06d1a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 --2- 172.21.15.81:0/3776335658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7234004800 0x7f724c09ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 >> 172.21.15.81:0/3776335658 conn(0x7f724c09aa30 msgr2=0x7f724c0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 shutdown_connections 2024-09-21T06:47:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-21T06:47:30.266+0000 7f7250e8b640 1 -- 172.21.15.81:0/3776335658 wait complete. 2024-09-21T06:47:30.279 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-21T06:47:30.279 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T06:47:30.279 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T06:47:30.279 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.289 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T06:47:30.289 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T06:47:30.289 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.341 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T06:47:30.341 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T06:47:30.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.354 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T06:47:30.354 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T06:47:30.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.407 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T06:47:30.407 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T06:47:30.407 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T06:47:30.407 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.432 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T06:47:30.433 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T06:47:30.433 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.505 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T06:47:30.505 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T06:47:30.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.574 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T06:47:30.575 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T06:47:30.575 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.647 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T06:47:30.647 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T06:47:30.647 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.680 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T06:47:30.680 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T06:47:30.680 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.758 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T06:47:30.758 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T06:47:30.758 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.827 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T06:47:30.827 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T06:47:30.827 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.901 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T06:47:30.902 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T06:47:30.902 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T06:47:30.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.929 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T06:47:30.929 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T06:47:30.930 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.974 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T06:47:30.974 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T06:47:30.974 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T06:47:30.974 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:30.985 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T06:47:30.985 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T06:47:30.985 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:31.027 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T06:47:31.028 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T06:47:31.028 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T06:47:31.081 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T06:47:31.082 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T06:47:31.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T06:47:31.120 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:47:31.120 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T06:47:31.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:47:31.350 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T06:47:31.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:47:31.440 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T06:47:31.498 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:47:31.498 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T06:47:31.548 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:47:31.548 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T06:47:31.701 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:47:31.701 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T06:47:31.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:31.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:31.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:47:31.779 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T06:47:31.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:47:31.879 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T06:47:31.959 INFO:tasks.ceph:Archiving mon data... 2024-09-21T06:47:31.960 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/data/mon.a.tgz 2024-09-21T06:47:31.960 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-21T06:47:31.975 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.y4K5TxADJC 2024-09-21T06:47:31.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.y4K5TxADJC 2024-09-21T06:47:32.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.y4K5TxADJC 2024-09-21T06:47:32.197 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.y4K5TxADJC is 348KB 2024-09-21T06:47:32.298 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.y4K5TxADJC 2024-09-21T06:47:32.313 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/data/mon.b.tgz 2024-09-21T06:47:32.313 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-21T06:47:32.328 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.tvJCmEg9XF 2024-09-21T06:47:32.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tvJCmEg9XF 2024-09-21T06:47:32.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.tvJCmEg9XF 2024-09-21T06:47:32.576 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.tvJCmEg9XF is 464KB 2024-09-21T06:47:32.672 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.tvJCmEg9XF 2024-09-21T06:47:32.687 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/data/mon.c.tgz 2024-09-21T06:47:32.687 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-21T06:47:32.742 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.JSdGkCSaoa 2024-09-21T06:47:32.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.JSdGkCSaoa 2024-09-21T06:47:32.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.JSdGkCSaoa 2024-09-21T06:47:32.976 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.JSdGkCSaoa is 464KB 2024-09-21T06:47:33.072 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.JSdGkCSaoa 2024-09-21T06:47:33.087 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T06:47:33.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T06:47:33.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T06:47:33.171 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T06:47:33.207 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T06:47:33.207 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T06:47:33.209 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/remote/smithi081/crash 2024-09-21T06:47:33.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T06:47:33.238 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/remote/smithi089/crash 2024-09-21T06:47:33.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T06:47:33.271 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T06:47:33.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:33.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:33.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:33.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T06:47:33.439 INFO:tasks.ceph:Compressing logs... 2024-09-21T06:47:33.439 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:47:33.458 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:47:33.481 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49331.log 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52875.log 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37145.log 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49331.log.gz 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47374.log 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52875.log.gz 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43069.log 2024-09-21T06:47:33.482 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37145.log.gz 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42807.log 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.3.42807.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42807.log.gz 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42409.log 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.1.42409.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph.audit.log 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr: -- replaced with /var/log/ceph/ceph-client.1.42409.log.gz 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T06:47:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36797.log 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36917.log 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36957.log 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36917.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36797.log.gz 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36917.log.gz 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr: -- /var/log/ceph/ceph-osd.6.log 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36957.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36957.log.gz 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.6.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.5.log: -- /var/log/ceph/ceph-client.admin.37037.log 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.37037.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37037.log.gz 2024-09-21T06:47:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T06:47:33.525 INFO:teuthology.orchestra.run.smithi089.stderr: /var/log/ceph/ceph-mgr.x.log 2024-09-21T06:47:33.525 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-mds.d.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36757.log 2024-09-21T06:47:33.525 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.x.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T06:47:33.525 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T06:47:33.525 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36757.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36757.log.gz 2024-09-21T06:47:33.525 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36837.log 2024-09-21T06:47:33.532 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36997.log 2024-09-21T06:47:33.539 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36837.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36837.log.gz 2024-09-21T06:47:33.552 INFO:teuthology.orchestra.run.smithi089.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T06:47:33.552 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36877.log 2024-09-21T06:47:33.552 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36997.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36997.log.gz 2024-09-21T06:47:33.552 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.36877.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36877.log.gz 2024-09-21T06:47:33.562 INFO:teuthology.orchestra.run.smithi089.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T06:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2024-09-21T06:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47374.log: /var/log/ceph/ceph-client.admin.43069.log: gzip -5 87.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47374.log.gz /var/log/ceph/ceph-client.admin.49373.log 2024-09-21T06:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47458.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43069.log.gz 2024-09-21T06:47:33.602 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36415.log 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49499.log 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49373.log.gz 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46064.log 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36415.log.gz 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55056.log 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49499.log.gz 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49004.log 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46064.log.gz 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36387.log 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55056.log.gz 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54659.log 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49004.log.gz 2024-09-21T06:47:33.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55349.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36387.log.gz 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45062.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.54659.log.gz 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49817.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55349.log.gz 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51091.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.45062.log.gz 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36555.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49817.log.gz 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.51091.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.43424.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.0.51091.log.gz 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53169.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36555.log.gz 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2024-09-21T06:47:33.604 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53169.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49583.log 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51235.log 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55391.log 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49583.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55559.log 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51235.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55685.log 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55391.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43298.log 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55559.log.gz 2024-09-21T06:47:33.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45055.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55685.log.gz 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53900.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43298.log.gz 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46232.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45055.log.gz 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.53900.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53900.log.gz 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50005.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52037.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46232.log.gz 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.50005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50005.log.gz 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46717.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48192.log 2024-09-21T06:47:33.606 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52037.log.gz 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.46717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46717.log.gz 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52234.log 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45679.log 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48192.log.gz 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48463.log 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52234.log.gz 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55433.log 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45679.log: /var/log/ceph/ceph-client.admin.48463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45679.log.gz 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48463.log.gz 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55433.log.gz 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43113.log 2024-09-21T06:47:33.607 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52437.log 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45602.log: /var/log/ceph/ceph-client.admin.43113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43658.log 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43113.log.gz 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50861.log 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52437.log.gz 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43658.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43466.log 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43658.log.gz 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47626.log 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50861.log: /var/log/ceph/ceph-client.admin.43466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50861.log.gz 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43466.log.gz 2024-09-21T06:47:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46148.log 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47626.log.gz 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52703.log 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43508.log: /var/log/ceph/ceph-client.admin.46148.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44859.log 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46148.log.gz 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36695.log 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52703.log: /var/log/ceph/ceph-client.admin.44859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43254.log 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52703.log.gz 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44859.log.gz 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36695.log.gz 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43254.log.gz 2024-09-21T06:47:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54146.log 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44774.log 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56147.log 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54146.log: /var/log/ceph/ceph-client.admin.44774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54146.log.gz 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44774.log.gz 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52314.log 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56147.log.gz 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36639.log 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49709.log: /var/log/ceph/ceph-client.admin.52314.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54869.log 2024-09-21T06:47:33.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52314.log.gz 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54911.log 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36639.log.gz 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45060.log 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54869.log.gz 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44732.log 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54911.log.gz 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52568.log 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45060.log: /var/log/ceph/ceph-client.admin.44732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50784.log 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45060.log.gz 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44732.log.gz/var/log/ceph/ceph-client.admin.52568.log: 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45373.log 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52568.log.gz 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2024-09-21T06:47:33.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50784.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45980.log 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45373.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51743.log 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.45980.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55307.log 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45980.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51743.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36303.log 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56229.log 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55307.log: /var/log/ceph/ceph-client.admin.36303.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55307.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.36303.log.gz 2024-09-21T06:47:33.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55014.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56229.log: /var/log/ceph/ceph-client.admin.45721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36723.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56229.log.gz 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55014.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55014.log.gz 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36723.log.gz 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52097.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47156.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54524.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52097.log.gz 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.47156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51701.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.47156.log.gz 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51869.log 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T06:47:33.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51701.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54524.log.gz 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45378.log 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51701.log.gz 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51869.log.gz 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54785.log 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45378.log.gz 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49415.log 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54785.log.gz 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45042.log: /var/log/ceph/ceph-client.admin.49415.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53085.log 2024-09-21T06:47:33.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49415.log.gz 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50640.log 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45366.log: /var/log/ceph/ceph-client.admin.53085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51491.log 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53085.log.gz 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.50640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50640.log.gz 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52524.log 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48421.log 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51491.log.gz 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52524.log.gz 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52917.log 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48421.log: /var/log/ceph/ceph-client.admin.44480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49163.log 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48421.log.gz 2024-09-21T06:47:33.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47500.log 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52917.log.gz 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56105.log 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49163.log.gz 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50903.log 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47500.log: /var/log/ceph/ceph-client.admin.56105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42903.log 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47500.log.gz 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56105.log.gz 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43340.log 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50903.log.gz 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45061.log 2024-09-21T06:47:33.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42903.log: /var/log/ceph/ceph-client.admin.43340.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42903.log.gz 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52791.log 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45061.log: /var/log/ceph/ceph-client.admin.52791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51785.log 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45061.log.gz 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52791.log.gz 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48919.log 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55098.log 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51785.log: /var/log/ceph/ceph-client.admin.48919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36499.log 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51785.log.gz 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48919.log.gz 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53001.log 2024-09-21T06:47:33.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55098.log.gz 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44522.log 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36499.log.gz 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52833.log 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53001.log.gz 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48318.log 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36274.log 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44522.log.gz 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52833.log: /var/log/ceph/ceph-client.admin.48318.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52833.log.gz 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53127.log 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48318.log.gz 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42518.log 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36274.log.gz 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51659.log 2024-09-21T06:47:33.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53127.log.gz 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55769.log 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42518.log.gz 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53277.log 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51659.log.gz 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47332.log 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55769.log.gz 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42985.log 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53277.log.gz 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47332.log: /var/log/ceph/ceph-client.admin.42985.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47332.log.gz 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49667.log 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42985.log.gz 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54827.log 2024-09-21T06:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.49667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49667.log.gz 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54827.log.gz 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55643.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44606.log: /var/log/ceph/ceph-client.admin.36162.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz --verbose 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.55811.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48024.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55643.log.gz 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55811.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54743.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48024.log: /var/log/ceph/ceph-client.admin.45722.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48024.log.gz 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-09-21T06:47:33.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45051.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54743.log: /var/log/ceph/ceph-client.admin.47542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36247.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54743.log.gz 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45051.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45051.log.gz 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36247.log: 74.3% -- replaced with /var/log/ceph/ceph-client.admin.36247.log.gz 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36471.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44816.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36471.log.gz 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53635.log 2024-09-21T06:47:33.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44816.log.gz 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36443.log 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53635.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47290.log 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53635.log.gz 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53465.log 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36443.log.gz 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49541.log 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47290.log: /var/log/ceph/ceph-client.0.53465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53465.log.gz 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47290.log.gz 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54701.log 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55937.log 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49541.log.gz 2024-09-21T06:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55727.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54701.log.gz 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53561.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55937.log: /var/log/ceph/ceph-client.admin.55727.log: 87.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55937.log.gz -5 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46022.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55727.log.gz 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.53561.log.gz 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44690.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45059.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46022.log.gz 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55601.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.44690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55517.log 2024-09-21T06:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44690.log.gz 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52395.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55601.log.gz 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55979.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55517.log.gz 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50182.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52395.log.gz/var/log/ceph/ceph-client.admin.55979.log: 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55979.log.gz 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53712.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50182.log.gz 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45938.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53712.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48585.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53712.log.gz 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54334.log 2024-09-21T06:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45938.log.gz 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48585.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.0.54334.log: -- replaced with /var/log/ceph/ceph-client.admin.48585.log.gz 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.0.54334.log.gz /var/log/ceph/ceph-client.admin.46106.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51911.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48150.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46106.log.gz 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51995.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51911.log.gz 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56271.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48150.log.gz 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51995.log.gz 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2024-09-21T06:47:33.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56271.log.gz 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53211.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51575.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54617.log 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: 92.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55895.log 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53211.log.gz 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54617.log: 84.8%/var/log/ceph/ceph-client.admin.55895.log: -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55895.log.gz 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42807.log: -- replaced with /var/log/ceph/ceph-client.admin.54617.log.gz 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-09-21T06:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36667.log 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36667.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54429.log 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44261.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.50300.log 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36219.log 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54429.log.gz 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45379.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50300.log.gz 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36219.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36359.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47584.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45379.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36359.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36331.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36583.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47584.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36331.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43592.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36583.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36583.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50224.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45360.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50224.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50224.log.gz 2024-09-21T06:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45360.log.gz 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44396.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51312.log 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43382.log 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44396.log.gz 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.51312.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48708.log 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43382.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51312.log.gz 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52661.log 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43382.log.gz 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51953.log 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48708.log.gz 2024-09-21T06:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52661.log.gz 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55475.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51953.log.gz 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48066.log 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50374.log 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55475.log.gz 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48066.log.gz 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52139.log 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50374.log.gz 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2024-09-21T06:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46852.log 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52139.log.gz 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50139.log 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.46852.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43027.log 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%/var/log/ceph/ceph-client.admin.50139.log: -- replaced with /var/log/ceph/ceph-client.admin.46852.log.gz 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56021.log 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50139.log.gz 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43027.log.gz 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48360.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56021.log.gz 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43550.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.48793.log 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-09-21T06:47:33.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48360.log.gz 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51827.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48505.log 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54972.log 87.5% 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51827.log.gz 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36751.log 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.48505.log.gz 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2024-09-21T06:47:33.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54972.log.gz 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48750.log 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36751.log: /var/log/ceph/ceph-client.admin.44564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53995.log 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36751.log.gz 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz/var/log/ceph/ceph-client.admin.48750.log: 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45405.log 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48750.log.gz 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30130.log 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53995.log: /var/log/ceph/ceph-client.admin.45405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51407.log 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.30130.log: gzip 87.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.45405.log.gz --verbose 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.47857.log 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53995.log.gz 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30130.log.gz 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48108.log 2024-09-21T06:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51407.log.gz 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49205.log 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47857.log.gz 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48108.log.gz 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49751.log 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49205.log.gz 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50085.log 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37346.log 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49751.log.gz 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.admin.37346.log: -- replaced with /var/log/ceph/ceph-client.admin.50085.log.gz 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56063.log 2024-09-21T06:47:33.634 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37346.log.gz 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55853.log 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36611.log: /var/log/ceph/ceph-client.admin.56063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52959.log 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56063.log.gz 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48962.log 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55853.log.gz 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49457.log 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52959.log.gz 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48962.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48962.log.gz 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49457.log.gz 2024-09-21T06:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44319.log 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56189.log 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48877.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44319.log.gz 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56189.log: 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.56189.log.gz 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48877.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48877.log.gz 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52749.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51533.log 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50452.log 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52749.log.gz 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52619.log 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50452.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51533.log.gz 2024-09-21T06:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50452.log.gz 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54069.log 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53043.log 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54069.log: /var/log/ceph/ceph-client.admin.52619.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52619.log.gz 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54069.log.gz 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49247.log 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51617.log 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53043.log: /var/log/ceph/ceph-client.admin.49247.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53043.log.gz 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49247.log.gz 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48234.log 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49289.log 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48234.log: /var/log/ceph/ceph-client.admin.51617.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51617.log.gz 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48234.log.gz 2024-09-21T06:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49121.log 2024-09-21T06:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2024-09-21T06:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49289.log: /var/log/ceph/ceph-client.admin.49121.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49289.log.gz 2024-09-21T06:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49121.log.gz 2024-09-21T06:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52479.log 2024-09-21T06:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49077.log: /var/log/ceph/ceph-client.admin.52479.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2024-09-21T06:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52479.log.gz 2024-09-21T06:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T06:47:33.639 INFO:teuthology.orchestra.run.smithi089.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T06:47:33.639 INFO:teuthology.orchestra.run.smithi089.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T06:47:33.745 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T06:47:34.202 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T06:47:34.214 INFO:teuthology.orchestra.run.smithi081.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T06:47:34.219 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T06:47:34.236 INFO:teuthology.orchestra.run.smithi089.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T06:47:34.255 INFO:teuthology.orchestra.run.smithi089.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T06:47:34.268 INFO:teuthology.orchestra.run.smithi089.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T06:47:34.270 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-21T06:47:34.270 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m0.776s 2024-09-21T06:47:34.270 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m3.149s 2024-09-21T06:47:34.270 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.146s 2024-09-21T06:47:34.303 INFO:teuthology.orchestra.run.smithi081.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T06:47:34.345 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T06:47:34.346 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-21T06:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m0.876s 2024-09-21T06:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m3.295s 2024-09-21T06:47:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.262s 2024-09-21T06:47:34.347 INFO:tasks.ceph:Archiving logs... 2024-09-21T06:47:34.347 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/remote/smithi081/log 2024-09-21T06:47:34.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:47:35.025 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/remote/smithi089/log 2024-09-21T06:47:35.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:47:35.471 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:47:35.481 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:47:35.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:47:35.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:47:35.563 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:47:35.571 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:47:35.571 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:47:35.574 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:47:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:47:35.589 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:47:35.591 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:47:35.591 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-21T06:47:35.591 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 63 -75us[ -68us] +/- 63ms 2024-09-21T06:47:35.591 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 0 +49us[ +59us] +/- 63ms 2024-09-21T06:47:35.591 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +28us[ +34us] +/- 63ms 2024-09-21T06:47:35.591 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:47:35.593 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:47:35.594 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-21T06:47:35.594 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 62 -79us[ -73us] +/- 63ms 2024-09-21T06:47:35.594 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv02.front.sepia.ceph.com 3 6 377 62 +68us[ +73us] +/- 62ms 2024-09-21T06:47:35.594 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +37us[ +37us] +/- 63ms 2024-09-21T06:47:35.594 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:47:35.594 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:47:35.602 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:47:35.602 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:47:35.631 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:47:35.705 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:47:35.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:47:35.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:47:35.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:47:35.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:47:35.826 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:47:35.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:47:35.857 INFO:teuthology.task.internal:Duration was 552.026294 seconds 2024-09-21T06:47:35.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:47:35.890 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:47:35.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:47:35.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:47:35.929 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:47:35.932 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:47:36.254 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:47:36.254 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-21T06:47:36.254 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:47:36.274 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-21T06:47:36.274 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:47:36.318 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:47:36.318 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:47:36.321 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:47:36.384 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:47:36.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:47:36.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:47:36.526 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:47:36.536 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:47:36.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:47:36.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:47:36.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:47:36.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:47:36.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:47:36.625 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-21T06:47:36.651 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-21T06:47:36.664 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:47:36.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:47:36.693 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:47:36.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:47:36.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:47:36.733 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:47:36.733 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/remote/smithi081 2024-09-21T06:47:36.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:47:36.767 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913561/remote/smithi089 2024-09-21T06:47:36.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:47:36.799 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:47:36.799 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:47:36.804 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:47:36.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:47:36.860 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:47:36.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:47:36.916 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:47:36.916 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:47:36.919 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:47:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:47 /home/ubuntu/cephtest 2024-09-21T06:47:36.933 INFO:teuthology.orchestra.run.smithi089.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:47 /home/ubuntu/cephtest 2024-09-21T06:47:36.934 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:47:36.944 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:47:37.012 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/pool-perm} duration: 552.0262939929962 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:47:37.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:47:37.085 INFO:teuthology.run:pass